I ran mine like that for a year or so. 5.5" lift with RE fixed lowers and stock uppers. It was driveable, but difficult to get aligned properly to get rid of death wobble and it rode like a cement truck. I had to slow to about 3.6 mph to go over speed bumps. Now with the long arm, I can cruise over the same speed bumps at 20. Much smoother ride.
It's doable, but you won't like it. I'd get some drop brackets from Jason (grimus) at Rough Country before putting it all back together and save yourself some hassle.
On the other hand I've never heard of anybody lowering a rig (from being big...not talking about these ricer pansy's that are a penny a dozen) unless they were transfering the schit to a new rig. Sad story!