There is no reason to worry about a TJ with a 4 to 5.5" lift on it no longer handling/riding well enough to be a daily driver. My present TJ is darned near a daily driver with its 4" Currie lift and my previous TJ was a daily driver with a 5.5" lift at one point with a 4.5" RE lift its last several years which is more like 5 to 5.5" in reality. Both TJs handled and rode just fine as daily drivers, even on the twisty mountain roads I'm on all the time.
Any of those lift heights can work just fine for a daily driver IF the Jeep is set up properly with the right shocks, f/r antisway bars, tires, and wheel backspacing. Personally, I would not go with RE Twin-Tube or Skyjacker Nitro shocks, I'd find better riding shocks. OME Nitrochargers, Skyjacker Hydros, Bilstein 5100 (the version valved for Wranglers), Rancho R9000xl, ProComp MX-6, and Savvy's new specially valved Fox shocks. Personally, I'd go with Savvy's new Fox shocks after driving a TJ with them Best riding/handling TJ I've ever driven or been in.