Deep inside the column you will find 3-4 screw that hold a plate inside the tube. Most likely these are loose. When you tighten them up make sure to use threadlock to keep em tight. You may find the pivot pins are sloppy and if replacement of them does not help the pivot housing is probly shot.
Tilt column rebuild isnt that hard just tedious. The GM Saginaw tilt columns are as common as fleas on a dog. The shafts and lengths may be different but the internals havent changed much in 20 years(mid70s to mid 90s). Go to a UPullIt, tear a GM column open and snag what you need. This will undoubtedly really piss the JY off cuz they want to sell the column whole. Just tell em the steering wheel was missing and it was already in pieces, lol. Most of the small parts are pocketable as well.
Heres the link I used to rebuild mine. It is Fiero specific but again the internals are identical to YJ
Save this .pdf and take the tablet or laptop down to the garage while your working on it. I had this .pdf and Grant steering wheel installation instructions up and running while I was working on my column. I cleaned all the old grease out and regreased everything including the internal steering shaft bearings. I replaced the wiper switch ($60), the ignition switch ($12), turn signal switch ($25), lower column bearing ($11). I deleted the key in the ignition dealie cuz I hate them and hooked the horn up with Grant's help. The PO couldnt figure it out but the instructions are only one page including pics!
The column is now ready for 20 more years of service and I have to thank Jazzman because it was a lot easier with the step by step assembly instructions. Start at the last page for disassembly and work forward.