LOL well I will still give it a shot. I had a Saturn car that did the exact same thing. Especially when the car was hot. What the problem was is the car lost fuel prime every time it shut off and when cranking on it the first time it didn't have enough fuel pressure and when you let off on cranking it and cranked it again the fuel pump had built up enough pressure to start the engine. Car ran great the whole time and never gave me any problems but the shop I took it to about the issue said the fuel pump needed to be replaced cause of the way the car has to hold fuel prime through the fuel pump. So I don't know if that's how those TJ's hold fuel prime but I would check for any small fuel leaks or bad fuel filters or a weak fuel pump. Check fuel pressure when you shut off the jeep. And check it after it sits for a while. Hope this helps.
Your friend from the YJ world!!