As long as your whole roll bar is painted, nothing will happen to the Jeep(not CAR!
) other than a few accidental scratches to the roll bar paint here and there.
To be honest, I would be more concerned about you or your friends getting concusions wheeling than the Jeep. Also, be very careful taking the padding off the roll bars. Its very easy to snap the foam in half, while trying to work the plastic pop-pins out of the bars.