Whether you have the soft top UP or DOWN, you do need to wear ear plugs for other than a short trip.
After 18 years of driving topless, I developed a ringing in my ears which never stopped. I was diagnosed with tinnitus caused by cumulative nerve damage. Now I have a hardtop-only Jeep.
To minimize the noise with the top up, run the fan at setting 2 or 3 to puff the top out. But still, for any longer trips, you and all passengers need earplugs. Especially children.