Yes, I had completely disassembled the driveshaft by removing all of the u-joints and taking apart the ball centering assembly as much as I could. The spring and pins fell out easily enough and I removed the seal that holds in the ball centering assembly, but the ball and the sleeve that it rides in remained very well seated in its original home (don't know the name of that part, but you can see it in the attached schematic diagram in the guy's hand). I don't have a photo of the seated ball and sleeve though.
Anyhow, I took it to a shop on Friday that said that I just needed to put a punch into the hole in the ball and crank on it real hard. I don't have a vise to hold it and could never actually get it out. Their service guy was out so they couldn't do it for me right then, but I figured that I would take it in today or tomorrow to have them do it, since I'm having no luck. Is this common? I hadn't read about anybody else having this problem.