Pot Joints actually stay on the Gearbox, the driveshafts get 'disconnected' from the pot joints, so you can leave the oil in if you want

I am in the midst of an engine swap and I can't get the pin out of the gear selector on the rod change. Granted, I'm trying to use a bolt to bash it out, but it's a pain in the.... I'm going to get some pin punches tomorrow but am anticipating that there won't be enough room to swing a hammer on it. I've snapped a drill bit trying to drill it out. I've had one fall out on me whilst driving, but when I actually want it out it won't budge. What gives? Also, if it wasn't for this post, I would have absolutely forgotten about the speedo cable. I'll probably forget about it tomorrow after a few beers too