So before I get too far ahead of myself. I got a centre punch (I'll probably try and find one with a narrower tip so I don't impact the plastic as much), but once I get the the pin out, how do I get it back in?
once it’s out and you want it back in, you can generally just slide it back through by holding the pin with with some pliers and pushing it into the hole. You just have to line up the interlocking body parts first. It’s way easier to put it back in. What I normally do though, is leave some/most of the knurled end out of the plastic. That way if you need to take it out again, you can, without a ton of effort. You barely notice it.