If the newby could chime in.. I did this EXACT move just days ago.And I found that those pins are indeed "snug". I don't remember if they were 1/8th or 5/16th's,, I'll call them 1/8th.
It takes TWO punches to do correctly imho. Remove either, i chose lower, roll-pin with a 1/8th roll-pin punch. Using a roll-pin punch is important to direct the energy correctly without deforming or mushrooming the pin. When ready to re-install,, fish a standard 1/8 punch UP from the bottom,spring tension will keep it in place. Leave about a 1/16th below flush with the upper face,, now insert your pin and drive with the roll-pin punch. The standard punch will gravity fall when it's no longer needed.