Each part needs to be used with the correct spring. If you don't have problems now, you probably will later. The pin can be a bit of a pain to remove without the correct punch. You want this one here, from Brownells. One side of the punch is shaved to allow enough clearance to prevent gouging the lower.

From Brownells.com