So I went to work with my needle files and polishing stones. I got the area shaped the way it should have been from the factory and the cylinder pin slides in-and-out easily now.
Thanks everybody for all the helpful suggestions and the comedy, it helped also!!!