Are your old Safety and new Safety alike and resemble the one in my pictures?

If you definitely have a model 1898 Safety, try lubricating the pin with solvent or CLP. 'Work' the pin a bunch of times to loosen up old hardened grease and ensure proper movement.

Sometimes the model 1892 Bolt-Sleeve and Safety find their way onto a model 1898 Krag ... or ... Possibly your replacement Safety is a variation of the model 1892 Safety?

The model 1892 Safety is different and retained by a cross-pin.

---