Hi, John, and welcome!
I bought a sporter that had the '96 rear sight.  It wasn't adjustable for windage so I bought a 1902 sight to replace it.  You might know that the mounting hole spacing is the same for all the rear sights though the handguards are different.  Is your new Krag a sporterized rifle without a handguard or is it still in military configuration?  If it's still military I'd certainly keep all the original parts tucked away somewhere and use the replacement parts for shooting.
We'd love to see some pictures of your rifle!