Bill:  When you remove the side-plate from the left side of the Krag action, the tip of the ejector pin should be visible (projecting just below the hole for the side-plate screw) .  There is a notch or groove on the tip of this pin to assist pulling it out of its hole.  It usually comes out pretty easy and a small screwdriver can be used to 'lever' it out.

All U.S. Krag sling swivels are interchangeable.  If a correct screw will not fit through the hole on a swivel, it is not a U.S. Krag swivel.

  I am a bit confused by your 'swivel/band problem'.  I thought your "Model 1894" came with its front-band (bayonet/nosecap/stacking swivel) and rear-band (sling swivel).  Why are you replacing a band?

p.s.  It is not unusual for Krag rear barrel bands to have a 'brownish' cast.  The different component parts of the U.S. Krag received distinctive specified finishes.  A U.S. Krag is not a uniform 'blued' color on its metal.  The subtle coloring differences of the Krag's metal parts are something you study, get use to, and recognize for authenticity.

---