'Shane' - Welcome to the KCA Forum. I'm sorry you are having accuracy problems with your Krag.

As 'Whig' said, pictures would likely help others spot potential problems.

The truth be told, I have never had a U.S. Krag, even with a rough bore, that didn't group at 50 yards.

I am not sure what type of sights and stock your Krag 'sporter' is now 'wearing'. 

You said your " ... father-in-law took the scope and gave you the Krag".
Does it now have a replacement Scope or iron-sights?

What type of stock is now on your Krag?

Bad accuracy is usually a problem with a bad scope, a loose mount, loose iron sights, poor stock bedding, or a damaged muzzle crown.

The first thing to know is if the problem is:

Sight calibration - The shots group, but, not close to point of aim, maybe even totally missing the target. (This is corrected by adjusting the sights).

Lack of accuracy - Some shots hit the target backer, but, fail to group predictably. (This is likely a result of poor stock bedding, faulty sight mounting, defective scope, or mount is loose).