The J-B Weld should work but another simple way to fix this is to use a small piece of paper to put on the base before pushing the sight blade down into the paper and then drift the pin through the base to secure the sight. This wedge usually gives a tight fit to take the wobble out.

Enjoy the nice Krag!