Should you be able to pull it out with just your fingers?
Had one do this. No big deal. Get you a coke can and cut you a shim for it. I did that and then I took and index around the outer race of the wheel. Problem fixed. It was making a popping sound in a left hand turn. The bearing was moving in the race.
David