Changed the left rear wheel bearing last fall and setting around this winter was thing about the rear wheel spacer.

My question is does this spacer have to be their? And what does it do? Besides making it harder to get the left bearing out. Looks like there is too much slop from side to side to be a spacer. Has anyone taken it out? And if so have you had any problems?