I have had the swing-arm off 3 different interstates all between 20 and 60K and the outer race mounted in the swing arm looked like that on them all and it is not an issue.
If that was in the steering stem and was detrimental enough to cause noticeable indexing or you could "feel" the indents while turning the handlebars it may be an issue depending on the rider and severity of indexing.
The swing arm bearing, however, functions quite differently.
They do support an enormous amount of weight, see huge momentary pressure spikes and the bearing mostly sits pretty stationary and does not rotate (yeah it does move about 30 degrees or so) it makes this indication all the more reasonable and not an issue. To impede the movement of the swing arm or cause premature bearing failure the indications would be much more severe.
SO this type of indication is not a big deal.
It would have to be very serious Brinneling to cause it to be noticeable in the swing arm,
This is what it would look like if it was serious
http://www.emersonbearing.com/fail_falsebrinell.htm