I have the same pitting in the same location from riding on the same roads as you. My attempt to sand them out only resulted in dulling the chrome finish. After looking at it closely, I decided it would take one heck of a pothole impact to compress the fork pitting just to the dust seal, let alone the main seal. I decided to make sure there were no protruding sharp points on the pitts and let them go at that. Also, my seal failed in the middle of its thickness, not on the seal's inside edge as I would have expected, had it failed from ruffness of the fork piston.

The inside wiping portion of the seal is not chewed up at all, so the pitting did not cause my seal's failure.