I used some stuff from auto parts store in the 70's to clean some rusty car parts. Turned the surface black. Painted over it, no problem. I think it was QssPho or OssPhoss. Probably not legal now-a-days.
edit: This stuff sounds like it, Ospho. I guess I was wrong.
http://ospho.com/