A while back the little "door" on my ignition lock came loose in there somehow...

Anyhow, it got harder and harder to get the key in and out, the local locksmith said she
could take the ignition lock apart and get the little door out so it wouldn't gum up the works,
but not fix the little door, so I hemed and hawed and ended up getting a lock set, they're not
too much from HDL...
Since I have the center cover off now, it seems like the right time to go for replacing all the locks,
and I've just been looking at the saddlebag locks... I don't see how I can switch them out without
removing the latches, and the latches have this hardened anti-leak goo around the three holes
that the bolts go through that basically have the latch glued on.
Have any of y'all done this before? Got any hints? I checked the manual pretty well without
seeing anything in there that helps...
-Mike