I've snapped off several clutch levers backing out my tight quarters bike shed over the years, so I keep putting new ones on before they wear out. I used to like my levers to be matching, but now I just put on whatever I have left in the parts bin. I have an overstock of brake levers now, because those never get broken off (and they only sell pairs).
Ever think of widening the door ?
As a hack carpenter, no. And both my 2 (10 X 12) sheds double doors are are in sad and rotting (at the bottoms) conditions. Plus these partially assembled sheds arrive with piano hinge doors with 57 nails down each side, and that looks like a problem too. So far, I've fixed them up by stapling rubber floor mats along the bottoms of the doors to keep the rodents and other animal life out. This works like a charm, but they are quite the eyesore.
I've though about looking into some cheap pair of house double doors to install in their place (size permitting), as steel takes longer to rot than wood.
As far as breaking levers off, I've learned my lesson... slow and sure doesn't break the levers or bang the mirrors.