I think 99% of us would fall into the same camp as you.
Wrapper or cap=brush/wipe and store
On or originating from foot/interior=pitch it
Sometimes you have a box that comes in from a vendor that has it too close to the humidification source or it was kept to high RH without being opened and some mold on wrappers is present.... happens to us every once in a while. Wipe and stabilize for future storage.
I occasionally read posts saying a cigar had a musty taste, like damp wood and earth. Not sure some one would intentionally blended a cigar to have those flavors so I'm thinking the poster burned a bit more mold then they realize.