I've only ever deleted HORRIBLY distracting SBs, such as ones that move around, which can REALLY be bad on taiko, and a skin that just made playing painful, because it was half transparent.
Hell no !The hell? How ;_;?
If anything, I add a custom skin, video, or SB to maps that deserve it. No deleting things here, unless they make maps REALLY unplayable.