Please excuse my terrible English.

That's not a legitimate excuse.

This doesn't excuse your behavior.

Please excuse my bad handwriting.

Excuse me, but you're mistaken.