Just so I've got this right....
You don't speed up, or move to one side when someone wants to go faster than you.
You deliberately stop to force them to stop at the most awkward bit of the path for traffic coming either way.
You then speed up to faster then the speed he wanted you to go at?
And the 'bum tinkler' winds you up?
If someone wants to go faster than me that's just fine. Instead what seems to happen is that I am much (much) faster but when it comes to the obstacles I go a lot more carefully than the two-tings-no-brakes brigade. Hence the bum tinkling opportunity for the odd Captain Commuter.
I have a rear-facing camera these days. I'll try to remember if I get a good example to download the footage.