I've found that if you want to be comfortable on the bike you have to put up with being cold off it.
Hence what I wear to ride to work or any time I'm riding predominantly, isn't the same as what I wear when I ride to the local shops, the supermarket, or when I'm bimbling around town from place to place and walking and standing as often as I'm pedalling.
Compared with December's snow riding, my thermal tights are now ordinary Roubaix, my Buff lives not over my ears and neck but in my bag in case I need it, my thick waterproof gloves are now my woolly Sealskinz, I'm back to airy mtb shoes rather than Goretex hiking boots, and under my waterproof jacket my fleece mid-layer has made way for a long-sleeved t-shirt (and even a short-sleeved t-shirt on occasion). I did actually get acclimatised to the sub-zero temperatures quite quickly.
I heard that some cyclists on the northern Eastern Seaboard of the US were riding to work in -26°C temperatures this week.