Rapha, nice but a bit pricey?

Does anyone else here have a tiny head and find no one size fits all hat ever fits properly?

I have the drawcord merino hat which i tried on this morning for the cold but no matter how it just doesn't fit my head properly. I am a 54cm noggin so not much up there at all.

Time to start buying caps from the kids section? Think I can shrink the rapha hat a little?

I have this problem (I'm a small in their normal cycling caps) but the winter hat and the merino hat both fit pretty well.