Thank you!
That wasn't turned on actually, but your comment made me google some more in this direction; turns out there's a sub-setting of this you can access via pressing & holding the volume bar in control center - it then offers to switch "head tracking" on or off 👍
Thanks again!
Spatial audio. In headphone settings.