I had a similar issue, drove me nuts. Just needed to tighten the inner nut/cone.
Might be the same with you.
@redostler started
London Fixed Gear and Single-Speed is a community of predominantly fixed gear and single-speed cyclists in and around London, UK.
This site is supported almost exclusively by donations. Please consider donating a small amount regularly.
I had a similar issue, drove me nuts. Just needed to tighten the inner nut/cone.
Might be the same with you.