I know what you mean but I got sick of the phone photos. I got a little case that I can wear on a belt like a hip-pack. It keeps it out of the way and off the bike so it's not vibrated to death.
I still like the Sony XCovers for a not too bulky rugged option but the camera isn't ace.
Neither do I but even the best phone cameras are shit compared to a little Sony so I pick and choose when I take a camera out.