FAO Photographers

So what if I had my picture take alongside a celebrity in a public place, then I download that image and upload to my blog, do I have any rights if the photog complains ....as I am a subject and had not signed a release?....this happened, I removed the image.

I can't see why, if it was non-commercial, and did not infringe their privacy.

public place and non commercial.(regarding your face)
you would not need to sign a release.
if the image was used in an article titled CELEBRITY STALKER MENACES FILM STAR or PEADO CYCLIST STALKER FRIGHTENS CHILD STAR your moral rights would be infringed and you would be right to complain and possibly have a retraction published or compensation.

as to the photographer complaining about the image on your blog? dunno but he may have a legal right to be credited?