Lower Gear Inches or HTFU?

I'm riding fixed though, so with a singlespeed I think people tend to ride a slightly higher gear.

I thought it was the other way round. At least thats the way I have my freewheel.

Lower because you only need to pedal uphill, unlike fixed where a low gear would require mad spinning downhill.

Plus the fact that if you have a flip-flop wheel or two bikes you are more likely to want to use the freewheel for long distance riding where freewheel would be nicer.