The finer you grind, the more resistance you create, the higher pressure you need to extract the coffee, the higher the water temperature you need to create the pressure.
Try to go as coarse as you can get away with whilst still creating some viscosity in the brew. This will avoid bitterness.
I've acquired a Moka pot for Xmas - any tips on the best coffee to use/handy hints/things to avoid? Thanks