Herne Hill Saturday Training

It seems that more than fitness or track craft or anything else the biggest "skill" you need to ride well on the track is to take a look before you move anywhere. Would that be accurate?

That's a part of 'track craft'. Depending on how that is defined...
I'd also count ability to ride in a straight line and at a constant speed as essential.

Unfortunately the technique for riding a velodrome at a constant speed is rarely demonstrated by intermediate riders resulting in kicking back and the famous 'concertina effect'