Yes (unless you knew you were buying a bike with a hole in it). However if it happened to me on a bike I already owned (as in cause through my riding it) I'd be less concerned.
By 'hole' you mean something that goes all the way through? As in removing at least the full thickness of the tube wall over an area that matches the profile of the tyre?
Would you regard the brake bridge as a structural element?
If you bought a track frame and the rear wheel had rubbed the brake bridge enough to make a tiny hole would you consider this an issue?