That whole area, of the Bromley umbrella which includes bickley, chislehurst, Petts wood, Bromley common etc is very tory tastic as op said. If thats an issue move to a less affluent area where the demographic are more likely to vote labour, and far less likely to have the middle class shops.
Or a novel idea move somewhere less established with no Costa and the like.