I've actually had less "oh shit" moments and ride much less aggressively since I removed my brakes. It's not a question of whether the rider has brakes or not, it's about how they conduct themselves on a bike on public roads with other road users.
Someone can be just as dangerous to other traffic with the help of brakes and gears, with or without a helmet, wearing high viz/full lycra MAMIL.
If you don't feel comfortable riding braklzz then it doesn't mean other riders are the same as you.
Fewer.