In the news

But if the self driving isn't in control 100% of the time and requires the driver to take over when it gets tricky you can be almost certain that the driver will not be paying attention when it happens and will have forgotten what to do/how to handle a car.

I'd love to remove human drivers but it needs to be level 5 or it is worse IMHO.

The big unknown is where we will be with ancillary tech in the future when attitudes and infrastructure have changed enough to support widespread autonomous vehicles. Things like "round the corner cameras", one of a fair few emergent techs, which clearly have the potential to do things that humans cannot.

https://physicsworld.com/a/shadowy-algorithm-allows-digital-camera-to-see-round-corners/

Its quite hard to look 10 or 15 years into the tech future, but I totally get your point of view though. Its an issue that needs to be solved.

But if the self driving isn't in control 100% of the time and requires the driver to take over when it gets tricky you can be almost certain that the driver will not be paying attention when it happens and will have forgotten what to do/how to handle a car.

Direct precedents for this in aviation where pilots have become progressively deskilled by automation, and have on occasion failed dramatically when required to take over and demonstrate basic handling skills (see Air France 447).

However as disturbing as this is when considering individual cases, it is also true that flying overall has become orders of magnitude safer, coincident with the advance of automation.

I'd love to remove human drivers but it needs to be level 5 or it is worse IMHO.

Bit or train drivers who still manned a fully autonomous trains.