Protecting The Most Vulnerable

The driver in the scenario needs to wait. You have priority in this situation as they are coming into your side of the road to overtake so make it look like you know that is the case by moving out and putting yourself in the middle of the available space between the parked cars on your side and the cyclist. This communicates "there isn;t enough space here for your car mate" which is better than "there might be enough space for your car if you just give it a go".
The driver will either make a brain/eye/hand connection and wait or it will flick a switch in their brain and they decide to make a bulls eye of you and try and kill you on purpose, driving off and laughing afterwards.....this is pretty unlikely though. You can maintain your position until they slow down at which point you can move back over to within the car door zone and proceed slowly- being the car door zone isn't so dangerous at low speed after all. Give them a broad smile in appreciation of their humanity and carry on.
They might carry on regardless- it does indeed happen so be ready with a handy swerve....you can handle it and if you cant then go and practise some swerves (have you had a cycle training lesson?). Try and leave making an assumption than rather than trying to kill you the driver isn't very good at driving and doesn't have the skills to judge their own size and speed and the effect this has on vulnerable road users, who they dont realise exist. Worrying of course, but better than thinking the world is full of people who are intent on killing you which tends to make you miserable and aggressive and you wont make the best decisions the next time you have a similar situation.
In other words, be assertive rather than submissive.