I am an idiot

try a cross inline lever like this

also try and smooth out the curve on your brake cable it will work better.

Thanks for the advice, shortened the cable so it didn't have a massive curve in it and it works much better. I haven't worked on brakes for many a year!