These are short pull levers, originally designed for cantis. It's just not a good pairing it seems, but well, I can still stop with ease so no real issue.
Might be worth getting a set of the avid levers that can be adjusted? Not tried them but it sounds like you’d be able to tweak them to work a bit better possibly.
Mini vs are designed for short pull levers I think. You could put short pull flat bar levers on.