I find xlsb only speeds up opening (and shrinks the file) it doesn't actually speed up operations within it.
Another killer for calculation speed is vlookups.
If it's a long-term thing and the data is just going to get bigger it may be worth looking at PowerPivot. It's relatively simple to learn the basics and is a lot faster. Definitely more complicated though.
I find xlsb only speeds up opening (and shrinks the file) it doesn't actually speed up operations within it.
Another killer for calculation speed is vlookups.
If it's a long-term thing and the data is just going to get bigger it may be worth looking at PowerPivot. It's relatively simple to learn the basics and is a lot faster. Definitely more complicated though.