Yeah that's the plan - I vaguely remember a few years ago I did this with a couple of small plates under the bench & it worked perfectly for height, I find it gives so much more confidence when you can just set it down without worrying about death by bar rash
Try putting the safeties one notch higher and putting boards under your bench to get the perfect safe height.
Safety first always!
I go heavy on dumbells and use my Smith for higher volume lower weight.