I'd recommend looking back at all the other times people have thought 2 wheelsets 1 bike was going to be the solution. Mostly they end up with one or other set gathering dust in a cupboard because, even as simple as it is, swapping wheels before going for a ride is too much hassle.
I'm mostly imagining a faster lighter summer set and something alloy to take a beating in autumn and winter- rather than swapping them every other ride.
I'd recommend looking back at all the other times people have thought 2 wheelsets 1 bike was going to be the solution. Mostly they end up with one or other set gathering dust in a cupboard because, even as simple as it is, swapping wheels before going for a ride is too much hassle.