Science Squabbling

But this isn't the case is it? Everything inside a fusion reactor becomes radioactive and parts wear out, need to be replaced and disposed of. So you still end up with a lot of radioactive material that you have to do something with.

Hardly. Most of the waste, which is the core itself will have a much much shorter half life. less than 100 years. Low level waste? Around 100 odd, which is way better than the output caused by fission reaction and all the heavy metals. If I remember right, you don't have to have very specific building materials (If someone could expand on that) so you could technically use materials that don't become easily radioactive.
Waste management for a fusion reactor will be far far easier than for a fission one.