What about as a descriptor but not in a derogatory way? I'm a musician and people often refer to others as tone deaf if they can't actually tell what they are singing (for example).
I don't think there is another phrase that's used in that situation.
Is criticising someone for not being able to sing in tune ableism? Genuine question here.