I would prefer people didn’t when addressing me casually. I know for some people Ze/Zir is hard to remember, and it doesn’t bother me much when I know people are trying and don’t have malicious intent. But if someone openly refuses to use Ze/Zir pronouns because they feel like I “don’t deserve it” that’s different, and it does bother me that they are looking for ways or reasons not to respect my identity. They aren’t actually trying.