Apple’s Sensitive Content Warning is supposed to protect users from unwanted nude images. It accidentally blurred my friend’s dog video.
Archived version: https://archive.is/newest/https://www.404media.co/apples-imessage-scanning-flagged-a-video-of-my-friends-dog-as-nudity/
Am I missing the point here? Software screws up in predictable, sometimes funny ways. This has been an issue for as long as software has existed.
This is more of a cautionary tale and evidence for why automated message scanning and reporting is a horrible idea. One false positive can ruin someone’s life. In today’s day and age an accusation is more powerful than any proof and being falsely accused of having or distributing CSAM is effectively a death sentence.
Thank you.