Apparently you can make it and own it if it’s all fake images. Something to do with the legal questions involved, if they illegalized this, then other non perverse things could be illegalized under that precedent. Unless congress steps up, (ha ha,) the judge might actually be in the right here I hate to say it.
Child abuse is always the trojan horse to take away freedoms it seems in the west.
You can’t have training data for it I guess? But then the model maker would have to break the law to even make it of course so you can’t even use that model without some laws being broken down the line. Then again virtually all models should be illegal because of that. I feel like there is a lot of legislation to be done here because the whole industry is rotten to the core.
The idea that CSAM is used in training data is largely discredited. An AI doesn’t need to have actual images of nude children to generate CSAM; it knows what humans look like naked, and it knows what children look like - it fills in the gaps from there.
The TL;DR is that there is a voluntary system that tracks court cases and will alert CSAM victims when it suspects images of them (either known images, or new ones) are the topic of criminal investigations. A Jane Doe was repeatedly raped in the early 2000’s to produce copious amounts of CSAM, which was broadly shared among pedophile groups. Her images were apparently very popular and prolific. Doe was alerted that Grok was producing new explicit images of her as a child. The images in question are novel (generated by AI, and not matching any known existing images) but are undoubtedly of Doe as a child. Meaning it was using Doe’s images as part of the training data for the images it generates.
Essentially, if Grok was trained on CSAM, Doe’s popular images were almost certainly included. And now Grok is producing new images of her. It would be like asking Grok to make an image of a popular egirl, and getting an image of what is undoubtedly Belle Delphine. And then X goes “no no no, we didn’t use any images of Belle Delphine in our training data. We promise!”
It’s important to note that to produce an AI-generated image of somebody, they do not need to exist in the training data beforehand. You can use an image as a prompt, and an AI can create new works based on that prompt, without ever referencing the person from training materials.
Most of these CSAM files are not readily available on the clearnet, and I don’t think even Elon is stupid enough to let an AI scraper run free on Tor. One would have to go significantly out of their way to locate clearnet sources of CSAM to include into the training data.
Some would say it’s a distinction without difference, but I think it’s important to understand how these AI images are actually created, if you want to adequately legislate them.
Like that article, the actual complaint noticeably leaves some key questions open, while inviting certain conclusions. That these conclusions are not clearly stated as fact makes me fear that the intent is to mislead without lying.
As far as I can tell, the basis for the allegation is that a) CSAM was uploaded to X/Grok and b) the TOS state that uploaded files may be used for training.
Looks like it’s seriously reaching. I hope that poor women isn’t being used by some unscrupulous ideologues. She is heading for trying times regardless.
Bullshit. They fed all that shit through in east african countries and the devil knows where else. Paying workers shit to id picture of csam and other abusive shit all day. You do not know what you are talking about, at best.
If by a whole lot of legislation that needs done you mean a whole lot of undiagnosed cases of lead deficiency that need urgent treatment, I would tend to agree with you. Just in general, everywhere.
So you can generate it but not be in possession of it?
I think it depends how rich you are.
Apparently you can make it and own it if it’s all fake images. Something to do with the legal questions involved, if they illegalized this, then other non perverse things could be illegalized under that precedent. Unless congress steps up, (ha ha,) the judge might actually be in the right here I hate to say it.
Child abuse is always the trojan horse to take away freedoms it seems in the west.
The ruling was on possession
You can’t have training data for it I guess? But then the model maker would have to break the law to even make it of course so you can’t even use that model without some laws being broken down the line. Then again virtually all models should be illegal because of that. I feel like there is a lot of legislation to be done here because the whole industry is rotten to the core.
The idea that CSAM is used in training data is largely discredited. An AI doesn’t need to have actual images of nude children to generate CSAM; it knows what humans look like naked, and it knows what children look like - it fills in the gaps from there.
There was an article the other day saying that Grok used CSAM as training data.
https://arstechnica.com/tech-policy/2026/08/elon-musks-xai-used-child-porn-to-train-grok-models-lawsuit-says/
The TL;DR is that there is a voluntary system that tracks court cases and will alert CSAM victims when it suspects images of them (either known images, or new ones) are the topic of criminal investigations. A Jane Doe was repeatedly raped in the early 2000’s to produce copious amounts of CSAM, which was broadly shared among pedophile groups. Her images were apparently very popular and prolific. Doe was alerted that Grok was producing new explicit images of her as a child. The images in question are novel (generated by AI, and not matching any known existing images) but are undoubtedly of Doe as a child. Meaning it was using Doe’s images as part of the training data for the images it generates.
Essentially, if Grok was trained on CSAM, Doe’s popular images were almost certainly included. And now Grok is producing new images of her. It would be like asking Grok to make an image of a popular egirl, and getting an image of what is undoubtedly Belle Delphine. And then X goes “no no no, we didn’t use any images of Belle Delphine in our training data. We promise!”
It’s important to note that to produce an AI-generated image of somebody, they do not need to exist in the training data beforehand. You can use an image as a prompt, and an AI can create new works based on that prompt, without ever referencing the person from training materials.
Most of these CSAM files are not readily available on the clearnet, and I don’t think even Elon is stupid enough to let an AI scraper run free on Tor. One would have to go significantly out of their way to locate clearnet sources of CSAM to include into the training data.
Some would say it’s a distinction without difference, but I think it’s important to understand how these AI images are actually created, if you want to adequately legislate them.
Like that article, the actual complaint noticeably leaves some key questions open, while inviting certain conclusions. That these conclusions are not clearly stated as fact makes me fear that the intent is to mislead without lying.
As far as I can tell, the basis for the allegation is that a) CSAM was uploaded to X/Grok and b) the TOS state that uploaded files may be used for training.
Looks like it’s seriously reaching. I hope that poor women isn’t being used by some unscrupulous ideologues. She is heading for trying times regardless.
that is so wrong, don’t spread that bullshit
they find it in models all the time!
Bullshit. They fed all that shit through in east african countries and the devil knows where else. Paying workers shit to id picture of csam and other abusive shit all day. You do not know what you are talking about, at best.
If by a whole lot of legislation that needs done you mean a whole lot of undiagnosed cases of lead deficiency that need urgent treatment, I would tend to agree with you. Just in general, everywhere.