Honestly, no sane person will have this happen to them. Someone with such strong delusions should not be anywhere near AI or even sharp objects. This person’s problem was not AI, it was their severe mental illness which was obviously not being treated properly for whatever reason.
The complaint, filed in California on Wednesday, says that Gavalas — who reportedly had no documented history of mental health problems — started using the chatbot in August 2025 for “ordinary purposes” like “shopping assistance, writing support, and travel planning.”
You don’t know if you’re sane. Millions of people aren’t aware of their mental illness and manage to live normal lives. LLMs can trigger delusional states in vulnerable people that have never experienced them because they are essentially delision-generating machines.
The issue is that it can encourage people who are having issues to do things and they only need to be in the right sort of energetic craziness once to cause problems.
I think that thinking has the problem of treating AI as this “weird occult book/tool about funny dealings”, and not “government, megacorp sanctified close-to-AGI super-intelligence tool for you to use for free because benevolence” as it is institutionally lied to be.
Sanity is culture relative. You’re absolutely right, but also, this is a symptom of the culture.
Not to mention how every “AI” company is actively participating in the surveillance of not only citizens, but of people in other countries, actively being used by the US military to pick targets for bombing, or how it’s being used to spread misinformation at a rate that would make the cia’s efforts in the 60s sound like that guy you met at the pub who has MANY opinions on geopolitics.
“Sane” people are exceeding minority. Everyone is couple of good conversations away from failing into some sort of rabbithole from which there is no return. Some people have very easily triggerable schizophrenia, which is more obvious, but nobody is OK and nobody is immune.
Honestly, no sane person will have this happen to them. Someone with such strong delusions should not be anywhere near AI or even sharp objects. This person’s problem was not AI, it was their severe mental illness which was obviously not being treated properly for whatever reason.
Undocumented could just as well mean untreated
We all know that undocumented equals doesn’t exist! That’s how the world works!
“He was definitely already suffering from severe mental illness”
“There’s no evidence of that, you can’t assume that”
“But I will anyway”
lol ok
You don’t know if you’re sane. Millions of people aren’t aware of their mental illness and manage to live normal lives. LLMs can trigger delusional states in vulnerable people that have never experienced them because they are essentially delision-generating machines.
Sure, but it would be illegal for a human to coerce/encourage a mentally ill person to commit crime (or worse).
So who’s responsible? Caretaker? Government?
The issue is that it can encourage people who are having issues to do things and they only need to be in the right sort of energetic craziness once to cause problems.
I think that thinking has the problem of treating AI as this “weird occult book/tool about funny dealings”, and not “government, megacorp sanctified close-to-AGI super-intelligence tool for you to use for free because benevolence” as it is institutionally lied to be.
Sanity is culture relative. You’re absolutely right, but also, this is a symptom of the culture.
Not to mention how every “AI” company is actively participating in the surveillance of not only citizens, but of people in other countries, actively being used by the US military to pick targets for bombing, or how it’s being used to spread misinformation at a rate that would make the cia’s efforts in the 60s sound like that guy you met at the pub who has MANY opinions on geopolitics.
“Sane” people are exceeding minority. Everyone is couple of good conversations away from failing into some sort of rabbithole from which there is no return. Some people have very easily triggerable schizophrenia, which is more obvious, but nobody is OK and nobody is immune.
“whatever reason” is often we can’t force people to take their meds.