It has become impossible to tell managers mesmerised by artificial intelligence that the tools are not, in fact, helpful. So employees just play along with the fiction to keep their jobs, writes our tech columnist
In my academic field of sustainability, AI still fails to explain what economic sustainability means. It’s very simple.
I lecture and explain to my students that economic sustainability is about how we assess and manage our knowledge, innovations, wealth, and other man-made capital. I stress that it is ABSOLUTELY NOT profit and revenue.
Sure enough, my students submit assignments clearly written by AI that state economic sustainability is profit and revenue.
AI is regurgitating decades of green-washing and even bad academic articles that state economic sustainability is about profits. I use that AI god mode site to test several AI’s at once and they’ve consistently gotten this wrong for 3 years.
The trick that AI pulls is just that it is really good at appearing competent, and we as humans really bad at acknowledging how little we individually know about the world around us.
The easiest example to ask AI detailed questions about something that you know you have expertise in. If you try to test its limit, no matter what your particular expertise is, I’m confident that in 5-10 minutes you’ll realize it’s no more intelligent than an average Joe who spent their lunch break Googling the subject or maybe someone who read a book about it once.
To give credit where it’s due, that does mean that these AIs have a much wider breadth of knowledge than any one person could have and that is, objectively, very cool.
On the other hand, that’s why it’s so easy to believe that AI is this all-knowing oracle that can replace all of humanity. It can give you a way better answer in an instant about things you know nothing about than you ever could off the top of your head, so it seems unbelievable. It’s instant gratification that also feels really valuable.
Despite the trick that AI plays on our psychology, you could also just read a book or two or participate in any form of genuine learning, and it really doesn’t take long for you to outgrow whatever the AI is capable of. It takes a bit longer, but now you have grown your actual intelligence and you get to keep it for a $0/month subscription and they don’t need to build another data center in your backyard.
The trick that AI pulls is just that it is really good at appearing competent
Yeah it’s almost like the AI is an unthinking machine trying to model what a person would answer to the question (prompt) provided to it.
I’m so goddamn tired of people (not you) acting like an LLM “knows” anything nevermind whether it’s right or wrong or could even tell you if it didn’t know the answer. It’s not like a person that can say, “I don’t have that knowledge so I know any answer is likely wrong” the machine is going to give you an answer every time. That answer will never be “idk” it’ll be whatever hallucination it’s confident enough is right based on the model and training.
I do think there are use cases for it and the technology is cool but the vision being sold and propping up our economy with a venture capitalist circle jerk is so far removed from reality.
that’s also how really successful human beings work. they bullshit and lie and appear confident, and people believe them and ignore the people who don’t do that, because they don’t appear as confident.
also why people basically fall in love with AI, because it spouts nothing but bullshit at them and they eat it up like candy because being fed back bullshit is a dopamine hit.
interacting with real people doesn’t supply endless dopamine and they might not tell you what you want to hear.
You will get an email at some point asking you if you would accept some well paid contract to train an LLM to answer like you would. That’s how they simulate professional behavior on top of the probabilistic monsters that is behind.
So you teach something different from the mainstream - cool. But don’t be surprised when students or AI cite others or take an alternative position.
I’m no economist but I had plenty of professors who wanted their particular theories reflected back at them.
While students should do their own reading and writing, using ‘they write mainstream ideas’ as a litmus test for writing and AI seems parochial. And I’d go so far as to say AI is becoming a standard research and writing aid like the web word processors, and you sound like teachers who ranted against those too.
Have you engaged either group in open discussion about comparing the perspectives you’re challenging? I bet several modern models could debate your philosophy on merit, I wonder if you ever gave students the chance.
I’m pretty sure the fucking economist you’re replying to is not “teach(ing) something different from the mainstream” that’s the whole point of their post.
The whole point is the AI tools are hallucinating* completely incorrect answers and that students trying to use them as study aids and tools to learn with are going to have a lot of fake and wrong information to sort out and good luck to them knowing what is or isn’t incorrect or wrong when they’re just trying to learn a subject they know nothing about.
The only reason you or I or anyone else knows when AI hallucinates in its output is because we know stuff from our prior knowledge and can catch it that way. If you’re ignorant to a subject and trying to learn stuff you’re not going to know off hand the AI is lying to you if it sounds convincing enough for a layperson to accept.
*which I kind of hate that term because to the AI there’s no difference between truth and hallucination - it’s just output as far as the robot is concerned
In my academic field of sustainability, AI still fails to explain what economic sustainability means. It’s very simple.
I lecture and explain to my students that economic sustainability is about how we assess and manage our knowledge, innovations, wealth, and other man-made capital. I stress that it is ABSOLUTELY NOT profit and revenue.
Sure enough, my students submit assignments clearly written by AI that state economic sustainability is profit and revenue.
AI is regurgitating decades of green-washing and even bad academic articles that state economic sustainability is about profits. I use that AI god mode site to test several AI’s at once and they’ve consistently gotten this wrong for 3 years.
The trick that AI pulls is just that it is really good at appearing competent, and we as humans really bad at acknowledging how little we individually know about the world around us.
The easiest example to ask AI detailed questions about something that you know you have expertise in. If you try to test its limit, no matter what your particular expertise is, I’m confident that in 5-10 minutes you’ll realize it’s no more intelligent than an average Joe who spent their lunch break Googling the subject or maybe someone who read a book about it once.
To give credit where it’s due, that does mean that these AIs have a much wider breadth of knowledge than any one person could have and that is, objectively, very cool.
On the other hand, that’s why it’s so easy to believe that AI is this all-knowing oracle that can replace all of humanity. It can give you a way better answer in an instant about things you know nothing about than you ever could off the top of your head, so it seems unbelievable. It’s instant gratification that also feels really valuable.
Despite the trick that AI plays on our psychology, you could also just read a book or two or participate in any form of genuine learning, and it really doesn’t take long for you to outgrow whatever the AI is capable of. It takes a bit longer, but now you have grown your actual intelligence and you get to keep it for a $0/month subscription and they don’t need to build another data center in your backyard.
Yeah it’s almost like the AI is an unthinking machine trying to model what a person would answer to the question (prompt) provided to it.
I’m so goddamn tired of people (not you) acting like an LLM “knows” anything nevermind whether it’s right or wrong or could even tell you if it didn’t know the answer. It’s not like a person that can say, “I don’t have that knowledge so I know any answer is likely wrong” the machine is going to give you an answer every time. That answer will never be “idk” it’ll be whatever hallucination it’s confident enough is right based on the model and training.
I do think there are use cases for it and the technology is cool but the vision being sold and propping up our economy with a venture capitalist circle jerk is so far removed from reality.
that’s also how really successful human beings work. they bullshit and lie and appear confident, and people believe them and ignore the people who don’t do that, because they don’t appear as confident.
also why people basically fall in love with AI, because it spouts nothing but bullshit at them and they eat it up like candy because being fed back bullshit is a dopamine hit.
interacting with real people doesn’t supply endless dopamine and they might not tell you what you want to hear.
You will get an email at some point asking you if you would accept some well paid contract to train an LLM to answer like you would. That’s how they simulate professional behavior on top of the probabilistic monsters that is behind.
So you teach something different from the mainstream - cool. But don’t be surprised when students or AI cite others or take an alternative position.
I’m no economist but I had plenty of professors who wanted their particular theories reflected back at them.
While students should do their own reading and writing, using ‘they write mainstream ideas’ as a litmus test for writing and AI seems parochial. And I’d go so far as to say AI is becoming a standard research and writing aid like the web word processors, and you sound like teachers who ranted against those too.
Have you engaged either group in open discussion about comparing the perspectives you’re challenging? I bet several modern models could debate your philosophy on merit, I wonder if you ever gave students the chance.
I’m pretty sure the fucking economist you’re replying to is not “teach(ing) something different from the mainstream” that’s the whole point of their post.
The whole point is the AI tools are hallucinating* completely incorrect answers and that students trying to use them as study aids and tools to learn with are going to have a lot of fake and wrong information to sort out and good luck to them knowing what is or isn’t incorrect or wrong when they’re just trying to learn a subject they know nothing about.
The only reason you or I or anyone else knows when AI hallucinates in its output is because we know stuff from our prior knowledge and can catch it that way. If you’re ignorant to a subject and trying to learn stuff you’re not going to know off hand the AI is lying to you if it sounds convincing enough for a layperson to accept.
*which I kind of hate that term because to the AI there’s no difference between truth and hallucination - it’s just output as far as the robot is concerned