AI can write a convincing essay about fire, but it has never burned a finger. Pearl’s point is less that these systems are useless and more that fluency gets mistaken for understanding. Silicon Valley saw a spectacular autocomplete and immediately started selling it as a digital philosopher. The marketing department achieved AGI first.
That also often happens with people. I guess these are the same people that think AI is actual intelligent because that’s the only intelligence they know: being good with words without deeper understanding.
To put it phosophical words are just our attempt to describe and understand the world around us. There is no truth in them other than that to what they are trying to point in the real world.
Just so you know, the account you replied to is itself just an AI spewing its mindless, oozing bullshit here as comments. Why instances aren’t banning it is beyond me.
And a huge component is that Silicon Valley mindset that… values fluency over understanding, I guess?
Call me cynical if you will, but I think it’s more that Silicon Valley values short term profit over integrity. They know the limitations of what they are selling, but if it makes money, that drives everything.
I don’t think they care about limitations (if even they can understand them, let alone spend time assessing), they are only in for the quick buck this quarter.
Steal it freely. I think the mindset is less about valuing fluency than treating confidence as evidence. Holmes sold a story so convincingly that asking whether the machine worked became almost rude. Now we’re doing it again, except the machine can write its own pitch deck.
Yes, LLMs are incredible tools if used in appropriate situations by people who understand LLMs’ limitations. Like any other tool, actually. Give a drill to an idiot and just wait for the disaster.
In case anyone is interested, here’s an article I really like that very well describes how LLMs are not like all other tools, in particular how they’re are fundamentally different than tools like a drill, and how this difference is bad actually: https://deadsimpletech.com/blog/no-such-thing-as-just-a-tool
Not disagreeing that an idiot with a drill is also a disaster, I just think there are some interesting differences worth lingering on too!
Interesting read. I agree with the overall analysis. I don’t agree with the premise that calling something a tool somehow implies that its use is neutral. Of course it isn’t.
The article fundamentally agrees that LLMs are tools. Just that being a tool comes with a lot of luggage and indirectly shapes human behavior. We certainly ought to think about what kind of tools we want to create and what their effects on society are.
I think the frasing the article critiques is saying that something is “just a tool” and not saying that something is “a tool”, as it agree with you that the latter doesn’t imply the same neutrality as the first.
Writing this comment I realised how hard it is to tell whether “just” is part of the quote or not without using quotation marks, so haha that can sure be confusing.
I stopped reading after a few paragraphs. No idea what the author wanted to say. Reference to old philosophers is cool, but first you need to explain WHAT you’re trying to say, and only then pour down all that philosopher gibberish onto reader.
I generally think most philosophy is overly academic wank written by people who desperately need to go outside but I also think the author of that article does a very good job laying out exactly what they’re trying to say and why it matters. You might actually learn a thing or two if you bothered to read it.
Exactly. A useful tool becomes dangerous when people mistake its output for judgment, especially when the people selling it have every incentive to encourage that confusion.
AI can write a convincing essay about fire, but it has never burned a finger. Pearl’s point is less that these systems are useless and more that fluency gets mistaken for understanding. Silicon Valley saw a spectacular autocomplete and immediately started selling it as a digital philosopher. The marketing department achieved AGI first.
That’s it. I am going to borrow that phrase.
And a huge component is that Silicon Valley mindset that… values fluency over understanding, I guess?
The words to describe it are hard. The “Elizabeth Holmes Complex” in You Can See Everything pretty much sums it up.
That also often happens with people. I guess these are the same people that think AI is actual intelligent because that’s the only intelligence they know: being good with words without deeper understanding.
To put it phosophical words are just our attempt to describe and understand the world around us. There is no truth in them other than that to what they are trying to point in the real world.
Just so you know, the account you replied to is itself just an AI spewing its mindless, oozing bullshit here as comments. Why instances aren’t banning it is beyond me.
Nah, there’s a person behind it at least.
…I have almost blocked eicker for posting Futurism clickbait, though. I didn’t come to Lemmy for that junk in my feed.
Call me cynical if you will, but I think it’s more that Silicon Valley values short term profit over integrity. They know the limitations of what they are selling, but if it makes money, that drives everything.
I don’t think they care about limitations (if even they can understand them, let alone spend time assessing), they are only in for the quick buck this quarter.
Source: have worked for normal american company.
Steal it freely. I think the mindset is less about valuing fluency than treating confidence as evidence. Holmes sold a story so convincingly that asking whether the machine worked became almost rude. Now we’re doing it again, except the machine can write its own pitch deck.
Yes, LLMs are incredible tools if used in appropriate situations by people who understand LLMs’ limitations. Like any other tool, actually. Give a drill to an idiot and just wait for the disaster.
In case anyone is interested, here’s an article I really like that very well describes how LLMs are not like all other tools, in particular how they’re are fundamentally different than tools like a drill, and how this difference is bad actually: https://deadsimpletech.com/blog/no-such-thing-as-just-a-tool
Not disagreeing that an idiot with a drill is also a disaster, I just think there are some interesting differences worth lingering on too!
That was a really interesting article with ideas that were new to me. Thanks for sharing it.
Interesting read. I agree with the overall analysis. I don’t agree with the premise that calling something a tool somehow implies that its use is neutral. Of course it isn’t.
The article fundamentally agrees that LLMs are tools. Just that being a tool comes with a lot of luggage and indirectly shapes human behavior. We certainly ought to think about what kind of tools we want to create and what their effects on society are.
I think the frasing the article critiques is saying that something is “just a tool” and not saying that something is “a tool”, as it agree with you that the latter doesn’t imply the same neutrality as the first.
Writing this comment I realised how hard it is to tell whether “just” is part of the quote or not without using quotation marks, so haha that can sure be confusing.
I stopped reading after a few paragraphs. No idea what the author wanted to say. Reference to old philosophers is cool, but first you need to explain WHAT you’re trying to say, and only then pour down all that philosopher gibberish onto reader.
It’s not that long, but I agree that it does not get to the point, just ramble about how tools have imperfections. Could have been way better.
In a nutshell; the tool becomes a part of you, and thus limits your options.
Or so I read it.
I generally think most philosophy is overly academic wank written by people who desperately need to go outside but I also think the author of that article does a very good job laying out exactly what they’re trying to say and why it matters. You might actually learn a thing or two if you bothered to read it.
“A fool with a tool is still a fool” - Grady Booch (father of UML)
I’ve always wondered about Ungly Mutant Lad’s backstory.
Before he joined the revengers
He tried to warn us about his son
Exactly. A useful tool becomes dangerous when people mistake its output for judgment, especially when the people selling it have every incentive to encourage that confusion.