• eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    114
    arrow-down
    5
    ·
    2 days ago

    AI can write a convincing essay about fire, but it has never burned a finger. Pearl’s point is less that these systems are useless and more that fluency gets mistaken for understanding. Silicon Valley saw a spectacular autocomplete and immediately started selling it as a digital philosopher. The marketing department achieved AGI first.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      edit-2
      1 day ago

      fluency gets mistaken for understanding

      That’s it. I am going to borrow that phrase.

      And a huge component is that Silicon Valley mindset that… values fluency over understanding, I guess?

      The words to describe it are hard. The “Elizabeth Holmes Complex” in You Can See Everything pretty much sums it up.

      • saimen@feddit.org
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        12 hours ago

        fluency gets mistaken for understanding

        That also often happens with people. I guess these are the same people that think AI is actual intelligent because that’s the only intelligence they know: being good with words without deeper understanding.

        To put it phosophical words are just our attempt to describe and understand the world around us. There is no truth in them other than that to what they are trying to point in the real world.

      • skaffi@infosec.pub
        link
        fedilink
        English
        arrow-up
        2
        ·
        19 hours ago

        Just so you know, the account you replied to is itself just an AI spewing its mindless, oozing bullshit here as comments. Why instances aren’t banning it is beyond me.

        • brucethemoose@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          19 hours ago

          Nah, there’s a person behind it at least.

          …I have almost blocked eicker for posting Futurism clickbait, though. I didn’t come to Lemmy for that junk in my feed.

      • bampop@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 day ago

        And a huge component is that Silicon Valley mindset that… values fluency over understanding, I guess?

        Call me cynical if you will, but I think it’s more that Silicon Valley values short term profit over integrity. They know the limitations of what they are selling, but if it makes money, that drives everything.

        • Valmond@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 day ago

          I don’t think they care about limitations (if even they can understand them, let alone spend time assessing), they are only in for the quick buck this quarter.

          Source: have worked for normal american company.

      • eicker@lemmy.worldOP
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        2
        ·
        1 day ago

        Steal it freely. I think the mindset is less about valuing fluency than treating confidence as evidence. Holmes sold a story so convincingly that asking whether the machine worked became almost rude. Now we’re doing it again, except the machine can write its own pitch deck.

    • username_1@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      51
      arrow-down
      2
      ·
      2 days ago

      Yes, LLMs are incredible tools if used in appropriate situations by people who understand LLMs’ limitations. Like any other tool, actually. Give a drill to an idiot and just wait for the disaster.

      • Lemmilicious@feddit.nu
        link
        fedilink
        English
        arrow-up
        10
        ·
        2 days ago

        In case anyone is interested, here’s an article I really like that very well describes how LLMs are not like all other tools, in particular how they’re are fundamentally different than tools like a drill, and how this difference is bad actually: https://deadsimpletech.com/blog/no-such-thing-as-just-a-tool

        Not disagreeing that an idiot with a drill is also a disaster, I just think there are some interesting differences worth lingering on too!

        • Ostfriesentee@feddit.org
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          1 day ago

          Interesting read. I agree with the overall analysis. I don’t agree with the premise that calling something a tool somehow implies that its use is neutral. Of course it isn’t.

          The article fundamentally agrees that LLMs are tools. Just that being a tool comes with a lot of luggage and indirectly shapes human behavior. We certainly ought to think about what kind of tools we want to create and what their effects on society are.

          • Lemmilicious@feddit.nu
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 day ago

            I think the frasing the article critiques is saying that something is “just a tool” and not saying that something is “a tool”, as it agree with you that the latter doesn’t imply the same neutrality as the first.

            Writing this comment I realised how hard it is to tell whether “just” is part of the quote or not without using quotation marks, so haha that can sure be confusing.

        • username_1@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          2
          ·
          2 days ago

          very well

          I stopped reading after a few paragraphs. No idea what the author wanted to say. Reference to old philosophers is cool, but first you need to explain WHAT you’re trying to say, and only then pour down all that philosopher gibberish onto reader.

          • Valmond@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            3
            ·
            1 day ago

            It’s not that long, but I agree that it does not get to the point, just ramble about how tools have imperfections. Could have been way better.

            In a nutshell; the tool becomes a part of you, and thus limits your options.

            Or so I read it.

          • Boost@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            1 day ago

            I generally think most philosophy is overly academic wank written by people who desperately need to go outside but I also think the author of that article does a very good job laying out exactly what they’re trying to say and why it matters. You might actually learn a thing or two if you bothered to read it.

      • eicker@lemmy.worldOP
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        7
        ·
        2 days ago

        Exactly. A useful tool becomes dangerous when people mistake its output for judgment, especially when the people selling it have every incentive to encourage that confusion.