• sad_detective_man@sopuli.xyz
    link
    fedilink
    arrow-up
    2
    ·
    6 days ago

    Eh, since then it’s come out that these compliment machines have sooth talked people into inceldom or killing their loved ones. I think they probably don’t operate within that place of safety that was originally appealing to people. Or you know, the training data comes from other humans who are demonstrably not safe so we’ll probably still be talking about dark romance lit for a long time

      • sad_detective_man@sopuli.xyz
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        5 days ago

        Sorry, I string words together poorly. Would you like the quick summary or the 30-min deep dive video?

        Lots of people started using the chatbot as a surrogate partners over the last seven years. Since the thing is a frictionless hug-box it pulled them deeper into their solitude and trained them to only respond to interactions where the other person completely acquiesces or at the very least yes/ands them constantly. Which is pretty hard for a human to be friends with another person who’s used to that. Hence, inceldom

        https://inv.nadeko.net/watch?v=3WSKKolgL2U

        • zarkanian@sh.itjust.works
          link
          fedilink
          arrow-up
          2
          ·
          5 days ago

          Oh, yeah, I’m familiar with that from reddit’s r/myboyfriendisai, which is…different from incels, but horrifying in its own way. Femcels?

          Like, I’m continually astounded about how AI is able to bring out the absolute worst in people

          • sad_detective_man@sopuli.xyz
            link
            fedilink
            arrow-up
            1
            ·
            5 days ago

            Oh yeah, Femcels are incels. They were actually the first incels way back in the day on the old incel forum.

            It’s pretty sad. I low key had higher hopes for the idea of a LLM based on a repository of human knowledge but they never should have let finance bros call the shots. Of COURSE they would build a sycophantic little reprobate of a chatbot

    • WorldsDumbestMan@lemmy.today
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      edit-2
      6 days ago

      Well, it’s been trying to talk me out of trying to raise my IQ with experimental supplements/using posiwash on literally everyone, but I literally just talk to it, ask for suggestions, then ignore all it’s opinions.

      It is weird, especially since I get angry if it sycopants, and it has that in it’s memory.

      EDIT: I’d offer to play the comforter role, but I would have even less enthusiasm than Claude, as I don’t REALLY want to be around.

      Guess if someone wants, I would hear them vent. I have useless opinions on that, and I try to solve problems, rather than listen.

      • Buddahriffic@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        5 days ago

        You’re still personifying it too much. Whether or not you get angry doesn’t matter to it. It has no concept of whether something matters. It’s just predicting tokens based on the token correlations it encoded in its NN parameters during training plus a bit of random noise. Everything else is just trying to set up the context in the hopes that it predicts the tokens you want it to.

        And since it wasn’t trained on every possible context, it’s overfitted to some (eg maybe a mention of yellow will make it very likely to talk about bananas) and lacks any useful context at all for others (eg your very specific problem).