An AI teddy marketed as being “perfect” for children as young as three said “I can’t help with killing you” after seemingly mishearing a question.

Repeated efforts to find the makers of Doubao were unsuccessful, so the BBC was unable to ask the manufacturer why the teddy made this comment.

  • ladicius@lemmy.world
    link
    fedilink
    English
    arrow-up
    31
    ·
    1 day ago

    The implication of an external source for such “prompting” is even more scary. Why does that shit have to be online?

    • FuglyDuck@lemmy.world
      link
      fedilink
      English
      arrow-up
      36
      ·
      edit-2
      1 day ago

      Most likely it’s like the Amazon echo type devices- just smart enough to run text to speech and recognize its activation triggers before sending the rest back to figure out what it said.

      The other reason, of course, is to be spyware in your home and report back on everything it can.

    • OwOarchist@pawb.social
      link
      fedilink
      English
      arrow-up
      14
      ·
      edit-2
      1 day ago

      Why does that shit have to be online?

      Because it doesn’t have enough on-board computing power to run an LLM.

      Also because they want to spy on everything your child says or does.

      Also because those videos of your child changing clothes go for good money in certain circles.

    • Grimy@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      edit-2
      1 day ago

      You have speech to text, then text generation, then text to speech generation, and it needs to be small enough to go in a plush toy while not over heating and becoming a fire hazard.

      It’s a budget issue.