• gabelstapler@feddit.org
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    1
    ·
    20 hours ago

    I’m wondering what training data they are using. The same pirated and scraped data the others are using as well?

    • memo@piefed.zip
      link
      fedilink
      English
      arrow-up
      11
      ·
      edit-2
      18 hours ago

      The answer is most probably yes. This is genuinely so tiring.

    • Artisian@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      17 hours ago

      They could use self-play and existing ethical models, like Apertus.

      That said, they don’t disclose afaict. Haven’t trained it, so they probably don’t know themselves.

        • Artisian@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 hour ago

          I suspect no, if they haven’t actually trained a model yet?

          Presumably you mean after they actually train the thing. Then I assume yes, but I’m unfamiliar with the law.

      • Echo Dot@feddit.uk
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        16 minutes ago

        Isn’t parameters just the number of virtual dials that can be changed, essentially the number of neurons, I don’t think it’s got anything to do with the actual amount of data.

        After all distilling works (somehow), by taking all the knowledge of the large AI with a lot of parameters and putting it into a smaller AI with fewer parameters. The amount of data hasn’t changed only the number of parameters. Presumably the inverse is also true, you can have a lot of parameters but not a lot of data.