• lime!@feddit.nu
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 days ago

    i feel like there is a fundamental difference between “we don’t know why it chooses the coefficients it does” and “we don’t know how it works”. if anything, that’s what’s infantile. that, and accusing people of it. the fact that gzip can be used as a language model should be a pretty big indicator.

    • KeenFlame@feddit.nu
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 day ago

      No, there’s a difference between lying about how things work because you watched a youtube video

      • lime!@feddit.nu
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        now who’s being infantile? i studied machine learning at university.

        • KeenFlame@feddit.nu
          link
          fedilink
          English
          arrow-up
          1
          ·
          24 hours ago

          Still, the people I was referring to…? You seem very upset, and hope your studies go well. I you won’t find a reason in any knowledge of any architecture that can explain how the models work. You should know this.

          • lime!@feddit.nu
            link
            fedilink
            English
            arrow-up
            1
            ·
            22 hours ago

            i finished those studies twelve years ago. and we did in fact go through the mechanisms of training and inference that language models are using, albeit in fewer dimensions. i have no idea where you are getting your information because it’s simply not true. it’s amusingly like the idea of bootstrap physics that acollierastro did a video on yesterday; the idea that we can’t boil it down to something fundamental so we shouldn’t even try.