• raspberriesareyummy@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    edit-2
    3 days ago

    This is almost exactly the opposite of how LLMs work.

    With the exact state of training data, and the exact prompt history, you’ll get the same output. Problem is that you only get this scenario a single time. And as much as a spelling error, or simply repeating the same prompt twice, will not yield deterministic output.

    So no, LLM garbage is not deterministic. Otherwise it would be possible to predict output before the matrix processes the input.

    They have no determinism, no concept of context and their “reaction” are pure statistics.

    This almost perfectly describes human behavior.

    That’s nonsense. Most mammals have a high understanding of context, and humans are very much able to produce deterministic answers to a given problem.

    • bumblebeer@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      3 days ago
      1. With greedy decoding (temperature set to 0) LLM output is deterministic. The same input will always result in the same output — every time. This is a fact.
      2. Just because something isn’t amenable to calculation does not mean it is nondeterministic, for example the Three Body Problem. This is a fact.
      3. Humans are stupid unpredictable base animals that hold almost no understanding of the world around them or their place within it, while at the same time their heard-level behaviors are almost, if not entirely, predictable. This is a cynical joke.