• Wildmimic@anarchist.nexus
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    19 minutes ago

    Intelligence needs something to anchor it in the real world, or it becomes useless. In the biological world, that is a world model, based on previous experiences - and this experience needs at least a modicum of sentience to become useful as we can see all around us. Animals more aware of their own existence are also those who are a lot better at intelligent behavior.

    The “intelligent” output we get from LLMs are NOT a sign of intelligence, it is a statistic. This is useful, no doubt about it - having computers that are able to output the average answer one would get if asking someone who knows their shit is a very good thing, as is being able to walk across a large amount of different (pre-existing) approaches. But conflating it with actual intelligence which would be able to correct hallucinations before they are uttered (because the hallucination isn’t logical at all in most cases) and which would be resistant against breaking them by asking them to do irrational things is not the way to go.

    There is no representation of the huge amount of rejections to answer a question or do a task that many people are not qualified to work on at all. An actually intelligent being realizes when it reaches the limits of it’s knowledge (or it’s training data). Intelligent beings can then try to extrapolate from existing knowledge, but they know that they actually do not know, and often communicate that (putting social things aside for the moment).

    This is the point where LLMs break down with 100% chance if pushed - they do not say: “i do not know”, or “i do not have enough data for that”, or “that doesn’t make sense”. An output is obligatory, regardless of how much an intelligent being would say “oh well, what you want from me doesn’t make sense at all”.

    And it’s as easy as asking an LLM to modify their way of communicating: If you tell it to use a symbol/word again after that same symbol/word, and continue to ask it to do this every time it fails to do so (under the guise of having reading or hearing issues) will break these things every time, sending them spiraling. An intelligent being would say “You know what, fuck you, you are messing with me”.

    This is actual proof of a complete lack of anything resembling real intelligence - intelligence would allow analysis of the situation and detection of unreasonable requests.

    Edit: they trained a model they called “Othello-GPT” with championship datasets, containing only valid moves, and tried to make the point that these things have an internal world model by providing it with game states and asking it for a valid move. It still messed up 5% of the time with real world data, meaning there is no consistent reasoning going on here.