• Wildmimic@anarchist.nexus
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    1
    ·
    24 hours ago

    In the case i mentioned, it is very much number 2 IMO - the coincidence is just too much. In other cases, we are probably looking mostly at number 1: techniques that already exist, applied to other situations. These things are very good at iterating through rather uncommon combinations and have a large corpus of techniques in their training data, letting them walk across the “plane” of combinations quickly.

    That’s not how humans work, and that’s probably the reason why there was a bunch of mathematical problems solved in a short time - the ingredients were there, but noone had yet tried that specific approach.

    I have not yet seen any evidence of number 3, mainly because we do not know what these models are being trained on - transparency would give us the possibility to check, but we will never get it from OpenAI.