In the case i mentioned, it is very much number 2 IMO - the coincidence is just too much. In other cases, we are probably looking mostly at number 1: techniques that already exist, applied to other situations. These things are very good at iterating through rather uncommon combinations and have a large corpus of techniques in their training data, letting them walk across the “plane” of combinations quickly.
That’s not how humans work, and that’s probably the reason why there was a bunch of mathematical problems solved in a short time - the ingredients were there, but noone had yet tried that specific approach.
I have not yet seen any evidence of number 3, mainly because we do not know what these models are being trained on - transparency would give us the possibility to check, but we will never get it from OpenAI.
In the case i mentioned, it is very much number 2 IMO - the coincidence is just too much. In other cases, we are probably looking mostly at number 1: techniques that already exist, applied to other situations. These things are very good at iterating through rather uncommon combinations and have a large corpus of techniques in their training data, letting them walk across the “plane” of combinations quickly.
That’s not how humans work, and that’s probably the reason why there was a bunch of mathematical problems solved in a short time - the ingredients were there, but noone had yet tried that specific approach.
I have not yet seen any evidence of number 3, mainly because we do not know what these models are being trained on - transparency would give us the possibility to check, but we will never get it from OpenAI.