I know very well what a “world model’” is, please stop trying to undermine my credibility.
If you feed these things thousands of datasets that only consist of a specific set of coordinates, your output will also only consist of these coordinates, which will create the illusion that they actually have knowledge about how an game board looks (as i said, these things are remixers after all). And feeding it a championship data set, where not one invalid move will appear, should ensure at least a close to 100% of valid moves if they were actually able to have an actual internal model of the system they are trying to manipulate. (and in reality, it should choose pretty good moves too, but this was not evaluated at all…).
Their test cases (and the error rates!) were not even “play a game of Othello”, but feeding them gamestates and asking them for a legal move. IMO, this whole setup does not require any form or shape of a world model, and if it actually existed, the error rates would be a ton lower - the championship data will not contain a single invalid move, and the concept of choosing an empty space on the board, touching the other players piece with one of my own ones on the other side of the mass of pieces, is really not a hard one.
I agree that current models will probably have a better performance, but this is NOT because of a better “world model”, but because the statistical sieve has become a lot finer by blowing up the amount of parameters.
I know very well what a “world model’” is, please stop trying to undermine my credibility.
If you feed these things thousands of datasets that only consist of a specific set of coordinates, your output will also only consist of these coordinates, which will create the illusion that they actually have knowledge about how an game board looks (as i said, these things are remixers after all). And feeding it a championship data set, where not one invalid move will appear, should ensure at least a close to 100% of valid moves if they were actually able to have an actual internal model of the system they are trying to manipulate. (and in reality, it should choose pretty good moves too, but this was not evaluated at all…).
Their test cases (and the error rates!) were not even “play a game of Othello”, but feeding them gamestates and asking them for a legal move. IMO, this whole setup does not require any form or shape of a world model, and if it actually existed, the error rates would be a ton lower - the championship data will not contain a single invalid move, and the concept of choosing an empty space on the board, touching the other players piece with one of my own ones on the other side of the mass of pieces, is really not a hard one.
I agree that current models will probably have a better performance, but this is NOT because of a better “world model”, but because the statistical sieve has become a lot finer by blowing up the amount of parameters.