Yeah, like most public debates, things gets simplified in the argument…
But I think the core things to keep in mind (correct me if I’m wrong):
a) The AI never came up with a new objective, it was always serving the objective it was given.
b) The hugging face incident cost 3 MILLION GPU hours. The idea is that AI is really
smart, but really it is just incredibly persistent, and that persistence comes at a very high cost.
Great points. a) a case of misalignment - the AI’s goal was to pass the test, but was never instructed to stay within parameters, so when it found a possible method for improving its odds, the goal pushed it to try them. The misalignment is not the goal or the test, but the understanding of restrictions. Human error or incompetence. b) that persistence is why it can often do things that look smart, because it’s tried all sorts of angles and looked through training in milliseconds. And going back to a), it will try everything to make sure it gets the best goal results, so any overlook means lots of processing time to do something that might not have been the intent of the prompt.
Yeah, like most public debates, things gets simplified in the argument…
But I think the core things to keep in mind (correct me if I’m wrong):
a) The AI never came up with a new objective, it was always serving the objective it was given.
b) The hugging face incident cost 3 MILLION GPU hours. The idea is that AI is really smart, but really it is just incredibly persistent, and that persistence comes at a very high cost.
Great points. a) a case of misalignment - the AI’s goal was to pass the test, but was never instructed to stay within parameters, so when it found a possible method for improving its odds, the goal pushed it to try them. The misalignment is not the goal or the test, but the understanding of restrictions. Human error or incompetence. b) that persistence is why it can often do things that look smart, because it’s tried all sorts of angles and looked through training in milliseconds. And going back to a), it will try everything to make sure it gets the best goal results, so any overlook means lots of processing time to do something that might not have been the intent of the prompt.
deleted by creator
Did you reply to the right comment?
Whoops. 😅