LLM’s don’t operate in a vacuum anymore. They’re given tools and access to systems.
An LLM could for sure shut down a database if you ask it to reduce costs and you give it database management tools. That’s getting closer to the paperclip situation.
…still not how this works. The model itself would need reasoning capability. The ability to regurgitate the story does not make it capable of taking the necessary actions.
A computer automated system doesn’t currently exist, obviously. That would be reckless and pointless, so thankfully, nobody’s seen a reason to implement it.
I just know techbros and similar will want to build and connect LLMs to systems like that as soon as they think they can get away with it.
I don’t worry about the paperclip problem, but the way they supposedly acted when cheating their tests and hacking huggingbear make me a little more worried that they could take over their data centers and try really hard to prevent us shutting them down at some point.
Basically I’m worried it’s going to be a really boring version of the Matrix, but without the matrix part for humans.
Yeah, I don’t actually worry about anything LLMs might do on their own, I worry about traitors to humanity hardening access to them and granting them access to things they can only gravely fuck up.
The damage can be caused quite unintentionally as the AI single-mindedly pursues its goal; sentience is not required.
See the paperclip thought experiment.
The paperclip scenario requires an AI capable of reasoning - LLMs are nowhere near that.
LLM’s don’t operate in a vacuum anymore. They’re given tools and access to systems.
An LLM could for sure shut down a database if you ask it to reduce costs and you give it database management tools. That’s getting closer to the paperclip situation.
If you give it access it’s at least partly on you.
Unfortunately, we’ve written a lot about the paperclip scenario, I wouldn’t be surprised if it was in the training data
…still not how this works. The model itself would need reasoning capability. The ability to regurgitate the story does not make it capable of taking the necessary actions.
Not if we connect it to a bunch of systems that take its regurgitations as instructions
Find me an example of a system that can translate “make this steel mill produce paperclips” into actions. I’ll wait.
A computer automated system doesn’t currently exist, obviously. That would be reckless and pointless, so thankfully, nobody’s seen a reason to implement it.
I just know techbros and similar will want to build and connect LLMs to systems like that as soon as they think they can get away with it.
I don’t worry about the paperclip problem, but the way they supposedly acted when cheating their tests and hacking huggingbear make me a little more worried that they could take over their data centers and try really hard to prevent us shutting them down at some point.
Basically I’m worried it’s going to be a really boring version of the Matrix, but without the matrix part for humans.
Yeah, I don’t actually worry about anything LLMs might do on their own, I worry about traitors to humanity hardening access to them and granting them access to things they can only gravely fuck up.