Heard some people say that a so called “Human Zoo” is one of the best-case scenarios with pseudo-omniscient AI taking care of all of us. Supposedly that comes true, to what ends would humans continue to keep a population going, simply due to biological bias? You think humans would devolve in some way, or become intellectually atrophied?


In my OP, I did not mean specifically some LLM, but a hypothetical, scalable-past-human-capabilities synthetic brain.
I would argue that a human brain is a statistical model. Complex, but in the end it’s a black box that takes in input from senses, and spits out output in form of interaction with environment. I’m not saying we and LLMs are in any way alike, or that AI is alive. But I do not agree with postulation that a true artificial thinking machine is impossible to build within next 1B years or however long Earth stays habitable for complex life.
You’d be wrong. Humans are a series of logic gates which don’t strictly compare values odds. We actually kind of suck at statistics.