OpenAI CEO Sam Altman said in a podcast interview that "it's quite terrible" for people to have RAM in their own PCs when it could go into AI data centers.
Yeah, people don’t really get the point of the massive data centers. While they do need a decent chunk of infrastructure to run their models for customers, a large amount of it is just for training, data processing and collection, and other R&D tasks.
The models themselves, once trained, are much more reasonable in terms of computation.
it also means that once the model has been trained to the point of diminishing return the data center just becomes a pollution factory that does nothing
which to be fair is what they already were but this also may be where we are
You can run it on a mid range gaming PC just fine these days. Which is why he’s terrified
Yeah, people don’t really get the point of the massive data centers. While they do need a decent chunk of infrastructure to run their models for customers, a large amount of it is just for training, data processing and collection, and other R&D tasks.
The models themselves, once trained, are much more reasonable in terms of computation.
it also means that once the model has been trained to the point of diminishing return the data center just becomes a pollution factory that does nothing
which to be fair is what they already were but this also may be where we are
More models! More training! Infinite growth!