OpenAI CEO Sam Altman said in a podcast interview that "it's quite terrible" for people to have RAM in their own PCs when it could go into AI data centers.
Maybe, maybe not. Phones are getting more optimized for AI and have decent RAM, so the on device models may not be great at agentic problem solving, but they’ll probably meet most people’s AI needs
Plus, any reasonable gaming computer or MacBook can run models… Maybe a bit slowly and maybe just the compressed 8gb models, but they can pretty much all do it to some degree
So I think we’ll be in a place where there’s little or no upfront cost after a couple more key advancements
Maybe, maybe not. Phones are getting more optimized for AI and have decent RAM, so the on device models may not be great at agentic problem solving, but they’ll probably meet most people’s AI needs
Plus, any reasonable gaming computer or MacBook can run models… Maybe a bit slowly and maybe just the compressed 8gb models, but they can pretty much all do it to some degree
So I think we’ll be in a place where there’s little or no upfront cost after a couple more key advancements