If LLMs used very little RAM and processing power, was light weight even for Mythos or Sol, would people be as opposed? Like no data centers, no memory shortages, like it was able to run on a calculator with the same performance.
If LLMs used very little RAM and processing power, was light weight even for Mythos or Sol, would people be as opposed? Like no data centers, no memory shortages, like it was able to run on a calculator with the same performance.
Qwen 3.6 27B has similar capabilities to Claude Sonnet 4.6 for coding, but uses about as much power for inference as playing a game on the gaming PC running it, compared to Sonnet that probably runs on like 8 B200s in a data center. If people were mostly just running open weight models on gaming PCs with no tech bros involved, I don’t think we’d be seeing the same level of outrage.
There would still be many questions around ethical training and output reliability (depending on the task being asked), but yeah the major problem is that they’re using it to steal our natural and electronic resources and sell them back to us for something we don’t really need, that doesn’t really do what they’re convincing normies it does. The problem is that if you don’t understand what it’s actually doing, it appears very impressive.
In other words, it hits real hard if you’re stupid