There are models that don’t need to consume the entire worlds data infinitively. We’ve had then before llms, things like the pi ai camera can do ai processing on image with something like 8mb of on board storage.

The problem is anthropic, open ai, who ever are trying to do the stupidist approach and assume they can brute force money and power at the problem and don’t understand that they need exponentially infinite data in a way that is unobtainable.

In an ideal world there would be a million little small local models that so specific tasks and can be ran on consumer hardware.