Given that we’re nearly at the point where decade-old GPUs can run close to the best models, I think consumer-grade “LLM machines” are entirely plausible if hardware prices can ever stabilize. Could just be an eGPU and snazzy software stack if someone already has a laptop.
With how much “AI” companies want to charge an eGPU would already pay for itself in a few days for just one person at a ridiculous “AI-first” company.
Given that we’re nearly at the point where decade-old GPUs can run close to the best models, I think consumer-grade “LLM machines” are entirely plausible if hardware prices can ever stabilize. Could just be an eGPU and snazzy software stack if someone already has a laptop.
With how much “AI” companies want to charge an eGPU would already pay for itself in a few days for just one person at a ridiculous “AI-first” company.