I’ll get this right out of the way first and foremost: if you absolutely need to use ai, run it locally. If you are gpu poor, find a service that hosts models on someone else’s machine, like silly tavern, kobold, lama, or things like artbot if you want to Vincent Van Techbro.
So I’ve been dabbling in farting around with this job stealing, planet vaporizing, technology for a year now and boy are these things nothing but hot air. I’ve tried all the frontier models for daily search engine stuff, questions, advice on stupid stuff like what games to play or what comics to read. Grok, (gag me) Gemini, ChatGPT, Claude, it’s all the same and it’s all shit.
Just yesterday ChatGPT gave me all the wrong issues of spider-man to read and that was the straw that broke the camel’s back and pissed me right off. Grok is just unhinged and wants to erp with you especially if you are a minor, Gemini is SORT OF okay, but that’s because they enshittified google search to make way for it. Claude is the most quirk chungus of the models, you can tell it was programmed to talk like a redditor or a discord moderator and that’s apparently the trick to fooling vc dipshit this is AGI.
Anywho these things are not worth it, but apparently capitalism has decided we are eternally 2 years away from agi so it’s full steam ahead of data centers shoved into the orifice of every closed down strip mall in the decaying rustbelt.
Yes, I hate them for all other purposes but for software it is unreal. As long as you’re the centaur, at least.
They can’t stick to a plan, none of them can, they’re terrible for that. But for short feedback loop work with frequent verification and good test coverage, there’s nothing else like it. That’s the key difference between software and other domains; you can rigorously test it, and you’ll put hands on it before it goes to a customer. If you care even a little bit, the experience doesn’t have to be sloppy for the consumer.
I can show opus (4.8 high is the sweet spot) a screenshot of an error message and a problem description and it’ll trace back from that error message across four different repos and have a fix ready in under a half an hour, basically every time. Logic that would have taken me hours to trace through by hand on codebases I know really well.
I had a big, nasty, multi-table join database query that badly needed optimization. I told claude to design and build a test database that reproduced the issue and then iterate on query shapes that would get the query planner to do the right thing. Ultimately I unlocked it by suggesting a small schema change, which it implemented and tested almost as fast as I could type it out. 175x improvement in maybe an hour, after dozens of hours of real engineer effort over the years. I just needed a 3D display to wave my hands around and stare pensively at for the full Tony Stark / Jarvis experience.
It’s hard to argue with the results; with claude in my hands I have been able to fix everything about the product that has ever bugged me going back a decade. Of course, since we have this tool now, my company let two thirds of the engineers go… given the choice I’d rather just have them back.
Anthropic and OpenAI are both screwed in the medium term though. Fable and Opus 5 are not only too expensive, they’re functional regressions in my team’s experience. And Kimi is already as good as Opus in real world use. Qwen3.8-27B will run on my laptop and is as good as Sonnet.