LLMs are a money hole. They are so fucking inefficient that they can only spit out a hundred words per second on high end consumer hardware that would have be considered a supercomputer 20 years ago. And the fact that those words are a likely to be a lie as they are truth means you need to burn more coal to get it to do it’s own fact checking.
Maybe in 20 years when we can pack a couple of exaflops into a phone llms will make sense as a swiss army knife solution.
I’m sure this will be worthwhile to spend money on.
Related: “The developer of an AI-powered driving instruction simulator is spending $1,000 per day just to keep its demo running”
LLMs are a money hole. They are so fucking inefficient that they can only spit out a hundred words per second on high end consumer hardware that would have be considered a supercomputer 20 years ago. And the fact that those words are a likely to be a lie as they are truth means you need to burn more coal to get it to do it’s own fact checking.
Maybe in 20 years when we can pack a couple of exaflops into a phone llms will make sense as a swiss army knife solution.