Gsus4@mander.xyz to World News@lemmy.worldEnglish · 2 days ago‘The cost of compute is far beyond the costs of the employees’: Nvidia exec says right now AI is more expensive than paying human workersfortune.comexternal-linkmessage-square107fedilinkarrow-up1722arrow-down15cross-posted to: technology@lemmy.worldhackernews@lemmy.bestiver.se
arrow-up1717arrow-down1external-link‘The cost of compute is far beyond the costs of the employees’: Nvidia exec says right now AI is more expensive than paying human workersfortune.comGsus4@mander.xyz to World News@lemmy.worldEnglish · 2 days agomessage-square107fedilinkcross-posted to: technology@lemmy.worldhackernews@lemmy.bestiver.se
minus-squareporous_grey_matter@lemmy.mllinkfedilinkEnglisharrow-up3·1 day agoThe cost of inference has passed the cost of training quite a while ago and it’s by far the majority of expenses
minus-squareKnock_Knock_Lemmy_In@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-213 hours agoThanks for the link, but disagree with your summary. The Spend on inference has passed the Spend on training. Training is the monopoly product and even the cheapest known model (deepseek) cost 10s of millions to train.
minus-squareporous_grey_matter@lemmy.mllinkfedilinkEnglisharrow-up1·12 hours agoThat’s got nothing to do with how expensive it is to serve models to customers which is what was being discussed.
The cost of inference has passed the cost of training quite a while ago and it’s by far the majority of expenses
Thanks for the link, but disagree with your summary.
The Spend on inference has passed the Spend on training.
Training is the monopoly product and even the cheapest known model (deepseek) cost 10s of millions to train.
That’s got nothing to do with how expensive it is to serve models to customers which is what was being discussed.