• humanspiral@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    Headline is innacuralte. Customers who purchase a $200/month subscription, can save up to $13800 on token costs compared to “a la carte” token pricing. Open AI does lose over $1 per $ in revenue, but this is more a function of them having too much compute, and very high training costs, rather than a loss per gpu hour on tokens served, it should stilll be a loss for OpenAI:

    Open source model pricing per gpu hour, ranges from 80% margins at high batch saturation per user (low tps per user) to 50% at concurency of 8, to loss at fewer user requests per gpu. https://inferencex.semianalysis.com/compare/deepseek-r1-b300-vs-h200

    OpenAI has very high prices, and too much compute. They would likely lose $6000 per user who maxes out their $200 plan, and certainly over $1000 per user.