• SootySootySoot [any]@hexbear.net
    link
    fedilink
    English
    arrow-up
    27
    ·
    edit-2
    2 days ago

    When the bubble pops (or at the very least when all that data center hardware gets obsolete) GPU and RAM prices gonna TANK. I’m not a fan of AI, but by that point, local-run models will be extremely cost-effective.

    Only reason AI companies are even slightly competitive on price currently is because supply hasn’t yet caught up to their mass cut-price purchases, plus the fact they’re subsidising price still on huge losses.

    • Collatz_problem [comrade/them]@hexbear.net
      link
      fedilink
      English
      arrow-up
      10
      ·
      2 days ago

      When the bubble pops (or at the very least when all that data center hardware gets obsolete) GPU and RAM prices gonna TANK.

      There is a very high probability that the hardware companies will significantly reduce their production to keep the prices from falling.

      • SootySootySoot [any]@hexbear.net
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        2 days ago

        I’m sure they will reduce their production, but unless they convince most datacentres to chuck their old hardware, I don’t think it’ll be close to enough to accommodate the flood of hardware to come.

        We’ve already had a year of massive over-production, and rising still. Even better, Chinese companies have been increasingly entering the market and they don’t tend to stop for sheet.

        Unless the bubble pops very soon, no amount of reducing production will stop an oversupply.