• Cethin@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    12 hours ago

    Most consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand.

    I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.

    • nilloc@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      1
      ·
      12 hours ago

      I could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.