• spectre [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    8
    ·
    5 days ago

    My AI enthusiast friends are interested in hosting their own model on a beefy laptop or a rack in their back closet. There are just so many better options than giving Microsoft $6000/month (or $600/month).

        • ziggurter [he/him, comrade/them]@hexbear.net
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 days ago

          Ah. I see. Not your own model; just your own hosting infrastructure.

          Yeah, you could potentially do it. You’ll get the same junk they’re delivering with the model running on their infrastructure though, of course.