• spectre [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      8
      ·
      5 days ago

      My AI enthusiast friends are interested in hosting their own model on a beefy laptop or a rack in their back closet. There are just so many better options than giving Microsoft $6000/month (or $600/month).

          • ziggurter [he/him, comrade/them]@hexbear.net
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 days ago

            Ah. I see. Not your own model; just your own hosting infrastructure.

            Yeah, you could potentially do it. You’ll get the same junk they’re delivering with the model running on their infrastructure though, of course.