• spectre [he/him]@hexbear.net
        link
        fedilink
        English
        arrow-up
        8
        ·
        5 days ago

        My AI enthusiast friends are interested in hosting their own model on a beefy laptop or a rack in their back closet. There are just so many better options than giving Microsoft $6000/month (or $600/month).

            • ziggurter [he/him, comrade/them]@hexbear.net
              link
              fedilink
              English
              arrow-up
              1
              ·
              5 days ago

              Ah. I see. Not your own model; just your own hosting infrastructure.

              Yeah, you could potentially do it. You’ll get the same junk they’re delivering with the model running on their infrastructure though, of course.