Civilizational intelligence infrastructure must remain free to study, build, deploy, and run, not rented from closed institutions.
    • mabeledo@lemmy.worldEnglish
      2·
      2 days ago

      I was talking about combined system RAM. People often overestimate what the average system specs are.

      • ZephyrXero@lemmy.worldEnglish
        4·
        2 days ago

        If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM