• crusa187@lemmy.ml
    link
    fedilink
    arrow-up
    5
    ·
    6 hours ago

    Agreed. Hate the data centers and corporate obsession with extreme waste for total value capture. Not the tech, especially on a local scale.

    A 128GB amd strix halo runs at 120W and can host large LLMs at home. If you ran it full time for inference it would still be under $20/mo in electricity costs.