But you’ll need a powerful system with 64GB of RAM to use it.

Microslop thinks that “Clutter free” means “bundled with an always on LLM” 😸

  • jtrek@startrek.website
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    13 hours ago

    I’m pretty sure local models still induce pyschosis and hallucinate. Maybe the cat’s out of the bag, but they still suck.

    • TheFogan@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      ·
      12 hours ago

      They absolutely do suck, but I can see some practical uses for them. IE I can see LLM’s as useful in localized specialized uses. for me I’d really like basically LLM as a like calendar, scheduling kind of thing, also say translating home assistant commands through a voice assistant to make it figure out actual intent etc…, nothing super mission critical, but also mostly things I wouldn’t want any 3rd party service that could change the rules for me, share them to others etc…