• 9tr6gyp3@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    21 hours ago

    Whats your viewpoint on open weight models that run on local hardware only? Such as a gemma4 or qwen3.6 models that can run on pretty much any gaming PC?

    • Victor@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      19 hours ago

      🤷‍♂️ You do whatever you want, but I would want to ask myself:

      • what/whose is the training data?
      • will this be in production or is it a PoC or other learning experiment?
      • will this code be published? If so, which license?
      • am I getting worse at what I do by using it? Will I be able to create the same thing without the LLM with unlimited time? Am I learning or getting dumber/stagnating?

      Things like that plague me, and dissuade me from using AI in the first place. I don’t want to become dependent.

      • 9tr6gyp3@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        7 hours ago

        Those are good things to ask prior to using it, but thats just the beginning.

        • If the training data matches what you would look up on the internet anyway, is it a deal breaker?
        • If it cannt be used for production, what about for organizational purposes? Documentation? Resource tracking? Upstream changes? Merging considerations? Security auditing?
        • It sounds like you would rather do the coding part, correct me if I’m wrong. This way you have full control of the license. For someone who isn’t a coder, they would probably have to consider that the code it generates could closely resemble an existing licensed work since the models are trained on open-source data.
        • I think the getting dumber argument is going to depend on the user, and its not an LLM issue specifically. You could definitely bypass the thinking process, but you could also make it explain things step by step, which could also accelerate learning stuff.

        But you’re right, to each their own.