• Regrettable_incident@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    8 hours ago

    Sorry, ignorant question from someone who didn’t understand much of your comment - do you mean that AI models are writing code that improves them? Cos that would be interesting.

    • SabinStargem@lemmy.today
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      8 hours ago

      Not improvements to the AI themselves, but rather the software that runs them. Backends like Unsloth are typically generalists - they are compatible with all sorts of hardware, but in exchange, they don’t incorporate the latest improvements or ideas. Projects run by pure human implementation tend to require a lot of oversight to ensure that additions don’t break functionality.

      AI is really good at collecting and aggregating information. This makes them ideal for creating tailor-made products that have a narrow focus, since they raid many Githubs and papers, then attempt to make them into a product. Strata is one such backend, which is specially designed for Qwen Next-Flash.

      Strata runs much faster than Unsloth and other generalist backends, but lacks flexibility in what it is suited for.


      At least, that is my admittedly basic understanding of the situation…