Has anyone tried in organization to use self hosted llm models for agentic programming?

Im curious if it makes any sense. My organization spends fortune on tokens from us companies. I want to recommend something…

  • robertdegallan@lemmy.org
    link
    fedilink
    arrow-up
    1
    ·
    22 hours ago

    I would recommend Qwen4-27B + CoDoc

    What is CoDoc? Have a look at the recent post I published so that you have all context (no pun intended) ;)

    IMO, massive costs savings ahead for those that adopt the set-up above.