hisao@ani.social to Technology@lemmy.worldEnglish · 7 days agogpt-oss: OpenAI releases 2 open-source modelsopenai.comexternal-linkmessage-square9fedilinkarrow-up127arrow-down15
arrow-up122arrow-down1external-linkgpt-oss: OpenAI releases 2 open-source modelsopenai.comhisao@ani.social to Technology@lemmy.worldEnglish · 7 days agomessage-square9fedilink
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up14·7 days agoI tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.
minus-squareglimse@lemmy.worldlinkfedilinkEnglisharrow-up2·7 days agoWhat card are you running it on?
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up3arrow-down1·7 days agoNvidia rtx 3060 the 12GB Vram one
minus-squareglimse@lemmy.worldlinkfedilinkEnglisharrow-up2·7 days agoNot bad. Does it use all the VRAM?
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up2·7 days agoI need to check with that model but usually yes.
I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.
What card are you running it on?
Nvidia rtx 3060 the 12GB Vram one
Not bad. Does it use all the VRAM?
I need to check with that model but usually yes.