lemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 3 days agoOpensource AI Must Winopensourceaimustwin.comexternal-linkmessage-square106fedilinkarrow-up1281arrow-down120cross-posted to: technology@lemmy.mltechnology@hexbear.net
arrow-up1261arrow-down1external-linkOpensource AI Must Winopensourceaimustwin.comlemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · 3 days agomessage-square106fedilinkcross-posted to: technology@lemmy.mltechnology@hexbear.net
minus-squareZephyrXero@lemmy.worldlinkfedilinkEnglisharrow-up4·2 days agoIf the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM
If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM