the 27b model fits completely on the gpu so ram and cpu makes no difference.
For the deepseek model you need a fast ssd because no matter how big your ram is that model won’t fit there since it is almost 300gb.
I’ve got a ryzen9 5900x and 40gb ram. I don’t know how much of an impact the cpu actually has because i think most of it is evaluated on the gpu but could be that the router that selects the experts is executed on the cpu.
in any case the main impact will probably be vram size, pci-e throughput and ssd read speed (and maybe cpu speed).
Can you speak in common market specs? How much RAM, CPU, GPU, etc.
the 27b model fits completely on the gpu so ram and cpu makes no difference.
For the deepseek model you need a fast ssd because no matter how big your ram is that model won’t fit there since it is almost 300gb.
I’ve got a ryzen9 5900x and 40gb ram. I don’t know how much of an impact the cpu actually has because i think most of it is evaluated on the gpu but could be that the router that selects the experts is executed on the cpu.
in any case the main impact will probably be vram size, pci-e throughput and ssd read speed (and maybe cpu speed).