Memory Prices Indefinitely High: SK Hynix Says Shortage Continues Through 2030 We haven't been complaining about RAM prices quite as much on the podcast
This. As with any technology, it will always improve. The American government helped the Chinese by barring the chips from them, meaning they had to program more efficient models.
We don’t know if they’re actually more efficient because ClosedAI and Anthropic won’t tell us how (in)efficient their models are, whether they’re running quants, etc. Kimi K3 is about 3 terabytes of VRAM unquantized so I wouldn’t call the Chinese models super efficient either. The “efficient” models are the distillations and particularly quantized versions of some Chinese models. Nothing stopping ClosedAI and Anthropic from doing the same if they’re willing to lose a bit in accuracy.
This. As with any technology, it will always improve. The American government helped the Chinese by barring the chips from them, meaning they had to program more efficient models.
We don’t know if they’re actually more efficient because ClosedAI and Anthropic won’t tell us how (in)efficient their models are, whether they’re running quants, etc. Kimi K3 is about 3 terabytes of VRAM unquantized so I wouldn’t call the Chinese models super efficient either. The “efficient” models are the distillations and particularly quantized versions of some Chinese models. Nothing stopping ClosedAI and Anthropic from doing the same if they’re willing to lose a bit in accuracy.