In theory costs could come down with each new hardware generation if the we dont keep pushing models the to max extent of what the hardware can do while pushing size.
E.g Claude Opus today, only trained in a similar size and manner as today, will be cheaper to run on whatever the next GPU that comes out with higher speeds and processing capabilities, unless of course NVidia raises the cost substantially. Given the current situation I think nvidia might do that which would hamper this lowering of costs, but it should possible, if not slower.
E.g 10 years from now it will be cheaper to run a opus similar model. But 10 years from now everyone will want the mythos of today, then. That wont be cheaper.
In theory costs could come down with each new hardware generation if the we dont keep pushing models the to max extent of what the hardware can do while pushing size.
E.g Claude Opus today, only trained in a similar size and manner as today, will be cheaper to run on whatever the next GPU that comes out with higher speeds and processing capabilities, unless of course NVidia raises the cost substantially. Given the current situation I think nvidia might do that which would hamper this lowering of costs, but it should possible, if not slower.
E.g 10 years from now it will be cheaper to run a opus similar model. But 10 years from now everyone will want the mythos of today, then. That wont be cheaper.