So the problem here is that every machine would have to run an instance of some model, you can’t spread the model over all the machines. It’d be too slow. Reading from NVMe on your very own machine is already pretty slow as it is. Kinda limits the model size.
You can let others use your hardware and in return get higher priority to use others. Want to generate 20 images? Its quicker spread across several other peoples GPUs at the same time with the same prompt.
Not poked AI stuff in a while though, it was interesting from a technical perspective but overall not super useful to me.
So the problem here is that every machine would have to run an instance of some model, you can’t spread the model over all the machines. It’d be too slow. Reading from NVMe on your very own machine is already pretty slow as it is. Kinda limits the model size.
You can let others use your hardware and in return get higher priority to use others. Want to generate 20 images? Its quicker spread across several other peoples GPUs at the same time with the same prompt.
Not poked AI stuff in a while though, it was interesting from a technical perspective but overall not super useful to me.