Megacorps don’t burn resources for the shake of it. They do it to train/run LLMS.
If all that running/training is done by the individual instead, the individual is going to be the one burning the resources.
In fact, it would probably be more resource intensive.
Since centralization and scale usually improves efficiency.
Most people don’t have computer hardware that was built with the sole purpose of training/running LLMs. LLM data centers do. Purpose-built hardware is more efficient than generic hardware.
If you are browsing Piefed you are probably using about 10-20% of your computer’s resources (if it is a computer capable of running a 4B model).
When you question the model and it pegs your system out, that is between 5 and 10 TIMES more resource utilization and power waste just to have a question answered that you could have taken the time to research, improve your own critical thinking skills, and learned something without changing your utilization at all.
No one in this post about Google is talking about local LLMs.
i was trying to say Local LLMS dont destroy the environment(cause its using the power of your pc instead)
Your computer uses more power when the GPU is “thinking” than when its idle, so there would still be environmental damage.
Training the models still uses a vast amount of resources
well atleast every prompt you ask it wont harm the environment
Megacorps don’t burn resources for the shake of it. They do it to train/run LLMS.
If all that running/training is done by the individual instead, the individual is going to be the one burning the resources.
In fact, it would probably be more resource intensive.
Since centralization and scale usually improves efficiency.
Most people don’t have computer hardware that was built with the sole purpose of training/running LLMs. LLM data centers do. Purpose-built hardware is more efficient than generic hardware.
If you are browsing Piefed you are probably using about 10-20% of your computer’s resources (if it is a computer capable of running a 4B model).
When you question the model and it pegs your system out, that is between 5 and 10 TIMES more resource utilization and power waste just to have a question answered that you could have taken the time to research, improve your own critical thinking skills, and learned something without changing your utilization at all.
Not counting the training debt.
i forgot about critical thinking, hehe.
but i hope my use of AI doesnt ruin it that much.
btw the best respones here.
“I’m not the one deforesting the amazon but I really love teak furniture, so I’M not the one hurting anybody by buying it”
Yeah, but Google search isn’t using local models.
sadly true