It doesn’t say anything about how this works. “No data retention” suggests that data is going to a server that’s processing it but then not retaining it. That’s bad, this type of feature should run entirely on the client.
Also, there’s a proprietary AI model doing the work, even if inference is in the client. It says “open weight” but that’s like letting people download a program as a compiled binary, the exact opposite of what FOSS is supposed to mean. It’s an open/free model only if the training data and algorithms are also public, not just the trained weights.
AI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It’s enough that the source is available and you can rebuild any component if you want ot do so.
It doesn’t say anything about how this works. “No data retention” suggests that data is going to a server that’s processing it but then not retaining it. That’s bad, this type of feature should run entirely on the client.
Also, there’s a proprietary AI model doing the work, even if inference is in the client. It says “open weight” but that’s like letting people download a program as a compiled binary, the exact opposite of what FOSS is supposed to mean. It’s an open/free model only if the training data and algorithms are also public, not just the trained weights.
Issue is that local AI hog vram, are slow and small models. Or if you don’t have a compatible GPU, it uses the CPU which is even slower.
If AI is the future, I really hope it’s local, but with the equipment people have at home, local AIs are a non-starter.
IMO it’s enough to justify not shipping those AI features at all but I guess that’s where FF execs disagree.
AI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It’s enough that the source is available and you can rebuild any component if you want ot do so.