eicker@lemmy.world to Technology@lemmy.worldEnglish · edit-25 days agoMistral and Mozilla are bringing open, private and multilingual AI to your web browser: a partnership to bring privacy, control and choice to people using AI to browse online.mistral.aiexternal-linkmessage-square105fedilinkarrow-up1203arrow-down148
arrow-up1155arrow-down1external-linkMistral and Mozilla are bringing open, private and multilingual AI to your web browser: a partnership to bring privacy, control and choice to people using AI to browse online.mistral.aieicker@lemmy.world to Technology@lemmy.worldEnglish · edit-25 days agomessage-square105fedilink
minus-squareCommanderCloon@lemmy.mllinkfedilinkEnglisharrow-up1·2 days agoIssue is that local AI hog vram, are slow and small models. Or if you don’t have a compatible GPU, it uses the CPU which is even slower. If AI is the future, I really hope it’s local, but with the equipment people have at home, local AIs are a non-starter. IMO it’s enough to justify not shipping those AI features at all but I guess that’s where FF execs disagree.
minus-squaresolrize@lemmy.mllinkfedilinkEnglisharrow-up1·2 days agoAI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It’s enough that the source is available and you can rebuild any component if you want ot do so.
Issue is that local AI hog vram, are slow and small models. Or if you don’t have a compatible GPU, it uses the CPU which is even slower.
If AI is the future, I really hope it’s local, but with the equipment people have at home, local AIs are a non-starter.
IMO it’s enough to justify not shipping those AI features at all but I guess that’s where FF execs disagree.
AI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It’s enough that the source is available and you can rebuild any component if you want ot do so.