I have avoided AI (LLMS) because it didn’t seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?
Depends what you’re wanting to use that AI for. Is it figuring out protein chains that might help make a vaccine? Sure. Is it making media at the expense of creators? No thanks. It’s hard to justify the costs of large AI rollout and honestly, from what I’ve read and heard, it’s hamstrung from the power grid.