Not really, they are testing your passwords against have I been pawnd. I agree that transparency should apply here, and also an upfront question to skip.
But it’s not “unsafe” or a privacy breach per se. No password has actually been “sent” anywhere only a partial hash that is useless for accessing your home assistant.
Yes i do.
I esperiment a lot, but my stable setup is Qwen 3.8 27B Q6_K on my home server. Hardware is Ryzen 9 5950x with 64gb ddr4 and two old but effective NVIDIA RTX A4000 for a total of 32gb VRAM.
Qwen 3.8 is the best model I can run in terms of output quality. It can perform all tasks pretty well and it’s reasonably fast at 500ts prefill and 30/40ts processing. There are much faster models but honestly not as good.
I can also run gemma4 all on CPU, with no GPU at all.
The key point is having both GPU on pci-e CPU, not on chip set bridge, so I am using a PCI riser 8x8x to share the 16x slot between the two GPUs. Inference speed is unaffected, but prefill benefits immensely.
Software side, use llama.cpp on Linux, you get the best performance possible at the expense of a bit more complexity compared to other engines.
From a power consumption perspective, I tined down my CPU governor and maximum frequency, and also the GPUs maximum watts. At ide the system is around 80w. At peak, it’s about 280w with the limiters, and inference speed doesn’t suffer too much. Without limiters I can easily reach 650w.
Edit: I run llama-swap in front of llama-cpp, and openwebui as agent manager/ web GUI. I also have ComfyUI installed because why not but seldomly use it.
You can read more of my setup on my wiki https://wiki.gardiol.org/8-llm-and-ai (no ads, no monetization whatsoever because fuck a hobby should not be a side gig)
Yes but unfortunately this specific tool is here to stay. Either we learn on how to use it properly and ethically and we regulate it, or we will be in deep troubles. Just denying and refusing to accept AI is here is dumb.
By regulate I mean at state and super-state level (not thinking of USA, but of the world) and define and accept proper ethical rules, both for individuals and corporations.
that is … Debatable.
Yeah even writing lead to cognitive loss, because now people don’t have to memorize everything.
It’s just fear for the future and for change. And this is probably the most massive change in human history since fire was discovered.
But don’t fear too much: the change is here and will stay, that’s the only sure thing
Edit: what I mean is that accepting the fact AI is here and won’t go away because we don’t like it is the path to start regulating it at government level and agreeing on ethical rules to use it. Just saying you are a bad person of you use it it’s like hiding under the sand. You lose.
Because they don’t.
Maybe they can be carrier but don’t get sick.
Flu or cold for example…
Fully agree with Linux.
Ai is a tool. Learn how to properly use it or not use it like you prefer, it’s a goddamn tool.
If you are a bad coder you will still be a bad coder using AI. If you are a good coder, you will be a faster good coder with AI.
It’s a fucking tool.
I bought it new, but of course you can repurpose old hardware!
I bought a firewall appliance based on an Intel CPU, with 4x 2.5gbps Ethernet ports, 8gb ram. Installed opnSense on it and been super happy even since!
A bit pricey the hardware, but it’s been totally rock solid for almost two years now.
I have configured unbound with ad blocking on opnSense, and it has every single option I would ever want on it. Amazing stuff.
Yes it’s a risk, but to be honest how many people do write assembly my hand? Also, code autogenerated is an industry fact for many years too.
Automation of art? Nah. Maybe commercial art, but not art itself. (I mean, artists who work for magazines, advertising… Compared to artist who do art like painters or musicians…)
No, people will keep doing the manual part of it. Some will be just cheaper that way )the real cost of AI will have to be paid sooner or later) while some will be done for fun.
Back to my example: nobody farm by hand except for fun or as a hobby. The same will apply with AI.
Short answer: yes.
Long answer: ai is a tool. In some fields it improved productivity. Not using it might hurt.
Can I work my garden without power tools? Yes I can. Would I grow more tomatoes and eggplant with power tools? Indeed.
Should I do it? Depends… Not if manual gardening is your hobby and you have fun in doing the action yourself… Yes if your livelihood depends on feeding your family with your garden produce.
We definitely need a community that copy these walls and keep for future memory…
Stupid people will always take a valid principle and push It too far refusing to see what good can be out there.
AI is a tool and it’s here to stay. The sooner we learn to cope, regulate and use it ethically the better. And shutting down any use of AI is just stupid.
I have only one user and host no public communities (at least, none that I would migrate). Ok I see.
So I would setup piefed on a different subdomain and then can I migrate / copy all my subscribed communities and posts and comments over? Because I want to remove the Lemmy instance then, and not lose all that
I would be very interested
I have four dogs… I know what I am talking about.
Dogs think, of course, but usually get to better and faster conclusions than AI…
That’s why they think less than AI.
No way to migrate from Lemmy to piefed right? If I replace my instance I lose all my posts and history?
Of course , sorry not English native… I seen your point.
Yes very possible.
Are they all serious issues? Almost certainly not.
Should those be fixed anyway? Well, why not? After all if the software is not abandoned, there is no need not to fix those.
Yes, simply put software is so complex, so many layers, that without a little critter working it’s ass off to find any possible stupid bug it was just too complex to find
Reverse proxy my friend…
Using one static IP per service feels so much like … 1990s…
… As well as owing a /24, I admit.