Dog walker mostly And also a dog feeder.

Man, do you even browse Lemmy or are you just an llm bot?

Every post on AI is filled with anti AI people.

They know what is right and wrong. So they complain .

They believe they know, of course. Dowsn mean they actually know right.

Because of many, only a few complains usually. And the complainers usually have stronger beliefs (true or false, I am not debating here).

Yeah problem is when upgrades break stuff…

Unattended upgrade?

Why? Specially on critical systems?

If you do such upgrades, schedule for a time you don’t use the system at very least …

Running local models will never be illegal. But maybe regulating ai could help bring down the hardware cost, by limiting scalping and data center uncontrolled growth.

And having cheaper hrdware would bring down the entry barrier costs and help make local ai more widespread

No idea.

But not everybody is against ai. I am not. I am about regulating and find ethical approach to AI, which is pretty substantially different. I use ai.

But those advocating against will always have a louder mouth. And it will be useless anyway, since ai is here to stay.

I believe it’s just ignorance. And understandable also… Today’s people really think food grows in the supermarkets.

And its not their fault, read caves of steel from Isaac Asimov…

I am that old.

Free food? That’s communism! That will cripple a billionaire income!

Jokes apart, have you done gardening at scale? That requires massive labour or very expensive machinery, expertise, and resources like land and water.

At least on the scale to feed a significant number of people.

Your own garden can produce some stuff, but far from what would undercut retail stores business. Unless you scale it, it just stays that way.

Yeah, might be fun and also a good community project, but not more.

Reverse proxy my friend…

Using one static IP per service feels so much like … 1990s…

… As well as owing a /24, I admit.

Not really, they are testing your passwords against have I been pawnd. I agree that transparency should apply here, and also an upfront question to skip.

But it’s not “unsafe” or a privacy breach per se. No password has actually been “sent” anywhere only a partial hash that is useless for accessing your home assistant.

Yes i do.

I esperiment a lot, but my stable setup is Qwen 3.8 27B Q6_K on my home server. Hardware is Ryzen 9 5950x with 64gb ddr4 and two old but effective NVIDIA RTX A4000 for a total of 32gb VRAM.

Qwen 3.8 is the best model I can run in terms of output quality. It can perform all tasks pretty well and it’s reasonably fast at 500ts prefill and 30/40ts processing. There are much faster models but honestly not as good.

I can also run gemma4 all on CPU, with no GPU at all.

The key point is having both GPU on pci-e CPU, not on chip set bridge, so I am using a PCI riser 8x8x to share the 16x slot between the two GPUs. Inference speed is unaffected, but prefill benefits immensely.

Software side, use llama.cpp on Linux, you get the best performance possible at the expense of a bit more complexity compared to other engines.

From a power consumption perspective, I tined down my CPU governor and maximum frequency, and also the GPUs maximum watts. At ide the system is around 80w. At peak, it’s about 280w with the limiters, and inference speed doesn’t suffer too much. Without limiters I can easily reach 650w.

Edit: I run llama-swap in front of llama-cpp, and openwebui as agent manager/ web GUI. I also have ComfyUI installed because why not but seldomly use it.

You can read more of my setup on my wiki https://wiki.gardiol.org/8-llm-and-ai (no ads, no monetization whatsoever because fuck a hobby should not be a side gig)

Yes but unfortunately this specific tool is here to stay. Either we learn on how to use it properly and ethically and we regulate it, or we will be in deep troubles. Just denying and refusing to accept AI is here is dumb.

By regulate I mean at state and super-state level (not thinking of USA, but of the world) and define and accept proper ethical rules, both for individuals and corporations.

that is … Debatable.

Yeah even writing lead to cognitive loss, because now people don’t have to memorize everything.

It’s just fear for the future and for change. And this is probably the most massive change in human history since fire was discovered.

But don’t fear too much: the change is here and will stay, that’s the only sure thing

Edit: what I mean is that accepting the fact AI is here and won’t go away because we don’t like it is the path to start regulating it at government level and agreeing on ethical rules to use it. Just saying you are a bad person of you use it it’s like hiding under the sand. You lose.

Because they don’t.

Maybe they can be carrier but don’t get sick.

Flu or cold for example…

Fully agree with Linux.

Ai is a tool. Learn how to properly use it or not use it like you prefer, it’s a goddamn tool.

If you are a bad coder you will still be a bad coder using AI. If you are a good coder, you will be a faster good coder with AI.

It’s a fucking tool.

I bought it new, but of course you can repurpose old hardware!

I bought a firewall appliance based on an Intel CPU, with 4x 2.5gbps Ethernet ports, 8gb ram. Installed opnSense on it and been super happy even since!

A bit pricey the hardware, but it’s been totally rock solid for almost two years now.

I have configured unbound with ad blocking on opnSense, and it has every single option I would ever want on it. Amazing stuff.

Yes it’s a risk, but to be honest how many people do write assembly my hand? Also, code autogenerated is an industry fact for many years too.

Automation of art? Nah. Maybe commercial art, but not art itself. (I mean, artists who work for magazines, advertising… Compared to artist who do art like painters or musicians…)

No, people will keep doing the manual part of it. Some will be just cheaper that way )the real cost of AI will have to be paid sooner or later) while some will be done for fun.

Back to my example: nobody farm by hand except for fun or as a hobby. The same will apply with AI.