Little bit of everything!

Avid Swiftie (come join us at !taylorswift@poptalk.scrubbles.tech )

Gaming (Mass Effect, Witcher, and too much Satisfactory)

Sci-fi

I live for 90s TV sitcoms

  • 16 Posts
  • 405 Comments
Joined 3 years ago
cake
Cake day: June 2nd, 2023

help-circle

  • I do selfhost my own, and even tried my hand at building something like this myself. It runs pretty well, I’m able to have it integrate with HomeAssistant and kubectl. It can be done with consumer GPUs, I have a 4000 and it runs fine. You don’t get as much context, but it’s about minimizing what the LLM needs to know while calling agents. You have one LLM context that’s running a todo list, you start a new one that is charge of step 1, which spins off more contexts for each subtask, etc. It’s not that each agent needs it’s own GPU, it’s that each agent needs it’s own context.


  • I am and do, I have no qualms with AI if I host it myself. I let it have read access to some things, I have one that is hooked up to my HomeAssistant that can do things like enable lighting or turn on devices. It’s all gated, I control what items I expose and what I don’t. I personally don’t want it reading my emails, but since I host it it’s really not a big deal at all. I have one that gets the status of my servers, reads the metrics, and reports to me in the morning if there were any anomalies.

    I’m really sick of the “AI is just bad because AI is bad”. It can be incredibly useful - IF you know it’s limitations and understand what is wrong with it. I don’t like corporate AI at scale for moral reasons, but running it at home has been incredibly helpful. I don’t trust it to do whatever it wants, that would be insane. I do however let it have read permissions (and I know you keep harping on it, but MCP servers and APIs also have permission structures, even if it did attempt to write something, my other services would block it and it’d be reported) on services to help me sort through piles of information that I cannot manage by myself. When I do allow write access it’s when I’m working directly with it, and I hit a button each time it attempts to write. Think spinning up or down containers on my cluster while I am testing, or collecting info from the internet.

    AI, LLMs, Agentic AI is a tool. It is not the hype every AI bro thinks it is, but it is another tool in the toolbelt. To completely ignore it is on par with ignoring Photoshop when it came out, or Wysiwyg editors when they came designing UIs.









  • It is true, and I counter that with if you choose to live far away from people then you will be prioritized less. Things get fixed faster when there are more people affected, so when you choose to live miles away from anyone, when your power goes out it’s not a high priority. I argue that that’s their choice, and that it’s deserved when it also costs much more for that one person to have power compared to thousands of people getting power for relatively the same cost in an urban area. Harsh I know, but that’s how the money flows. They can always move to an urban area if they choose that services are more important than living rurally. More or less I agree with you, but I would tell them “you chose that”.



  • God people in rural communities are so stupid when they vote. I live in a very lopsided state. Just for ease of understanding, about 80% of the state is rural, but also 80% of the people live in the cities. Rural folks often forget just how many more people live in cities.

    So they get resentful and say “why are MAH tax dollars going to all them city folks”! I’ve had this talk so many times with them, why should they pay (like pennies or their salary) to my city improvements just because they’re state taxes?

    Well, rural guy, because in actuality “us city folk” subsidize all of the rural state. They think they’re paying for our stuff but turns out density is way cheaper and way more economically viable than rural. So we subsidize them all the time. I always remind them who do they think pays for the roads, the infrastructure, their state parks? It’s not them and their low tax income. Their life depends on the city people

    And then they vote to hurt us by cutting programs… And forget that we were paying for them to be on those programs.