Yeah now that hardware isn’t as much of an issue (I got a couple models working on my years-old android) my barrier is pretty much as you’ve described. I can’t think of a personal usecase since I don’t code much, and as such delving into all the complexities is a big ask as of right now.

So far the only utility I regularly get out of LLMs is searching for internet results, but I have no idea how to go about getting a local model to do so, or if it’s even possible with old hardware.

Spent like an hour messing around on an old Linux desktop with an rx580, but never figured it out lol