Same, toyed with it for creating stupid things like bot for telegram, that basically was a 3rd-person NSFW storyteller in RP chat. Sadly, after I made said bot I remember that I don’t have friends to RP with.
That being said, ollama+openwebui kinda sucks: openwebui have “wider scope” and features that you don’t need like auth via social providers and managing multiple accounts, while ollama itself does the opposite and lacks certain features (like proper mmap support to load big models), slow in comparison to pure llama.cpp and generally easily replaceable with lm studio, that provides both - client and server. So yeah, my advise for anyone who want to try it localy - just use lm manager.
Same, toyed with it for creating stupid things like bot for telegram, that basically was a 3rd-person NSFW storyteller in RP chat. Sadly, after I made said bot I remember that I don’t have friends to RP with.
That being said, ollama+openwebui kinda sucks: openwebui have “wider scope” and features that you don’t need like auth via social providers and managing multiple accounts, while ollama itself does the opposite and lacks certain features (like proper mmap support to load big models), slow in comparison to pure llama.cpp and generally easily replaceable with lm studio, that provides both - client and server. So yeah, my advise for anyone who want to try it localy - just use lm manager.