Chris wrote:
Yes — that's the Local AI app, and it's exactly what you're describing: it runs the model on your own box (Ollama) with a private ChatGPT-style chat screen (Open WebUI), so nothing ever leaves your network. No cloud, no account. One honest heads-up: these models want RAM, so on an 8GB machine stick with the small 3B models (the default is a good start) — the 7B-and-up ones want 16GB or more. Turn it on from the Apps page, or run sudo sparkbox enable localai and then sudo sparkbox up.