7 guides
Models on your own machine
Ollama, LM Studio, another computer or an AI box on your network.
- Run a model on your own machine with OllamaInstall Ollama, pull a model, and NeuralVault finds it at localhost:11434 with no API key and no account.
- Connect LM Studio, or any other OpenAI-compatible serverAnything that speaks the OpenAI API on a URL you control connects through the "OpenAI-compatible" provider, and needs a base URL rather than a key.
- Connect an NVIDIA DGX Spark, or any AI box on your networkA Spark, a second PC, or any machine on your network running Ollama or another OpenAI-compatible server connects through the same "OpenAI-compatible" provider as a local one, once you give it a network address instead of localhost.
- Use Ollama running on another computer, such as a Mac or a Linux boxNeuralVault runs on Windows only, but the models can run on any machine on your network that runs Ollama. Make that machine listen on the network, then point NeuralVault’s Ollama address at it in one small file.
- Before you let other computers reach Ollama: a security noteMaking Ollama listen on the network lets any device that can reach that port use your models. Ollama’s documentation describes no sign-in for it, so keep it on a network you trust.
- Local model problems: Ollama not found, an empty list, a machine that is not reachableThe Ollama row in Settings, Intelligence, API keys tells you which of five states you are in and what to do next, whether Ollama is on this PC or another computer.
- Local and custom models ask before every command and outbound callAlso hereIn NeuralVault 2.0 a model you run yourself or reach through a custom endpoint is not trusted by default, so it asks before every shell command and every outbound call, and you can mark one trusted.Home: Tools, approvals and safety / How much it may do without asking