Run a model on your own machine with Ollama
Install Ollama, pull a model, and NeuralVault finds it at localhost:11434 with no API key and no account.
Last checked against the app on · View as Markdown
Steps
- Install Ollama from ollama.com and let it finish starting. It runs as a background service and listens on http://localhost:11434, which is the address NeuralVault uses unless you change it.
- Pull a model. In a terminal, "ollama pull llama3.1" is a reasonable first choice; smaller models answer faster on modest hardware.
- Open NeuralVault and go to Settings, then Intelligence, then API keys. Ollama appears under "Providers that run locally" and asks for nothing, because there is no key to give a server on your own machine. The row says "Reached at" with the address, and a status line such as "Ollama is answering".
- Open the model picker in Chat and choose the model you pulled.
- If Ollama runs on a different computer instead, such as a Mac or a Linux box, see the guide on Ollama on another machine. NeuralVault itself runs on Windows only.
How to tell it worked
Send one message in Chat. If it answers, the whole path is working: nothing left your machine to do it.
If it does not work
- Ollama is installed but no models are listed.
- Installing Ollama does not download a model. The Ollama row says "Ollama has no models installed". Run "ollama list" in a terminal, and if it is empty, pull one.
- The app cannot reach Ollama.
- The Ollama row says "Ollama is not running" when nothing answers at its address. Start Ollama, then reopen the model picker. No setting in NeuralVault can start it for you. See the guide on local model problems for the other states.
- Answers are extremely slow.
- That is a hardware answer, not a configuration one. A model larger than your available memory will be swapped to disk. Try a smaller variant.