Configure Ollama inference
Run Ollama on a host reachable from the Payne containers and pull the chosen model before configuring Payne. Local inference reduces external data transit; it does not remove metadata, model, host, or application security risks.
Confirm the selected model against Ollama’s official tool calling and structured output guides. Payne still requires its own live contract check because Ollama feature support does not imply compatibility for every model.
ollama listAdd the provider, that model identifier, and the URL reachable from Compose:
PAYNE_INFERENCE_PROVIDER=ollama
PAYNE_INFERENCE_MODEL=REPLACE_WITH_AN_ALREADY_PULLED_MODEL
PAYNE_OLLAMA_BASE_URL=http://host.docker.internal:11434Restart the stack and choose Check inference on Connection. Payne does not claim support for arbitrary local models; the configured model must pass the live tool and structured-output check.
Last updated on