Ollama (Local)

Ollama is the recommended local backend when privacy constraints prevent cloud usage.

Requirements

• Ollama installed.

• At least one model pulled locally.

Setup

1. Install Ollama from ollama.com.

2. Pull a model:

ollama pull qwen2.5:14b-instruct

1. Start server:

ollama serve

1. Configure in AI Backend settings tab.

Configuration

Setting	Value
Preferred Backend	Ollama
Ollama URL	http://127.0.0.1:11434
Ollama Model	e.g. qwen2.5:14b-instruct
Ollama API Key	optional
Ollama Headers	optional
Ollama Auto-Start	optional (ollama serve)

Notes

The active backend path is HTTP-based. CLI command fields are primarily used for validation/default-model detection.

Output Token Limits

The extension now sets num_predict automatically per request type. Previously, Ollama defaulted to 128 tokens, which caused truncated responses. Current values:

Request Type	num_predict
Chat	4096
Scanner (single request)	2048
Scanner (batch analysis)	4096
Payload generation	1024

Troubleshooting

• Empty responses: run ollama list and verify model exists.

• Connection issues: confirm server process and URL.

• Slow output: reduce model size on limited hardware.

Retry Behavior

If a request to Ollama fails due to a transient network error (connection timeout, connection refused), the extension retries automatically up to 6 attempts using a bounded stepped backoff schedule (500/1000/1500/2000/3000/4000 ms). Each retry is logged in the AI Request Logger with the attempt number and delay. After 5 consecutive failures a circuit breaker opens for 30 seconds before allowing a half-open probe — see Backends Overview → Retry Behavior.

Related Pages

• Backends Overview

• Troubleshooting