Providers
Octrafic supports cloud and local AI providers. Choose one during first launch or switch anytime with octrafic --onboarding.
Cloud
| Provider | Get API key |
|---|---|
| Claude (Anthropic) | console.anthropic.com |
| OpenRouter | openrouter.ai/keys |
| OpenAI | platform.openai.com |
Local
No API key needed. Just run a model server locally.
| Provider | Default URL | Get started |
|---|---|---|
| Ollama | localhost:11434 | ollama.com |
| llama.cpp | localhost:8080 | github.com/ggml-org/llama.cpp |
Quick start with Ollama:
bash
ollama pull llama3.1
octrafic --onboarding # select OllamaCustom (OpenAI-compatible)
Any API that follows the OpenAI chat completions format is supported. This covers providers like Groq, Mistral, DeepSeek, Together AI, and others.
Select Custom (OpenAI-compatible) during onboarding, then enter:
- Base URL — the API root without
/v1, e.g.https://api.groq.com/openai - API key — optional, leave empty if the endpoint requires no auth
Octrafic will fetch the model list automatically. If that fails (some providers don't expose /v1/models), you can type the model name manually.
Configuration
Settings are stored in ~/.octrafic/config.json. To switch provider, run octrafic --onboarding.