# LLM Provider Configuration
Beamlens supports the vast majority of LLM providers. You can configure them in the `client_registry` section of your configuration.
```elixir
{Beamlens,
client_registry: %{
primary: "Ollama",
clients: [
%{
name: "Ollama",
provider: "openai-generic",
options: %{base_url: "http://localhost:11434/v1", model: "llama3.2"}
}
]
}}
```
Beamlens utilizes BAML to provide LLM Client support. See the [ClientRegistry](https://docs.boundaryml.com/ref/baml_client/client-registry) documentation if you have questions beyond what this documentation provides.
## Default: Anthropic
By default Anthropic is configured with the `claude-haiku-4-5-20251001` model. No configuration needed. Set your API key and you're ready:
```bash
export ANTHROPIC_API_KEY="sk-ant-..."
```
## Anthropic
```bash
export ANTHROPIC_API_KEY="sk-ant-..."
```
```elixir
client_registry: %{
primary: "Anthropic",
clients: [
%{
name: "Anthropic",
provider: "anthropic",
options: %{model: "claude-haiku-4-5-20251001"}
}
]
}
```
Refer to the [BAML Anthropic documentation](https://docs.boundaryml.com/ref/llm-client-providers/anthropic) for more details.
## AWS Bedrock
AWS Bedrock uses standard AWS authentication methods.
```elixir
client_registry: %{
primary: "Bedrock",
clients: [
%{
name: "Bedrock",
provider: "aws-bedrock",
options: %{
model: "anthropic.claude-3-5-haiku-20241022-v1:0",
region: "us-east-1"
}
}
]
}
```
Refer to the [BAML AWS Bedrock documentation](https://docs.boundaryml.com/ref/llm-client-providers/aws-bedrock) for more details.
## Google AI Gemini
```bash
export GOOGLE_API_KEY="..."
```
```elixir
client_registry: %{
primary: "GoogleAI",
clients: [
%{
name: "GoogleAI",
provider: "google-ai",
options: %{model: "gemini-2.0-flash"}
}
]
}
```
Refer to the [BAML Google AI Gemini documentation](https://docs.boundaryml.com/ref/llm-client-providers/google-ai-gemini) for more details.
## Google Vertex AI
Uses Google Cloud Application Default Credentials.
```elixir
client_registry: %{
primary: "GoogleVertexAI",
clients: [
%{
name: "GoogleVertexAI",
provider: "vertex-ai",
options: %{
model: "gemini-2.5-pro",
location: "us-central1",
project_id: "my-project-id",
query_params: %{
key: "Your VERTEX_API_KEY" # Or set the API KEY
}
}
}
]
}
```
Refer to the [BAML Vertex AI documentation](https://docs.boundaryml.com/ref/llm-client-providers/google-vertex) for more details.
## Ollama (Local)
No API key. Your data stays on your machine.
```bash
# Install and run Ollama
ollama serve
ollama pull llama3.2
```
```elixir
client_registry: %{
primary: "Ollama",
clients: [
%{
name: "Ollama",
provider: "openai-generic",
options: %{
base_url: "http://localhost:11434/v1",
model: "llama3.2"
}
}
]
}
```
Refer to the [BAML Ollama documentation](https://docs.boundaryml.com/ref/llm-client-providers/ollama) for more details.
## OpenAI
```bash
export OPENAI_API_KEY="sk-..."
```
```elixir
client_registry: %{
primary: "OpenAI",
clients: [
%{
name: "OpenAI",
provider: "openai",
options: %{model: "gpt-4o-mini"}
}
]
}
```
Refer to the [BAML OpenAI documentation](https://docs.boundaryml.com/ref/llm-client-providers/open-ai) for more details.
## OpenAI Azure
```bash
export AZURE_OPENAI_API_KEY="..."
```
```elixir
client_registry: %{
primary: "AzureOpenAI",
clients: [
%{
name: "AzureOpenAI",
provider: "azure-openai",
options: %{
resource_name: "your-resource-name",
deployment_id: "your-deployment-id",
api_version: "2024-02-15-preview"
}
}
]
}
```
Refer to the [BAML OpenAI Azure documentation](https://docs.boundaryml.com/ref/llm-client-providers/open-ai-from-azure) for more details.
## OpenAI Generic
```elixir
client_registry: %{
primary: "OpenAIGeneric",
clients: [
%{
name: "OpenAIGeneric",
provider: "openai-generic",
options: %{
base_url: "https://api.provider.com",
model: "o<provider-specified-format>"
}
}
]
}
```
Refer to the [BAML OpenAI Generic documentation](https://docs.boundaryml.com/ref/llm-client-providers/openai-generic) for more details.
## OpenRouter
```bash
export OPENROUTER_API_KEY="..."
```
```elixir
client_registry: %{
primary: "OpenRouter",
clients: [
%{
name: "OpenRouter",
provider: "openrouter",
options: %{
model: "openai/gpt-4o-mini"
}
}
]
}
```
Refer to the [BAML OpenRouter documentation](https://docs.boundaryml.com/ref/llm-client-providers/openrouter) for more details.
## Advanced Patterns
### Retry Policy
Handle transient failures with exponential backoff. Beamlens includes a `DefaultRetry` policy (3 retries, exponential backoff starting at 200ms):
```elixir
client_registry: %{
primary: "Anthropic",
clients: [
%{
name: "Anthropic",
provider: "anthropic",
options: %{model: "claude-haiku-4-5-20251001"},
retry_policy: "DefaultRetry"
}
]
}
```
The `DefaultRetry` policy uses:
- 3 retries after initial failure
- Exponential backoff starting at 200ms
- 1.5x multiplier per retry
- Maximum delay of 10 seconds
### Fallback Chains
Switch providers when your primary fails:
```elixir
client_registry: %{
primary: "PrimaryWithFallback",
clients: [
%{
name: "Primary",
provider: "anthropic",
options: %{model: "claude-haiku-4-5-20251001"}
},
%{
name: "Backup",
provider: "openai",
options: %{model: "gpt-4o-mini"}
},
%{
name: "PrimaryWithFallback",
provider: "fallback",
options: %{strategy: ["Primary", "Backup"]}
}
]
}
```
### Round-Robin
Distribute load across multiple providers or API keys:
```elixir
client_registry: %{
primary: "RoundRobinClient",
clients: [
%{
name: "Client1",
provider: "anthropic",
options: %{model: "claude-haiku-4-5-20251001"}
},
%{
name: "Client2",
provider: "anthropic",
options: %{model: "claude-haiku-4-5-20251001"}
},
%{
name: "RoundRobinClient",
provider: "round-robin",
options: %{strategy: ["Client1", "Client2"]}
}
]
}
```
Each request cycles through the clients in order. Useful for spreading rate limits across multiple API keys.
## More Providers
Beamlens uses [BAML](https://docs.boundaryml.com/docs/snippets/clients/overview) for LLM integration. Any provider BAML supports works with Beamlens:
- Together AI
- Groq
- Vercel AI Gateway
- And more
See the [BAML provider documentation](https://docs.boundaryml.com/docs/snippets/clients/overview) for the full list and configuration options.
