Skip to content

Model Providers

elsai Agents supports a wide range of LLM providers through elsai-model v2.0.0 *Model classes from elsai Core.

For standalone invoke / stream usage (without agents), see LLM Models in elsai Core.

Install

bash
pip install --extra-index-url https://elsai-agents.elsai.ai/root/ elsai-agents==0.3.0
pip install --extra-index-url https://core-packages.elsai.ai/root/elsai-model/ elsai-model==2.0.0

Some providers need optional extras on elsai-model — see LLM Models — Optional package extras.

Supported providers

ProviderModel classDocs
Amazon BedrockBedrockModelBedrock
Anthropic (direct)AnthropicModelAnthropic
Anthropic via Bedrock SDKAnthropicBedrockModelAnthropic
OpenAIOpenAIModelOpenAI
Google GeminiGeminiModelGemini
LiteLLMLiteLLMModelLiteLLM
Ollama (local)OllamaModelOllama
MistralMistralModelMistral
WriterWriterModelWriter
Meta Llama APILlamaAPIModelLlama API
llama.cpp (local)LlamaCppModelllama.cpp
Amazon SageMakerSageMakerAIModelSageMaker

Quick switch

python
import os
from elsai import Agent
from elsai_model.openai import OpenAIModel
from elsai_model.gemini import GeminiModel
from elsai_model.bedrock import BedrockModel
from elsai_model.ollama import OllamaModel

# OpenAI
agent = Agent(model=OpenAIModel(model_id="gpt-4o", client_args={"api_key": "..."}))

# Gemini
agent = Agent(model=GeminiModel(model_id="gemini-2.5-flash", client_args={"api_key": "..."}))

# Amazon Bedrock
agent = Agent(model=BedrockModel(model_id="us.anthropic.claude-3-5-sonnet-20241022-v2:0", region_name="us-east-1"))

# Ollama (local)
agent = Agent(model=OllamaModel(model_id="llama3.2"))

Common parameters

ParameterDescription
model_idProvider model or deployment ID
client_argsSDK client options (API keys, endpoints)
paramsGeneration settings (temperature, max_tokens, …)

Copyright © 2026 elsai foundry.