Amazon Bedrock

Run foundation models on AWS with BedrockModel — Claude, Nova, Llama, Mistral, and more. Best when you need AWS-native deployment, IAM-based auth, and enterprise compliance.

For standalone invoke / stream usage, see LLM Models — Amazon Bedrock.

Install

pip install --extra-index-url https://core-packages.elsai.ai/root/elsai-model/ elsai-model==2.0.0

Setup

1. Enable model access in the Amazon Bedrock console.
2. Configure AWS credentials (environment variables, aws configure, or an IAM role).
3. Export your chosen model ID:

export AWS_ACCESS_KEY_ID=...
export AWS_SECRET_ACCESS_KEY=...
export AWS_REGION=us-east-1
export BEDROCK_MODEL_ID=us.anthropic.claude-3-5-sonnet-20241022-v2:0

4. Install elsai-agents:

pip install --extra-index-url https://elsai-agents.elsai.ai/root/ elsai-agents==0.3.0

Agent — basic

import os
from elsai import Agent
from elsai_model.bedrock import BedrockModel

model = BedrockModel(
    model_id=os.getenv("BEDROCK_MODEL_ID", "us.anthropic.claude-3-5-sonnet-20241022-v2:0"),
    region_name=os.getenv("AWS_REGION", "us-east-1"),
    max_tokens=256,
    temperature=0.2,
)
agent = Agent(
    model=model,
    system_prompt="You are a concise assistant.",
)
result = agent("What is 17 + 28? Reply with just the number.")
print(result.message["content"][0]["text"])

Popular model IDs

Model	Model ID
Claude 3.5 Sonnet v2	anthropic.claude-3-5-sonnet-20241022-v2:0
Amazon Nova Pro	us.amazon.nova-pro-v1:0
Amazon Nova Lite	us.amazon.nova-lite-v1:0
Llama 3.1 70B	us.meta.llama3-1-70b-instruct-v1:0