Appearance
AnthropicModel
Environment variables: ANTHROPIC_API_KEY, ANTHROPIC_MODEL_NAME
python
import os
from elsai_model.anthropic import AnthropicModel
model = AnthropicModel(
model_id=os.getenv("ANTHROPIC_MODEL_NAME", "claude-3-5-sonnet-latest"),
max_tokens=256,
client_args={"api_key": os.environ["ANTHROPIC_API_KEY"]},
params={"temperature": 0.2},
)
messages = [{"role": "user", "content": "Say hello in one short sentence."}]
response = model.invoke(messages)
print(response["content"][0]["text"])
for chunk in model.stream_text(messages):
print(chunk, end="", flush=True)Or via the factory (max_tokens required):
python
from elsai_model import LLM, Provider
model = LLM(
provider=Provider.ANTHROPIC,
model=os.getenv("ANTHROPIC_MODEL_NAME", "claude-3-5-sonnet-latest"),
api_key=os.environ["ANTHROPIC_API_KEY"],
max_tokens=1024,
params={"temperature": 0.2},
)See also
- LLM Models overview — install, extras, factory
- LLM factory