LiteLLMModel

Route to 100+ providers through a single interface. Browse supported model names at the LiteLLM model hub.

Environment variables: provider keys + LITELLM_MODEL

import os
from elsai_model.litellm import LiteLLMModel

model = LiteLLMModel(
    model_id=os.getenv("LITELLM_MODEL", "gpt-4o-mini"),
    client_args={"api_key": os.environ["OPENAI_API_KEY"]},
    params={"temperature": 0.2},
)
messages = [{"role": "user", "content": "Say hello in one short sentence."}]

response = model.invoke(messages)
print(response.choices[0].message.content)

for chunk in model.stream_text(messages):
    print(chunk, end="", flush=True)

Or via the factory:

from elsai_model import LLM, Provider

model = LLM(
    provider=Provider.LITELLM,
    model=os.getenv("LITELLM_MODEL", "gpt-4o-mini"),
    api_key=os.environ["OPENAI_API_KEY"],
    params={"temperature": 0.2},
)

---

See also

• LLM Models overview — install, extras, factory
• LLM factory