LlamaAPIModel

Hosted Meta Llama models. Requires the llamaapi extra:

pip install --extra-index-url https://core-packages.elsai.ai/root/ "elsai-model[llama-api]==2.1.0"

Environment variables: LLAMA_API_KEY, LLAMA_API_MODEL_ID

import os
from elsai_model.llamaapi import LlamaAPIModel

model = LlamaAPIModel(
    model_id=os.environ["LLAMA_API_MODEL_ID"],
    client_args={"api_key": os.environ["LLAMA_API_KEY"]},
    temperature=0.2,
)
messages = [{"role": "user", "content": "Say hello in one short sentence."}]

response = model.invoke(messages)
print(response.choices[0].message.content)

for chunk in model.stream_text(messages):
    print(chunk, end="", flush=True)

Or via the factory (top-level generation kwargs, not params):

from elsai_model import LLM, Provider

model = LLM(
    provider=Provider.LLAMA_API,
    model=os.environ["LLAMA_API_MODEL_ID"],
    api_key=os.environ["LLAMA_API_KEY"],
    temperature=0.2,
)

---

See also

• LLM Models overview — install, extras, factory
• LLM factory