Appearance
WriterModel
Environment variables: WRITER_API_KEY, WRITER_MODEL_NAME
python
import os
from elsai_model.writer import WriterModel
model = WriterModel(
client_args={"api_key": os.environ["WRITER_API_KEY"]},
model_id=os.getenv("WRITER_MODEL_NAME", "palmyra-x4"),
temperature=0.2,
)
messages = [{"role": "user", "content": "Say hello in one short sentence."}]
response = model.invoke(messages)
print(response.choices[0].message.content)
for chunk in model.stream_text(messages):
print(chunk, end="", flush=True)Or via the factory (top-level generation kwargs, not params):
python
from elsai_model import LLM, Provider
model = LLM(
provider=Provider.WRITER,
model=os.getenv("WRITER_MODEL_NAME", "palmyra-x4"),
api_key=os.environ["WRITER_API_KEY"],
temperature=0.2,
)See also
- LLM Models overview — install, extras, factory
- LLM factory