Skip to content

Release Notes ​

0.1.0 ​

Initial release of elsai-llm-gateway.

  • LLMGateway server and in-process Gateway SDK on top of the LiteLLM proxy (litellm[proxy] 1.104.x).
  • policy.yaml with default, domain, team and key policies, named policies and attachments. The most restrictive scope wins.
  • Daily and monthly budgets with block or downgrade actions, alert thresholds and webhook alerts, plus per-user budgets.
  • Auto routing by task type, domain, images, tools, prompt size and automatic complexity, and cost-based routing (strategy: cheapest).
  • Nine guardrail templates switched on from policy.yaml.
  • Namespaced response caching with policy-controlled TTLs.
  • Admin API under /admin/v1 with audit trail.
  • Deny-by-default edge, AWS Secrets Manager loading and ${NAME} substitution in config.yaml.

Copyright © 2026 elsai foundry.