Appearance
Release Notes
0.1.0
Initial release of elsai-llm-gateway.
LLMGatewayserver and in-processGatewaySDK on top of the LiteLLM proxy (litellm[proxy]1.104.x).policy.yamlwith default, domain, team and key policies, named policies and attachments. The most restrictive scope wins.- Daily and monthly budgets with block or downgrade actions, alert thresholds and webhook alerts, plus per-user budgets.
- Auto routing by task type, domain, images, tools, prompt size and automatic complexity, and cost-based routing (
strategy: cheapest). - Nine guardrail templates switched on from
policy.yaml. - Namespaced response caching with policy-controlled TTLs.
- Admin API under
/admin/v1with audit trail. - Deny-by-default edge, AWS Secrets Manager loading and
${NAME}substitution inconfig.yaml.