Skip to content

feat: model aliases - #21

Merged
cmdoret merged 2 commits into
mainfrom
feat/virtual-model-names
Oct 22, 2026
Merged

cmdoret merged 2 commits into
mainfrom
feat/virtual-model-names

Conversation

@cmdoret

@cmdoret cmdoret commented Oct 22, 2026

Copy link
Copy Markdown
Member

Context

We want to support stable model ids like sdsc-large to let users keep their client config as we update the underlying models.

Summary

Adds modelAliases in values, a map of stable model names to entries in models, routed using envoy AI gateway's modelNameOverride. Aliases also work for external (apiUrl) models.

Notes

  • Requires Envoy AI Gateway ≥ v0.3.0, the first release with modelNameOverride.
  • An alias and its full name count against separate rate-limit buckets, because buckets are keyed on the requested model name.
  • Telemetry records the alias in gen_ai.request.model and the real model in gen_ai.response.model.

🤖 Generated with Claude Code

@Panaetius Panaetius left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks looks fine to me. I would have probably put the alias as a property on the model, but I like this solution much more where it's a top level config, that makes it easier to see 👍

@cmdoret
cmdoret merged commit 1597f8b into main Oct 22, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants