diff --git a/changelog/enterprise.mdx b/changelog/enterprise.mdx index bde9587d..0b32e468 100644 --- a/changelog/enterprise.mdx +++ b/changelog/enterprise.mdx @@ -1,6 +1,6 @@ --- title: "Enterprise Gateway" -sidebarTitle: "Enterprise Gateway [2.18.0]" +sidebarTitle: "Enterprise Gateway [2.19.0]" rss: true --- @@ -8,6 +8,77 @@ rss: true Discuss how Portkey's AI Gateway can enhance your organization's AI infrastructure + + +## v2.19.0 + +--- + +### Deepgram Provider + +New Deepgram provider integration supporting speech-to-text (transcription) and text-to-speech endpoints through the gateway's unified API, with full support for retries, fallbacks, load balancing, caching, logging, and pricing. + +[Deepgram Documentation](/integrations/llms/deepgram) + +### Headroom Guardrail + +New Headroom partner guardrail plugin for request and response scanning, configurable through the standard guardrails workflow. + +[Guardrails Documentation](/product/guardrails) + +### Qwen (DashScope) Responses & Messages API + +Qwen models via DashScope now support the Responses API and Messages API endpoints, along with pass-through of non-OpenAI parameters (`extra_body`) for Qwen-specific features. + +[DashScope Documentation](/integrations/llms/dashscope) + +### Vertex AI OCR Support + +The `POST /v1/ocr` endpoint now supports Vertex AI models, bringing OCR under the gateway's full middleware stack for Google Cloud-hosted models. + +[OCR API Reference](/api-reference/inference-api/ocr) ยท [Vertex AI Documentation](/integrations/llms/vertex-ai) + +### MCP Server Registry + +New `/v0.1/servers` endpoint exposes a registry of available MCP servers, enabling client-side discovery of configured servers and their capabilities. + +[MCP Registry Documentation](/product/mcp-gateway/mcp-registry) + +### Span-Level Feedback + +Feedback can now target individual spans within a trace, enabling more granular quality signals at the sub-request level. + +[Feedback Documentation](/product/observability/feedback) + +### Provider Updates + +- **OpenRouter**: Pricing now uses provider-reported cost when available, falling back to configured pricing tables +- **Qwen (DashScope)**: Responses API and Messages API support with non-OpenAI parameter pass-through +- **Bedrock (Mantle)**: Fixed Anthropic SSE streaming boundary handling for reliable chunk delivery +- **Bedrock**: `temperature` is stripped from `inferenceConfig` for Claude 4-series models that deprecate it +- **Azure AI Foundry**: Additional OpenCode compatibility fixes for Responses API routing +- **Vertex AI**: Fixed `output_config` forwarding for Anthropic Messages requests +- **Vertex AI**: Thinking token attribution corrected for proxy requests +- **Anthropic**: Updated beta parameter blocklist + +[Providers Documentation](/integrations/llms) + +### Fixes and Improvements + +- **MCP Gateway**: OAuth issuer URL now follows RFC 8414 format +- **MCP Gateway**: Extra authorization parameters can be passed to upstream OAuth providers +- **Streaming Logs**: `output_token_details` now included in reassembled streaming log entries +- **Pricing**: Integration-level `pricing_adjustments` applied correctly on the config path +- **Pricing**: Bedrock inference-profile prefix preserved for accurate cost attribution +- **Pricing**: Meshy and Tripo3D async API pricing tracked +- **Security**: `x-amz-security-token` masked in log paths +- **Messages API**: Unique `tool_use` IDs generated instead of reusing provider-issued IDs, fixing deduplication issues +- **Messages/Responses**: Instructions parameter handling corrected +- **Forwarding**: `chat_complete_kwargs` forwarded to providers that support it +- Updated dependencies to patch security vulnerabilities. + + + ## v2.18.0