-
Notifications
You must be signed in to change notification settings - Fork 2.2k
[VoiceLive]Add Foundry Agent integration, filler responses, and reaso… #47772
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
…ning effort configuration
API Change CheckAPIView identified API level changes in this PR and created the following API reviews |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
Updates the VoiceLive Java SDK to align with the latest VoiceLive TypeSpec, adding Foundry Agent tool integration plus new request/response configuration features (filler responses, reasoning effort, metadata, and custom text normalization URL support).
Changes:
- Added new model types and discriminators for Foundry Agent tools, Foundry agent response items, and Foundry agent server-event lifecycle events.
- Added new configuration surfaces for
reasoning_effort,filler_response, andmetadata, plus custom text normalization URL support on Azure voice models. - Updated generated metadata/APIVIew mapping files, tests, and changelog; updated
tsp-location.yamlto the new spec commit.
Reviewed changes
Copilot reviewed 42 out of 42 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
| sdk/ai/azure-ai-voicelive/tsp-location.yaml | Bumps the source TypeSpec commit used for generation. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/VoiceLiveSessionOptionsNewFeaturesTest.java | Adds tests for new session options fields (reasoning effort, filler response). |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/ServerEventResponseFoundryAgentCallLifecycleTest.java | Adds tests covering Foundry agent call server event lifecycle models. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/ResponseFoundryAgentCallItemTest.java | Adds tests for Foundry agent response item model. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/ResponseCreateParamsNewFeaturesTest.java | Adds tests for reasoning effort and metadata support in request/response models. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/ReasoningEffortTest.java | Adds tests for the ReasoningEffort expandable enum. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/OutputAudioFormatTest.java | Adds tests for updated OutputAudioFormat string values. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/FoundryAgentToolTest.java | Adds tests for Foundry agent tool model and enums. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/FillerResponseConfigTest.java | Adds tests for filler response config models and enums. |
| sdk/ai/azure-ai-voicelive/src/test/java/com/azure/ai/voicelive/models/AzureVoiceCustomTextNormalizationTest.java | Adds tests for custom text normalization URL support on Azure voice models. |
| sdk/ai/azure-ai-voicelive/src/main/resources/META-INF/azure-ai-voicelive_metadata.json | Updates generated cross-language definitions and generated-file list for new models. |
| sdk/ai/azure-ai-voicelive/src/main/resources/META-INF/azure-ai-voicelive_apiview_properties.json | Updates APIView mapping entries for newly added models. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/VoiceLiveToolDefinition.java | Adds discriminator handling for foundry_agent tool type. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/VoiceLiveSessionResponse.java | Adds reasoning_effort and filler_response fields with JSON (de)serialization and accessors. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/VoiceLiveSessionOptions.java | Adds reasoning_effort and filler_response fields with JSON (de)serialization and accessors. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ToolType.java | Adds FOUNDRY_AGENT discriminator value. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/SessionUpdate.java | Adds discriminator handling for Foundry agent call server events. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/SessionResponseItem.java | Adds discriminator handling for foundry_agent_call response items. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/SessionResponse.java | Adds metadata field (de)serialization and getter. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ServerEventType.java | Adds new ServerEventType values for Foundry agent call lifecycle events. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ServerEventResponseFoundryAgentCallInProgress.java | New model for Foundry agent “in progress” event. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ServerEventResponseFoundryAgentCallFailed.java | New model for Foundry agent “failed” event. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ServerEventResponseFoundryAgentCallCompleted.java | New model for Foundry agent “completed” event. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ServerEventResponseFoundryAgentCallArgumentsDone.java | New model for Foundry agent “arguments done” event. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ServerEventResponseFoundryAgentCallArgumentsDelta.java | New model for Foundry agent “arguments delta” event. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ResponseFoundryAgentCallItem.java | New response-item model representing a Foundry agent call. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ResponseCreateParams.java | Adds reasoning_effort + metadata fields with JSON (de)serialization and accessors. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ReasoningEffort.java | New expandable enum for reasoning-effort configuration. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/OutputAudioFormat.java | Fixes string values for PCM formats from dash-separated to underscore-separated. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/LlmFillerResponseConfig.java | New model for LLM-based filler response configuration. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/ItemType.java | Adds FOUNDRY_AGENT_CALL discriminator value. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/FoundryAgentTool.java | New tool-definition model for Foundry agent integration. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/FoundryAgentContextType.java | New expandable enum for Foundry agent context type configuration. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/FillerTrigger.java | New expandable enum for filler trigger conditions. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/FillerResponseConfigType.java | New expandable enum for filler config discriminator values. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/FillerResponseConfigBase.java | New base model for filler response configuration (polymorphic deserialization). |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/BasicFillerResponseConfig.java | New model for static/basic filler response configuration. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/AzureStandardVoice.java | Adds custom_text_normalization_url field and accessors. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/AzurePersonalVoice.java | Adds custom_text_normalization_url field and accessors. |
| sdk/ai/azure-ai-voicelive/src/main/java/com/azure/ai/voicelive/models/AzureCustomVoice.java | Adds custom_text_normalization_url field and accessors. |
| sdk/ai/azure-ai-voicelive/CHANGELOG.md | Documents the added features and the OutputAudioFormat value fix. |
| .vscode/cspell.json | Adds dictionary entries for new terms introduced by the feature set. |
…ning effort configuration
Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
All SDK Contribution checklist:
General Guidelines and Best Practices
Testing Guidelines