Skip to content

Move azure-ai-evaluation breaking change note to 1.16.8 (Unreleased)#46998

Draft
Copilot wants to merge 4 commits into
mainfrom
copilot/update-changelog-to-1168
Draft

Move azure-ai-evaluation breaking change note to 1.16.8 (Unreleased)#46998
Copilot wants to merge 4 commits into
mainfrom
copilot/update-changelog-to-1168

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented May 19, 2026

azure-ai-evaluation 1.16.7 was already released (2026-05-07), but a new breaking-change entry was added under ## 1.16.7 (Unreleased). This PR rehomes that entry under a new unreleased version section so release history remains chronologically and semantically correct.

  • Changelog version correction

    • Added ## 1.16.8 (Unreleased) at the top of sdk/evaluation/azure-ai-evaluation/CHANGELOG.md.
    • Added standard subsection scaffold under 1.16.8:
      • ### Features Added
      • ### Breaking Changes
      • ### Bugs Fixed
      • ### Other Changes
  • Breaking change relocation

    • Moved (not duplicated) the EVALUATOR_NAME_METRICS_MAPPINGS breaking-change bullet from 1.16.7 to 1.16.8 under ### Breaking Changes.
    • Left 1.16.7 section content otherwise unchanged.
## 1.16.8 (Unreleased)

### Breaking Changes
- Updated `EVALUATOR_NAME_METRICS_MAPPINGS` so `document_retrieval` and `rouge_score` report single primary metrics (`document_retrieval`, `rouge`), with previous sub-metrics now represented in each evaluator's `*_properties` payload.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • centralus-2.in.applicationinsights.azure.com
    • Triggering command: /home/REDACTED/bin/azsdk /home/REDACTED/bin/azsdk ingest-telemetry --client-type copilot-cli --event-type skill_invocation --session-id 1c747b61-294e-4cb8-8272-f1dbdf4600b8 --skill-name find-package-skill (dns block)
  • scanning-api.github.com
    • Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node /home/REDACTED/work/_temp/ghcca-node/node/bin/node --enable-source-maps /home/REDACTED/work/_temp/copilot-developer-action-main/dist/index.js (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

Original prompt

Background

In PR #46436 ("Standardize Output Schema for Evaluators"), a Breaking Changes entry was added to sdk/evaluation/azure-ai-evaluation/CHANGELOG.md under the ## 1.16.7 (Unreleased) section:

- Updated `EVALUATOR_NAME_METRICS_MAPPINGS` so `document_retrieval` and `rouge_score` report single primary metrics (`document_retrieval`, `rouge`), with previous sub-metrics now represented in each evaluator's `*_properties` payload.

However, SDK version 1.16.7 was already released on 2026-05-07, so this entry must not appear under 1.16.7. It needs to be placed under a new ## 1.16.8 (Unreleased) section instead.

Task

Update sdk/evaluation/azure-ai-evaluation/CHANGELOG.md so that:

  1. A new ## 1.16.8 (Unreleased) section is added at the top of the file (immediately above the existing ## 1.16.7 (Unreleased) heading).

  2. The new 1.16.8 section contains the standard subsections (### Features Added, ### Breaking Changes, ### Bugs Fixed, ### Other Changes) following the convention used elsewhere in the file.

  3. The breaking change bullet currently under 1.16.7:

    - Updated `EVALUATOR_NAME_METRICS_MAPPINGS` so `document_retrieval` and `rouge_score` report single primary metrics (`document_retrieval`, `rouge`), with previous sub-metrics now represented in each evaluator's `*_properties` payload.
    

    must be moved (not copied) from the 1.16.7 ### Breaking Changes section into the 1.16.8 ### Breaking Changes section.

  4. The now-empty ### Breaking Changes subsection under 1.16.7 should remain as an empty heading (consistent with other unreleased/released sections in this file that have empty subsections), OR be removed if no other entries follow that pattern in this file — match the style of the surrounding entries.

  5. Do not modify any other content in the CHANGELOG. All other entries (Features Added, Bugs Fixed, Other Changes under 1.16.7, as well as all prior version sections) must remain unchanged.

Acceptance Criteria

  • The diff is limited to sdk/evaluation/azure-ai-evaluation/CHANGELOG.md.
  • The EVALUATOR_NAME_METRICS_MAPPINGS entry appears exactly once in the file, under ## 1.16.8 (Unreleased)### Breaking Changes.
  • The 1.16.7 section no longer contains that entry.
  • No other text in the file is changed.

Reference

The following is the prior conversation context from the user's chat exploration (may be truncated):

User: The change log needed to be under version 1.16.8 instead version 1.16.7. SDK version 1.16.7 was already released on 5/7

Create a PR to fix it

Assistant: I'll create a PR to fix this by moving the changelog entry from 1.16.7 to a new 1.16.8 section.

Assistant: I'm waiting for your response to the confirmation dialog before I can dispatch the coding agent to create the PR that moves the CHANGELOG entry from 1.16.7 to a new 1.16.8 (Unreleased) section.

This pull request was created from Copilot chat.

Copilot AI changed the title [WIP] Update changelog for SDK version 1.16.8 Move azure-ai-evaluation breaking change note to 1.16.8 (Unreleased) May 19, 2026
Copilot AI requested a review from m7md7sien May 19, 2026 20:12
Updated version number and release date for 1.16.7. Added 'extra_headers' argument to RaiServiceEvaluatorBase for custom HTTP headers.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants