Skip to content

Introduce CI redundancy groups#38160

Open
AndriySvyryd wants to merge 2 commits intomainfrom
CIGroups
Open

Introduce CI redundancy groups#38160
AndriySvyryd wants to merge 2 commits intomainfrom
CIGroups

Conversation

@AndriySvyryd
Copy link
Copy Markdown
Member

@AndriySvyryd AndriySvyryd commented Apr 23, 2026

  • Added continueOnError: true to all major jobs in both azure-pipelines-internal-tests.yml and azure-pipelines-public.yml, allowing the pipeline to continue running even if individual jobs fail.
  • Introduced a new Validate_Job_Results job in both pipeline files that runs after all test jobs, collecting the results for each group and failing the pipeline only if all jobs in a group fail.
  • Added more Helix queues
    • Windows.11.Amd64.Client - only SQL Server tests
    • Windows.Server2025.Amd64 - only Cosmos tests on the emulator
    • Windows.11.Arm64 - All other tests
  • The job groups are defined as follows:
    • Windows: {Windows, Helix_Windows}
    • Linux: {Linux, Helix_Ubuntu}
    • macOS: {macOS, macOS x64}
    • Arm64: {Helix Windows Arm64, Helix macOS ARM64}
    • SQL Server: {Windows SqlServer, Helix Windows SqlServer, Helix Ubuntu SqlServer}
    • Cosmos : {Linux_Cosmos, Helix Windows Cosmos, Helix Ubuntu Cosmos}

Copilot AI review requested due to automatic review settings April 23, 2026 23:16
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds “redundancy groups” to the Azure Pipelines CI so the overall pipeline fails only when all jobs within a platform group (Windows/macOS/Linux/Cosmos) fail.

Changes:

  • Set continueOnError: true on major jobs so individual job failures don’t immediately fail the stage.
  • Add a Validate_Job_Groups job to aggregate job results by platform group and fail the pipeline only when an entire group fails.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.

File Description
azure-pipelines-public.yml Marks major jobs continueOnError and adds Validate_Job_Groups to evaluate grouped outcomes.
azure-pipelines-internal-tests.yml Same grouping approach as public, including additional Cosmos coverage via Linux_Cosmos.

Comment thread azure-pipelines-internal-tests.yml Outdated
Comment thread azure-pipelines-public.yml Outdated
Comment thread azure-pipelines-internal-tests.yml Outdated
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated 6 comments.

Comment thread azure-pipelines-public.yml Outdated
Comment thread azure-pipelines-public.yml Outdated
Comment thread azure-pipelines-public.yml Outdated
Comment thread azure-pipelines-internal-tests.yml Outdated
Comment thread azure-pipelines-internal-tests.yml Outdated
Comment thread azure-pipelines-internal-tests.yml Outdated
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.

Comment thread azure-pipelines-internal-tests.yml
Comment thread azure-pipelines-public.yml
Comment thread azure-pipelines-internal-tests.yml
Comment thread azure-pipelines-public.yml
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

Comment thread azure-pipelines-public.yml
Comment thread azure-pipelines-public.yml
Comment thread azure-pipelines-internal-tests.yml
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

Comment thread azure-pipelines-internal-tests.yml Outdated
Comment thread eng/testing/WaitCosmosEmulator.cmd
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

Comment thread eng/testing/WaitCosmosEmulator.cmd
Comment thread eng/helix.proj Outdated
Comment thread azure-pipelines-public.yml Outdated
Copilot AI review requested due to automatic review settings April 27, 2026 21:43
@AndriySvyryd AndriySvyryd requested a review from a team as a code owner April 27, 2026 21:43
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated 3 comments.

Comment thread test/EFCore.SqlServer.FunctionalTests/DbContextPoolingTest.cs Outdated
Comment thread test/EFCore.SqlServer.FunctionalTests/DbContextPoolingTest.cs Outdated
Comment thread test/EFCore.Cosmos.FunctionalTests/TestUtilities/CosmosTestStore.cs Outdated
@AndriySvyryd AndriySvyryd enabled auto-merge (squash) April 27, 2026 23:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants