[devops] Run macOS tests on macOS Golden Gate.

[rolfbjarne]

No description provided.

[Copilot]

Pull request overview

This PR updates the Azure DevOps macOS test matrix to add a new macOS Golden Gate (27) arm64 test stage, and updates the devops documentation to reflect the new stage lineup.

Changes:

• Add a new mac_27_arm64 macOS test stage targeting macOS Golden Gate (27) in the tests-stage template.
• Add a corresponding macOS Golden Gate (27) entry to the testConfigurations matrix in configure.yml.
• Update tools/devops/README.md to document the updated macOS stage list (including mac_27_arm64).

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File	Description
tools/devops/README.md	Updates the documented macOS test stages to include mac_27_arm64.
tools/devops/automation/templates/tests-stage.yml	Adds a new macOS Golden Gate (27) arm64 test stage configuration.
tools/devops/automation/templates/common/configure.yml	Adds a new test configuration entry for macOS Golden Gate (27) to the test matrix.

[dalexsoto]

🌉 ✅

[vs-mobiletools-engineering-service2]

🔥 [PR Build #f96c504] Build failed (Build macOS tests) 🔥

Build failed for the job 'Build macOS tests' (with job status 'Failed')

Pipeline on Agent
Hash: f96c5049a0a517459ee3b988da994f2faaa60932 [PR build]

[vs-mobiletools-engineering-service2]

🔥 [CI Build #f96c504] Build failed (Build packages) 🔥

Build failed for the job 'Build packages' (with job status 'Failed')

Pipeline on Agent
Hash: f96c5049a0a517459ee3b988da994f2faaa60932 [PR build]

[vs-mobiletools-engineering-service2]

🔥 [CI Build #f96c504] Build failed (Detect API changes) 🔥

Build failed for the job 'Detect API changes' (with job status 'Failed')

Pipeline on Agent
Hash: f96c5049a0a517459ee3b988da994f2faaa60932 [PR build]

[vs-mobiletools-engineering-service2]

🔥 Unable to find the contents for the comment: D:\a\1\s\change-detection\results\gh-comment.md does not exist :fire

Pipeline on Agent
Hash: f96c5049a0a517459ee3b988da994f2faaa60932 [PR build]

[vs-mobiletools-engineering-service2]

🔥 [CI Build #f96c504] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

4 tests crashed, 10 tests failed, 183 tests passed.

Failures

❌ assembly-processing tests

1 tests failed, 0 tests passed.

Failed tests

• Assembly processing tests: Failed (Execution failed with exit code 1)
  • AssemblyPreparerTests.InlineDlfcnMethodsStepTests.MarkedTest(iOS...: System.IO.DirectoryNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/...
  • AssemblyPreparerTests.InlineDlfcnMethodsStepTests.MarkedTest(Mac...: System.IO.DirectoryNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/...
  • AssemblyPreparerTests.InlineDlfcnMethodsStepTests.MarkedTest(Mac...: System.IO.DirectoryNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/...
  • ... and 42 more

Html Report (VSDrops) Download

❌ cecil tests

1 tests failed, 0 tests passed.

Failed tests

• Cecil-based tests: Failed (Execution failed with exit code 1)
  • Cecil.Tests.ApiAvailabilityTest.AttributeConsistency(): System.Reflection.TargetInvocationException : Exception has been thrown by the target of an invocation.
    ----> NUnit.Framework....
  • Cecil.Tests.ApiAvailabilityTest.FindMissingObsoleteAttributes: Assembly existence
    Assert.That(assembly, Does.Exist)
    Expected: file or directory exists
    But was: "/Users/builder/azdo/_wo...
  • Cecil.Tests.ApiCapitalizationTest.EventsCapitalizationTest(): System.Reflection.TargetInvocationException : Exception has been thrown by the target of an invocation.
    ----> NUnit.Framework....
  • ... and 46 more

Html Report (VSDrops) Download

❌ fsharp tests

2 tests failed, 2 tests passed.

Failed tests

• fsharp/iOS - simulator/Debug: LaunchTimedOut
• fsharp/tvOS - simulator/Debug: LaunchTimedOut

Html Report (VSDrops) Download

❌ generator tests

3 tests failed, 2 tests passed.

Failed tests

• BGen tests: Failed (Execution failed with exit code 1)
  • GeneratorTests.BGen.ResponseFile(iOS): BGen failed with exit code 1: response file
    /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.400-preview.0....
  • GeneratorTests.BGenTests.AbstractTypeTest: BGen failed with exit code 1: build
    /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.400-preview.0.26316.10...
  • GeneratorTests.BGenTests.ArrayFromHandleBug: BGen failed with exit code 1: build
    /Users/builder/azdo/_work/1/s/macios/builds/downloads/dotnet-sdk-10.0.400-preview.0.26316.10...
  • ... and 160 more
• Roslyn Generator tests: Failed (Execution failed with exit code 1)
  • Microsoft.Macios.Generator.Tests.Attributes.ProtocolMemberDataTe...: System.IO.FileNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/dotne...
  • Microsoft.Macios.Generator.Tests.Attributes.ProtocolMemberDataTe...: System.IO.FileNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/dotne...
  • Microsoft.Macios.Generator.Tests.Attributes.ProtocolMemberDataTe...: System.IO.FileNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/dotne...
  • ... and 4081 more
• Roslyn Analyzer tests: Failed (Execution failed with exit code 1)
  • Microsoft.Macios.Bindings.Analyzer.Tests.BindingTypeSemanticAnal...: System.IO.FileNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/dotne...
  • Microsoft.Macios.Bindings.Analyzer.Tests.BindingTypeSemanticAnal...: System.IO.FileNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/dotne...
  • Microsoft.Macios.Bindings.Analyzer.Tests.BindingTypeSemanticAnal...: System.IO.FileNotFoundException : Could not find a part of the path '/Users/builder/azdo/_work/1/s/macios/builds/downloads/dotne...
  • ... and 317 more

Html Report (VSDrops) Download

❌ linker tests (tvOS)

1 tests failed, 14 tests passed.

Failed tests

• dont link/tvOS - simulator/Release: BuildFailure

Html Report (VSDrops) Download

❌ sharpie tests

1 tests failed, 0 tests passed.

Failed tests

• Sharpie tests: Failed (Execution failed with exit code 1)

  • Sharpie.Bind.Tests.OnDiskTests.ParseNoRunTest("Category.h",""): Expected success
    Assert.That(bindings.ExitCode, Is.EqualTo (0))
    Expected: 0
    But was: 1

  • Sharpie.Bind.Tests.OnDiskTests.ParseNoRunTest("CFRelatedType.h",...: Expected success
    Assert.That(bindings.ExitCode, Is.EqualTo (0))
    Expected: 0
    But was: 1

  • Sharpie.Bind.Tests.OnDiskTests.ParseNoRunTest("CodeAuditedAttrib...: Expected success
    Assert.That(bindings.ExitCode, Is.EqualTo (0))
    Expected: 0
    But was: 1

  • ... and 108 more

Html Report (VSDrops) Download

❌ xtro tests

1 tests failed, 0 tests passed.

Failed tests

• Xtro: Failed (Execution failed with exit code 1)
  • Xamarin.Tests.Xtro.RunTest: ExitCode
    Assert.That(rv, Is.EqualTo (0))
    Expected: 0
    But was: 2

Html Report (VSDrops) Download

❌ Tests on macOS Sonoma (14) tests

🔥 Failed catastrophically on VSTS: test results - mac_sonoma (no summary found).

Html Report (VSDrops) Download

❌ Tests on macOS Sequoia (15) tests

🔥 Failed catastrophically on VSTS: test results - mac_sequoia (no summary found).

Html Report (VSDrops) Download

❌ Tests on macOS Tahoe (26) tests

🔥 Failed catastrophically on VSTS: test results - mac_tahoe (no summary found).

Html Report (VSDrops) Download

❌ Tests on macOS Golden Gate (27) tests

🔥 Failed catastrophically on VSTS: test results - mac_golden_gate (no summary found).

Html Report (VSDrops) Download

Successes

✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 8 tests passed. Html Report (VSDrops) Download
✅ linker (iOS): All 15 tests passed. Html Report (VSDrops) Download
✅ linker (MacCatalyst): All 15 tests passed. Html Report (VSDrops) Download
✅ linker (macOS): All 21 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 19 tests passed. Html Report (VSDrops) Download
✅ monotouch (MacCatalyst): All 24 tests passed. Html Report (VSDrops) Download
✅ monotouch (macOS): All 24 tests passed. Html Report (VSDrops) Download
✅ monotouch (tvOS): All 19 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ windows: All 3 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download

macOS tests

Linux Build Verification

✅ Linux build succeeded

Pipeline on Agent
Hash: f96c5049a0a517459ee3b988da994f2faaa60932 [PR build]

[rolfbjarne]

Clsoing in favor of #25784 (using the correctly named source branch).