Skip to content

devops: add android bot to tests_secondary#40799

Merged
dgozman merged 6 commits into
microsoft:mainfrom
dgozman:devops-tests-android
May 13, 2026
Merged

devops: add android bot to tests_secondary#40799
dgozman merged 6 commits into
microsoft:mainfrom
dgozman:devops-tests-android

Conversation

@dgozman
Copy link
Copy Markdown
Collaborator

@dgozman dgozman commented May 12, 2026

No description provided.

@dgozman dgozman added the CQ1 label May 12, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Test results for "tests others"

18 flaky ⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-macos-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-macos-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-macos-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-macos-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-macos-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-macos-latest`
⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-windows-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-windows-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-windows-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-windows-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-windows-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-windows-latest`

19717 passed, 651 skipped


Merge workflow run.

@dgozman dgozman force-pushed the devops-tests-android branch from 7b03be6 to 0c84a1b Compare May 12, 2026 13:29
@dgozman dgozman added CQ1 and removed CQ1 labels May 12, 2026
- Redirect emulator stdout/stderr to emulator.log and dump on failure
- Wrap adb wait-for-device in timeout (default 600s) to fail fast
- Print KVM availability before starting the emulator
@dgozman dgozman added CQ1 and removed CQ1 labels May 12, 2026
Print env, avdmanager version, list avd, and probe candidate AVD
directories ($HOME/.android, $XDG_CONFIG_HOME/.android,
$ANDROID_USER_HOME) to identify where `avdmanager create` is writing
the .ini vs where `emulator -list-avds` searches.
@dgozman dgozman added CQ1 and removed CQ1 labels May 13, 2026
Newer cmdline-tools resolve the AVD storage path via ANDROID_USER_HOME,
which defaults to $XDG_CONFIG_HOME/.android when XDG_CONFIG_HOME is set
(as it is on Linux GHA runners: /home/runner/.config). The `emulator`
binary, however, only searches $ANDROID_AVD_HOME, $ANDROID_SDK_HOME/avd,
and $HOME/.android/avd — so the AVD created at
$XDG_CONFIG_HOME/.android/avd is invisible to `emulator @android35`.

Pin both ANDROID_USER_HOME and ANDROID_AVD_HOME to $HOME/.android(/avd)
in avd_recreate.sh and avd_start.sh. Matches macOS defaults and aligns
the two tools on Linux runners that set XDG_CONFIG_HOME.

Diagnostic prints are left in place for one more run to confirm.
@dgozman dgozman added CQ1 and removed CQ1 labels May 13, 2026
The Android playwright.config.ts was the only test config without
['blob'] in its CI reporter list, so the run-test action's
upload-blob-report step failed with:
  find: 'blob-report': No such file or directory

Match the convention used by tests/library, tests/bidi, tests/mcp, etc.
@dgozman dgozman added CQ1 and removed CQ1 labels May 13, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Test results for "tests 2"

2 failed
❌ [android-page] › page/page-route.spec.ts:1039 › should intercept when postData is more than 1MB
❌ [android-page] › page/page-screenshot.spec.ts:668 › page screenshot animations › should resume infinite animations

5 flaky ⚠️ [android-page] › page/page-autowaiting-no-hang.spec.ts:41 › assigning location to about:blank
⚠️ [android-page] › page/page-evaluate.spec.ts:169 › should work with large unicode strings
⚠️ [android-page] › page/page-request-continue.spec.ts:162 › should override method along with url
⚠️ [android-page] › page/page-request-fallback.spec.ts:123 › should amend HTTP headers
⚠️ [android-page] › page/page-route.spec.ts:317 › should not throw if request was cancelled by the page

2135 passed, 283 skipped


Merge workflow run.

Remove the avdmanager/find/ls diagnostic block from avd_recreate.sh,
the emulator.log capture and boot-timeout block from avd_start.sh, and
the "Check KVM availability" workflow step. ANDROID_USER_HOME and
ANDROID_AVD_HOME exports stay — they're the actual fix.
@dgozman dgozman force-pushed the devops-tests-android branch from cef1d4f to 5989487 Compare May 13, 2026 12:05
@github-actions
Copy link
Copy Markdown
Contributor

Test results for "tests 1"

4 flaky ⚠️ [chromium-library] › library/video.spec.ts:275 › screencast › should capture navigation `@ubuntu-22.04-chromium-tip-of-tree`
⚠️ [chromium-library] › library/video.spec.ts:682 › screencast › should capture full viewport on hidpi `@chromium-ubuntu-22.04-node20`
⚠️ [chromium-library] › library/video.spec.ts:719 › screencast › should work with video+trace `@chromium-ubuntu-22.04-node20`
⚠️ [firefox-page] › page/page-leaks.spec.ts:85 › click should not leak `@firefox-ubuntu-22.04-node20`

41763 passed, 850 skipped


Merge workflow run.

@github-actions
Copy link
Copy Markdown
Contributor

Test results for "MCP"

8 failed
❌ [firefox] › mcp/annotate.spec.ts:230 › should capture annotations via show --annotate @mcp-windows-latest-firefox
❌ [firefox] › mcp/annotate.spec.ts:251 › should start dashboard and annotate when no dashboard is running @mcp-windows-latest-firefox
❌ [firefox] › mcp/annotate.spec.ts:273 › should enter annotate mode on fresh dashboard.tsx mount with -s --annotate @mcp-windows-latest-firefox
❌ [firefox] › mcp/annotate.spec.ts:427 › should switch screencast to -s session on show --annotate @mcp-windows-latest-firefox
❌ [firefox] › mcp/annotate.spec.ts:476 › should disengage annotate mode when --annotate client disconnects @mcp-windows-latest-firefox
❌ [firefox] › mcp/cli-devtools.spec.ts:217 › video-start-stop @mcp-windows-latest-firefox
❌ [webkit] › mcp/annotate.spec.ts:251 › should start dashboard and annotate when no dashboard is running @mcp-windows-latest-webkit
❌ [webkit] › mcp/annotate.spec.ts:398 › should cancel browser_annotate when the MCP client disconnects @mcp-windows-latest-webkit

7062 passed, 1068 skipped


Merge workflow run.

@dgozman dgozman merged commit d2edf45 into microsoft:main May 13, 2026
43 of 45 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants