E2E: parallel workers

[phyllis-sy-wu]

Addressed #7268

WHY are these changes introduced?

E2E tests currently run sequentially with 1 worker, making the suite slow (~25 min on CI). With per-test store creation (PR #7279), each store-dependent test adds ~30s of overhead, compounding the problem.

WHAT is this pull request doing?

Enables parallel test execution in playwright.config.ts:

• fullyParallel: true — tests run concurrently across workers
• workers: 5 — 5 parallel Playwright workers
• globalTimeout: 20 * 60 * 1000 — reduced from 35 min to 20 min (parallel execution is much faster)
• GitHub Actions timeout-minutes reverted from 40 back to 20 (no longer needs the temporary bump from E2E: temporary time limit bump #7282)

This is safe because the store isolation PR (#7279) gives each worker its own dev store with unique ports per worker (SHOPIFY_FLAG_GRAPHIQL_PORT, SHOPIFY_FLAG_THEME_APP_EXTENSION_PORT), preventing EADDRINUSE conflicts. Tests use pnpm (not npm) for dependency installation, which is reliable under parallel load on CI runners.

CI result: Current test suite completes in ~10 min with 5 workers, down from ~27 min with 1 worker. The globalTimeout is set to 20 min to leave headroom as more tests will be added — will be re-evaluated once test coverage is finalized.

How to test your changes?

# Run full suite — should complete in ~5-10 min instead of ~25 min
pnpm --filter e2e exec playwright test

# Verify no port conflicts with headed mode
E2E_HEADED=1 DEBUG=1 pnpm --filter e2e exec playwright test

Checklist

• I've considered possible cross-platform impacts (Mac, Linux, Windows)
• I've considered possible documentation changes
• I've considered analytics changes to measure impact
• The change is user-facing, so I've added a changelog entry with pnpm changeset add

[phyllis-sy-wu]

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

• Trial branch for more workers #7343
• E2E: parallel workers #7309 👈 (View in Graphite)
• E2E: per-test store isolation with automatic teardown #7279
• E2E: temporary time limit bump #7282
• E2E: improve error context in assertions #7281
• E2E: one-time global auth before test start #7272
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[gonzaloriestra]

The improvement is great, but it’s still 2x slower than the others...

Have you tried with more workers? Or maybe with shards as we do for Unit tests on Windows?

[github-actions]

Differences in type declarations

We detected differences in the type declarations generated by Typescript for this branch compared to the baseline ('main' branch). Please, review them to ensure they are backward-compatible. Here are some important things to keep in mind:

• Some seemingly private modules might be re-exported through public modules.
• If the branch is behind main you might see odd diffs, rebase main into this branch.

New type declarations

We found no new type declarations in this PR

Existing type declarations

packages/cli-kit/dist/public/node/upgrade.d.ts

@@ -1,5 +1,3 @@
-import { getAutoUpgradeEnabled, setAutoUpgradeEnabled } from '../../private/node/conf-store.js';
-export { getAutoUpgradeEnabled, setAutoUpgradeEnabled };
 /**
  * Utility function for generating an install command for the user to run
  * to install an updated version of Shopify CLI.