Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/test-tier3.yml
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ jobs:
- name: Calculate matrix chunks
id: count
run: |
TOTAL=$(bun -e "import { ALL_COMBINATIONS } from './tests/utils/matrix.config'; console.log(ALL_COMBINATIONS.length)")
TOTAL=$(bun -e "import { PRIMARY_COMBINATIONS } from './tests/utils/matrix.config'; console.log(PRIMARY_COMBINATIONS.length)")

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟠 Major | ⚡ Quick win

Align matrix chunk sizing with the same combo set used at execution time.

Line 67 computes TOTAL from PRIMARY_COMBINATIONS, but Layer 2 executes and validates ranges against ALL_COMBINATIONS (tests/e2e/run-matrix.ts:38-44, tests/e2e/validate-combo.ts:34-42). This mismatch can silently skip tail combinations when lengths diverge, reducing Tier 3 coverage.

Suggested patch
-          TOTAL=$(bun -e "import { PRIMARY_COMBINATIONS } from './tests/utils/matrix.config'; console.log(PRIMARY_COMBINATIONS.length)")
+          TOTAL=$(bun -e "import { ALL_COMBINATIONS } from './tests/utils/matrix.config'; console.log(ALL_COMBINATIONS.length)")
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
TOTAL=$(bun -e "import { PRIMARY_COMBINATIONS } from './tests/utils/matrix.config'; console.log(PRIMARY_COMBINATIONS.length)")
TOTAL=$(bun -e "import { ALL_COMBINATIONS } from './tests/utils/matrix.config'; console.log(ALL_COMBINATIONS.length)")
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.github/workflows/test-tier3.yml at line 67, The CI step computes TOTAL from
PRIMARY_COMBINATIONS but the runner and validator use ALL_COMBINATIONS, causing
mismatched chunk sizing and skipped tail combos; update the bun command that
sets TOTAL to import and use ALL_COMBINATIONS.length instead of
PRIMARY_COMBINATIONS.length so the matrix chunk sizing aligns with the actual
execution/validation set (reference symbols: TOTAL, PRIMARY_COMBINATIONS,
ALL_COMBINATIONS, and the matrix chunking step).

CHUNK_SIZE=${{ inputs.concurrency || '75' }}
CHUNKS=$(( (TOTAL + CHUNK_SIZE - 1) / CHUNK_SIZE ))

Expand Down
Loading