Skip to content

[ci] Read frozen CI baselines strictly - #3577

Open
joshlf wants to merge 1 commit into
Ghrxpfppzzenc5ecwz3u273gd42e4psk7from
Gt4itljw3xh6tci2mjqj4z245i6pwle2i
Open

[ci] Read frozen CI baselines strictly#3577
joshlf wants to merge 1 commit into
Ghrxpfppzzenc5ecwz3u273gd42e4psk7from
Gt4itljw3xh6tci2mjqj4z245i6pwle2i

Conversation

@joshlf

@joshlf joshlf commented Aug 25, 2026

Copy link
Copy Markdown
Member

Add typed, data-only readers for the eight files which record legacy CI
behavior. Require exact headers, field counts, row order, identifiers,
paths, counts, hashes, command forms, action references, and canonical
JSON. Reject invalid UTF-8, control characters, duplicate rows, and
manifest counts which disagree with the parsed data.

Keep parsed fields private and expose validated constructors so future
plans cannot bypass the same invariants when comparing exact sets.
Reparse public string-bearing enum values and compare the resulting
canonical variant, preventing WorkingDirectory::Relative(".") from
entering a record as an alternate spelling of the repository root.
Report missing and extra work separately and in deterministic order.

This reader deliberately does not parse workflow YAML or regenerate the
baseline. The checked-in files remain independent review evidence from
the old workflow rather than an expectation produced by the new planner.

Tests: standalone warning-free compilation; baseline mutation tests.

Authored by an agent, posting via joshlf's account


Latest Update: v29 — Compare vs v28

📚 Full Patch History

Links show the diff between the row version and the column version.

Version v28 v27 v26 v25 v24 v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v29 v28 v27 v26 v25 v24 v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v28 v27 v26 v25 v24 v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v27 v26 v25 v24 v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v26 v25 v24 v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v25 v24 v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v24 v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v23 v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v22 v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v21 v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v8 v7 v6 v5 v4 v3 v2 v1 Base
v7 v6 v5 v4 v3 v2 v1 Base
v6 v5 v4 v3 v2 v1 Base
v5 v4 v3 v2 v1 Base
v4 v3 v2 v1 Base
v3 v2 v1 Base
v2 v1 Base
v1 Base
⬇️ Download this PR

Branch

git fetch origin refs/heads/Gt4itljw3xh6tci2mjqj4z245i6pwle2i && git checkout -b pr-Gt4itljw3xh6tci2mjqj4z245i6pwle2i FETCH_HEAD

Checkout

git fetch origin refs/heads/Gt4itljw3xh6tci2mjqj4z245i6pwle2i && git checkout FETCH_HEAD

Cherry Pick

git fetch origin refs/heads/Gt4itljw3xh6tci2mjqj4z245i6pwle2i && git cherry-pick FETCH_HEAD

Pull

git pull origin refs/heads/Gt4itljw3xh6tci2mjqj4z245i6pwle2i

Stacked PRs enabled by GHerrit.

@codecov-commenter

codecov-commenter commented Aug 25, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (Ghrxpfppzzenc5ecwz3u273gd42e4psk7@d5d5a26). Learn more about missing BASE report.

Additional details and impacted files
@@                         Coverage Diff                          @@
##             Ghrxpfppzzenc5ecwz3u273gd42e4psk7    #3577   +/-   ##
====================================================================
  Coverage                                     ?   91.85%           
====================================================================
  Files                                        ?       20           
  Lines                                        ?     6093           
  Branches                                     ?        0           
====================================================================
  Hits                                         ?     5597           
  Misses                                       ?      496           
  Partials                                     ?        0           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

joshlf commented Aug 25, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. You're on a roll.

Reviewed commit: 4864e15686

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@joshlf
joshlf force-pushed the Ghrxpfppzzenc5ecwz3u273gd42e4psk7 branch from 453c9c9 to cc02374 Compare August 26, 2026 11:31
@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from 8da94d7 to e19d827 Compare August 26, 2026 11:31
@joshlf

joshlf commented Aug 26, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e19d827d4b

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread tools/zc/src/baseline.rs Outdated
@joshlf
joshlf force-pushed the Ghrxpfppzzenc5ecwz3u273gd42e4psk7 branch from cc02374 to 41ece9e Compare August 26, 2026 15:46
@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from e19d827 to 5488531 Compare August 26, 2026 15:46
@joshlf

joshlf commented Aug 26, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Delightful!

Reviewed commit: 548853140e

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from 5488531 to da7ad19 Compare August 26, 2026 17:40
@joshlf

joshlf commented Aug 26, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 👍

Reviewed commit: da7ad19f11

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from da7ad19 to d6bc5ea Compare August 26, 2026 18:55
@joshlf

joshlf commented Aug 26, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

Please review the current head, d6bc5ea583a63e31ff84fe6dc5d81f981d502a23.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Swish!

Reviewed commit: d6bc5ea583

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@joshlf
joshlf force-pushed the Ghrxpfppzzenc5ecwz3u273gd42e4psk7 branch from 6ea01e9 to e5ca1fb Compare August 26, 2026 20:11
@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from d6bc5ea to 82ce4ba Compare August 26, 2026 20:11
@joshlf

joshlf commented Aug 26, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

Please review the current head, 82ce4ba37b3a44a129e05fc4e9501295633f1d76.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Nice work!

Reviewed commit: 82ce4ba37b

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from 82ce4ba to c84c440 Compare August 26, 2026 22:35
@joshlf
joshlf force-pushed the Ghrxpfppzzenc5ecwz3u273gd42e4psk7 branch from e5ca1fb to 7f75458 Compare August 26, 2026 22:35
@joshlf

joshlf commented Aug 26, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

Please review the current head, c84c44097a6add8c1948386bffbf12655d041c7f.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c84c44097a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread tools/zc/src/baseline.rs Outdated
@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from c84c440 to fec9a20 Compare August 26, 2026 23:31
Add typed, data-only readers for the eight files which record legacy CI
behavior. Require exact headers, field counts, row order, identifiers,
paths, counts, hashes, command forms, action references, and canonical
JSON. Reject invalid UTF-8, control characters, duplicate rows, and
manifest counts which disagree with the parsed data.

Keep parsed fields private and expose validated constructors so future
plans cannot bypass the same invariants when comparing exact sets.
Reparse public string-bearing enum values and compare the resulting
canonical variant, preventing `WorkingDirectory::Relative(".")` from
entering a record as an alternate spelling of the repository root.
Report missing and extra work separately and in deterministic order.

This reader deliberately does not parse workflow YAML or regenerate the
baseline. The checked-in files remain independent review evidence from
the old workflow rather than an expectation produced by the new planner.

Tests: standalone warning-free compilation; baseline mutation tests.

*Authored by an agent, posting via joshlf's account*

gherrit-pr-id: Gt4itljw3xh6tci2mjqj4z245i6pwle2i
@joshlf
joshlf force-pushed the Ghrxpfppzzenc5ecwz3u273gd42e4psk7 branch from 7f75458 to d5d5a26 Compare August 27, 2026 01:18
@joshlf
joshlf force-pushed the Gt4itljw3xh6tci2mjqj4z245i6pwle2i branch from fec9a20 to 0adf985 Compare August 27, 2026 01:18
@joshlf

joshlf commented Aug 27, 2026

Copy link
Copy Markdown
Member Author

Authored by an agent, posting via joshlf's account

@codex review

Please review the current head, 0adf9856a0bd269c890e841a70544c56dc0eac54.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 🎉

Reviewed commit: 0adf9856a0

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants