Skip to content

ci(perf): throwaway verification run, do not merge (LAB-12228) - #219

Closed
27Bslash6 wants to merge 10 commits into
mainfrom
lab-12228-throwaway-stack-212
Closed

27Bslash6 wants to merge 10 commits into
mainfrom
lab-12228-throwaway-stack-212

Conversation

@27Bslash6

Copy link
Copy Markdown
Contributor

Throwaway, do not merge. #218 merged with the head of #212, only to get one Instruction counts vs base run in which both builds contain macro_hit. Closed and its branch deleted once that run reports.

…est error kind for the unreachable hex branch
Conflicts in README.md and examples/bench_hot_path.rs: this branch adds
the macro_hit op, main adds the ns and nsenc modes. Both kept.

The union also paired macro_hit with ns and nsenc, and those cases fail:
a namespaced client refuses interop reads. is_case now leaves them out,
so every listed case runs.
The perf-ir job built both trees with default features, which leave out
macros, so a bench case behind #[cfg(feature = "macros")] never reached
the gate. Build head and base with --features macros; the feature exists
at every base the job uses, including the last release tag.
…nto lab-12228-throwaway-stack-212

# Conflicts:
#	Makefile
#	README.md
@coderabbitai

coderabbitai Bot commented Nov 1, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@github-actions

github-actions Bot commented Nov 1, 2026

Copy link
Copy Markdown

Instruction counts: PASS

116 of 116 cases measured. A case fails when its median is slower than the base by its floor or more (SLOWER). The floor is 0.5%, and such a case also fails when the head's runs spread by more than that (NOISIER), except l2_hit, whose floor is 2% because its count varies between runs. delete cases are reported, never failed. Method: README, Measuring performance.

Verdict Case Base Ir/op Head Ir/op Delta Floor Head spread
faster macro_hit/plain/40 10222 5482 -46.37% 0.50% 0.00%
faster macro_hit/plain/64 10355 5529 -46.61% 0.50% 0.00%
faster macro_hit/plain/1024 10884 6058 -44.34% 0.50% 0.00%
faster macro_hit/plain/65536 104788 99916 -4.65% 0.50% 0.00%
faster macro_hit/rel/40 10222 5482 -46.37% 0.50% 0.00%
faster macro_hit/rel/64 10355 5529 -46.61% 0.50% 0.00%
faster macro_hit/rel/1024 10884 6058 -44.34% 0.50% 0.00%
faster macro_hit/rel/65536 104771 99932 -4.62% 0.50% 0.00%
faster macro_hit/enc/40 14446 9706 -32.81% 0.50% 0.00%
faster macro_hit/enc/64 14646 9820 -32.95% 0.50% 0.00%
faster macro_hit/enc/1024 17995 13180 -26.76% 0.50% 0.00%
faster macro_hit/enc/65536 342472 336719 -1.68% 0.50% 0.00%
104 cases within noise
Verdict Case Base Ir/op Head Ir/op Delta Floor Head spread
within noise l1_hit/plain/40 1526 1526 +0.00% 0.50% 0.00%
within noise l1_hit/plain/64 1573 1573 +0.00% 0.50% 0.00%
within noise l1_hit/plain/1024 2102 2102 +0.00% 0.50% 0.00%
within noise l1_hit/plain/65536 95922 95922 +0.00% 0.50% 0.00%
within noise l1_hit/rel/40 1520 1520 +0.00% 0.50% 0.00%
within noise l1_hit/rel/64 1567 1567 +0.00% 0.50% 0.00%
within noise l1_hit/rel/1024 2096 2096 +0.00% 0.50% 0.00%
within noise l1_hit/rel/65536 95938 95938 +0.00% 0.50% 0.00%
within noise l1_hit/enc/40 5129 5129 +0.00% 0.50% 0.00%
within noise l1_hit/enc/64 5243 5243 +0.00% 0.50% 0.00%
within noise l1_hit/enc/1024 8591 8591 +0.00% 0.50% 0.00%
within noise l1_hit/enc/65536 332108 332108 +0.00% 0.50% 0.00%
within noise l1_hit/prev/40 8095 8095 +0.00% 0.50% 0.00%
within noise l1_hit/prev/64 8283 8283 +0.00% 0.50% 0.00%
within noise l1_hit/prev/1024 14507 14507 +0.00% 0.50% 0.00%
within noise l1_hit/prev/65536 633158 633158 +0.00% 0.50% 0.00%
within noise l1_hit/ns/40 1788 1788 +0.00% 0.50% 0.00%
within noise l1_hit/ns/64 1832 1832 +0.00% 0.50% 0.00%
within noise l1_hit/ns/1024 2361 2361 +0.00% 0.50% 0.00%
within noise l1_hit/ns/65536 96187 96187 +0.00% 0.50% 0.00%
within noise l1_hit/nsenc/40 5397 5397 +0.00% 0.50% 0.00%
within noise l1_hit/nsenc/64 5511 5511 +0.00% 0.50% 0.00%
within noise l1_hit/nsenc/1024 8871 8871 +0.00% 0.50% 0.00%
within noise l1_hit/nsenc/65536 332408 332408 +0.00% 0.50% 0.00%
within noise l1_hit_row/plain/40 8485 8485 +0.00% 0.50% 0.00%
within noise l1_hit_row/plain/64 8538 8538 +0.00% 0.50% 0.00%
within noise l1_hit_row/plain/1024 9047 9047 +0.00% 0.50% 0.00%
within noise l1_hit_row/plain/65536 103024 103024 +0.00% 0.50% 0.00%
within noise l2_hit/plain/40 6681 6661 -0.30% 2.00% 0.82%
within noise l2_hit/plain/64 6729 6712 -0.25% 2.00% 0.76%
within noise l2_hit/plain/1024 7656 7666 +0.13% 2.00% 0.20%
within noise l2_hit/plain/65536 167150 167138 -0.01% 2.00% 0.13%
within noise l2_hit/rel/40 7373 7370 -0.03% 2.00% 0.56%
within noise l2_hit/rel/64 7419 7427 +0.10% 2.00% 1.01%
within noise l2_hit/rel/1024 8371 8372 +0.01% 2.00% 0.39%
within noise l2_hit/rel/65536 167845 167710 -0.08% 2.00% 0.11%
within noise l2_hit/enc/40 10166 10182 +0.16% 2.00% 0.47%
within noise l2_hit/enc/64 10301 10340 +0.38% 2.00% 0.56%
within noise l2_hit/enc/1024 14100 14099 -0.01% 2.00% 0.46%
within noise l2_hit/enc/65536 403394 403241 -0.04% 2.00% 0.05%
within noise l2_hit/prev/40 13155 13152 -0.02% 2.00% 0.47%
within noise l2_hit/prev/64 13365 13347 -0.13% 2.00% 0.45%
within noise l2_hit/prev/1024 20056 20064 +0.04% 2.00% 0.11%
within noise l2_hit/prev/65536 704327 704472 +0.02% 2.00% 0.03%
within noise l2_hit/ns/40 7147 7137 -0.13% 2.00% 0.71%
within noise l2_hit/ns/64 7308 7286 -0.30% 2.00% 0.92%
within noise l2_hit/ns/1024 8135 8113 -0.27% 2.00% 0.34%
within noise l2_hit/ns/65536 167558 167422 -0.08% 2.00% 0.11%
within noise l2_hit/nsenc/40 10914 10880 -0.31% 2.00% 1.09%
within noise l2_hit/nsenc/64 10812 10791 -0.19% 2.00% 0.43%
within noise l2_hit/nsenc/1024 14555 14565 +0.06% 2.00% 0.27%
within noise l2_hit/nsenc/65536 403761 403643 -0.03% 2.00% 0.04%
within noise set/plain/40 4838 4838 +0.00% 0.50% 0.00%
within noise set/plain/64 4850 4850 +0.00% 0.50% 0.00%
within noise set/plain/1024 5065 5065 +0.00% 0.50% 0.00%
within noise set/plain/65536 70470 70470 -0.00% 0.50% 0.00%
within noise set/rel/40 5700 5700 +0.00% 0.50% 0.00%
within noise set/rel/64 5703 5703 +0.00% 0.50% 0.00%
within noise set/rel/1024 5936 5936 +0.00% 0.50% 0.00%
within noise set/rel/65536 71350 71350 +0.00% 0.50% 0.00%
within noise set/enc/40 8090 8090 +0.00% 0.50% 0.00%
within noise set/enc/64 8155 8155 +0.00% 0.50% 0.00%
within noise set/enc/1024 11355 11355 +0.00% 0.50% 0.00%
within noise set/enc/65536 306334 306334 +0.00% 0.50% 0.00%
within noise set/ns/40 5126 5126 +0.00% 0.50% 0.00%
within noise set/ns/64 5129 5129 +0.00% 0.50% 0.00%
within noise set/ns/1024 5350 5350 +0.00% 0.50% 0.00%
within noise set/ns/65536 70774 70774 -0.00% 0.50% 0.00%
within noise set/nsenc/40 8384 8384 +0.00% 0.50% 0.00%
within noise set/nsenc/64 8443 8443 +0.00% 0.50% 0.00%
within noise set/nsenc/1024 11479 11479 -0.00% 0.50% 0.00%
within noise set/nsenc/65536 306606 306606 -0.00% 0.50% 0.00%
within noise delete/plain/40 3562 3538 -0.68% 26.85% 1.15%
within noise delete/plain/64 3570 3557 -0.36% 22.38% 4.09%
within noise delete/plain/1024 3646 3634 -0.31% 14.16% 8.64%
within noise delete/plain/65536 4560 4568 +0.17% 2.00% 0.33%
within noise delete/rel/40 4249 4249 -0.01% 18.86% 6.98%
within noise delete/rel/64 4257 4339 +1.92% 18.16% 8.26%
within noise delete/rel/1024 4332 4336 +0.11% 13.25% 6.69%
within noise delete/rel/65536 5258 5264 +0.11% 2.00% 0.31%
within noise delete/enc/40 3754 3593 -4.29% 25.49% 7.50%
within noise delete/enc/64 3576 3589 +0.37% 25.34% 8.16%
within noise delete/enc/1024 3852 3696 -4.07% 19.39% 7.00%
within noise delete/enc/65536 4594 4598 +0.09% 2.00% 0.32%
within noise exists/plain/40 782 782 +0.00% 0.50% 0.00%
within noise exists/plain/64 782 782 +0.00% 0.50% 0.00%
within noise exists/plain/1024 782 782 +0.00% 0.50% 0.00%
within noise exists/plain/65536 781 781 +0.00% 0.50% 0.00%
within noise exists/rel/40 776 776 +0.00% 0.50% 0.00%
within noise exists/rel/64 776 776 +0.00% 0.50% 0.00%
within noise exists/rel/1024 776 776 +0.00% 0.50% 0.00%
within noise exists/rel/65536 781 781 +0.00% 0.50% 0.00%
within noise exists/enc/40 809 809 +0.00% 0.50% 0.00%
within noise exists/enc/64 809 809 +0.00% 0.50% 0.00%
within noise exists/enc/1024 809 809 +0.00% 0.50% 0.00%
within noise exists/enc/65536 814 814 +0.00% 0.50% 0.00%
within noise oneshot/enc/40 71023 71035 +0.02% 0.50% 0.00%
within noise oneshot/enc/64 71137 71149 +0.02% 0.50% 0.00%
within noise oneshot/enc/1024 74820 74808 -0.02% 0.50% 0.00%
within noise oneshot/enc/65536 464283 464271 -0.00% 0.50% 0.00%
within noise oneshot/prev/40 103691 103703 +0.01% 0.50% 0.00%
within noise oneshot/prev/64 103879 103891 +0.01% 0.50% 0.00%
within noise oneshot/prev/1024 110438 110426 -0.01% 0.50% 0.00%
within noise oneshot/prev/65536 794988 794976 -0.00% 0.50% 0.00%

PR head f989944577874262e3cf0fdbed0e084041310d1f merged into its base, measured against bebaafa0378cb37309f05608a1b0fd97f023da03 on the same runner. Workflow run

@27Bslash6

Copy link
Copy Markdown
Contributor Author

Verification run done (all 12 macro_hit cases measured, PASS); closing as planned.

@27Bslash6 27Bslash6 closed this Nov 1, 2026
@27Bslash6
27Bslash6 deleted the lab-12228-throwaway-stack-212 branch November 1, 2026 01:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant