Skip to content

Move benchmark machines to c8gd.metal-24xl - #9761

Merged
robert3005 merged 3 commits into
developfrom
rk/benchboxes
Sep 3, 2026
Merged

Move benchmark machines to c8gd.metal-24xl#9761
robert3005 merged 3 commits into
developfrom
rk/benchboxes

Conversation

@robert3005

Copy link
Copy Markdown
Contributor

c7gd use graviton3 which suffers from llvm bugs, c8gd shouldn't have this
problem

Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added changelog/chore A trivial change action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Sep 3, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 3, 2026
@codspeed-hq

codspeed-hq Bot commented Sep 3, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 4.52%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 2 regressed benchmarks
✅ 2195 untouched benchmarks
⏩ 206 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation random_i8[0.5] 66.6 µs 90.6 µs -26.51%
Simulation decompress[u64, (4000, 1024)] 70.3 µs 85.5 µs -17.73%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.6 µs +21.19%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing rk/benchboxes (a42e6d5) with develop (78f4d38)

Open in CodSpeed

Footnotes

  1. 206 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@codecov

ghost commented Sep 3, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 83.33%. Comparing base (792cef7) to head (ca72571).
⚠️ Report is 8 commits behind head on develop.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a42e6d5 statpopgen 2 Explore Profiling Data
🟢 Done a42e6d5 clickbench-nvme 1 Explore Profiling Data
🟢 Done a42e6d5 tpch-s3-10 1 Explore Profiling Data
🟢 Done a42e6d5 fineweb 1 Explore Profiling Data
🟢 Done a42e6d5 tpcds-nvme 1 Explore Profiling Data
🟢 Done a42e6d5 tpch-s3 1 Explore Profiling Data
🟢 Done a42e6d5 polarsignals 1 Explore Profiling Data
🟢 Done a42e6d5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done a42e6d5 random-access-bench 1 Explore Profiling Data
🟢 Done a42e6d5 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done a42e6d5 fineweb-s3 1 Explore Profiling Data
🟢 Done a42e6d5 tpch-nvme 1 Explore Profiling Data
🟢 Done a42e6d5 appian-nvme 1 Explore Profiling Data
🟢 Done a42e6d5 compress-bench 1 Explore Profiling Data
🟢 Done a42e6d5 string-bench 1 Explore Profiling Data
Previous Runs (13)
Status Commit Job Attempt Link
🟡 In Progress a42e6d5 statpopgen 1 Explore Profiling Data
🟢 Done ca72571 tpch-s3-10 1 Explore Profiling Data
🟢 Done ca72571 tpch-s3 1 Explore Profiling Data
🟢 Done ca72571 random-access-bench 1 Explore Profiling Data
🟢 Done ca72571 fineweb 1 Explore Profiling Data
🟢 Done ca72571 fineweb-s3 1 Explore Profiling Data
🟢 Done ca72571 polarsignals 1 Explore Profiling Data
🟢 Done ca72571 tpch-nvme 1 Explore Profiling Data
🟢 Done ca72571 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ca72571 statpopgen 1 Explore Profiling Data
🟢 Done ca72571 clickbench-nvme 1 Explore Profiling Data
🟢 Done ca72571 string-bench 1 Explore Profiling Data
🟢 Done ca72571 compress-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR a42e6d50 vs base 792cef74


vortex / vortex-file-compressed / ns (0.736x ✅, 24↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 944066205 / 1173457064 / -19.5% 🟢
compress time/Bimbo 4189442372 / 5062112092 / -17.2% 🟢
compress time/CMSprovider 3130347087 / 4026792967 / -22.3% 🟢
compress time/Euro2016 365379846 / 524481612 / -30.3% 🟢
compress time/Food 339090686 / 433961311 / -21.9% 🟢
compress time/HashTags 617425015 / 879075118 / -29.8% 🟢
compress time/TPC-H l_comment canonical 826356756 / 1194031130 / -30.8% 🟢
compress time/TPC-H l_comment chunked 830654329 / 1171588937 / -29.1% 🟢
compress time/taxi 459370535 / 557440930 / -17.6% 🟢
compress time/wide table cols=100 chunks=1 rows=1000 7199041 / 8107505 / -11.2% 🟢
compress time/wide table cols=100 chunks=50 rows=1000 7220400 / 8497328 / -15.0% 🟢
compress time/wide table cols=1000 chunks=1 rows=1000 70626882 / 84263736 / -16.2% 🟢
compress time/wide table cols=1000 chunks=50 rows=1000 71630254 / 84524961 / -15.3% 🟢
compress time/wide table cols=10000 chunks=1 rows=1000 798519448 / 980849956 / -18.6% 🟢
compress time/wide table cols=10000 chunks=50 rows=1000 798188878 / 972116618 / -17.9% 🟢
decompress time/Arade 11464528 / 26001352 / -55.9% 🟢
decompress time/Bimbo 58978891 / 91779375 / -35.7% 🟢
decompress time/CMSprovider 30712587 / 72839252 / -57.8% 🟢
decompress time/Euro2016 8646991 / 15555604 / -44.4% 🟢
decompress time/Food 3657768 / 7000742 / -47.8% 🟢
decompress time/HashTags 70434217 / 108364467 / -35.0% 🟢
decompress time/TPC-H l_comment canonical 21849934 / 34641468 / -36.9% 🟢
decompress time/TPC-H l_comment chunked 21916968 / 34924803 / -37.2% 🟢
decompress time/taxi 8321486 / 14132673 / -41.1% 🟢
decompress time/wide table cols=100 chunks=1 rows=1000 2175021 / 2342811 / -7.2%
decompress time/wide table cols=100 chunks=50 rows=1000 2190444 / 2413617 / -9.2%
decompress time/wide table cols=1000 chunks=1 rows=1000 20816560 / 22840839 / -8.9%
decompress time/wide table cols=1000 chunks=50 rows=1000 20766840 / 22587781 / -8.1%
decompress time/wide table cols=10000 chunks=1 rows=1000 248150212 / 251218578 / -1.2%
decompress time/wide table cols=10000 chunks=50 rows=1000 267369779 / 277275144 / -3.6%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 144460980 / 144460980 / +0.0%
vortex-file-compressed size/Bimbo 461842908 / 461842908 / +0.0%
vortex-file-compressed size/CMSprovider 415191460 / 415192460 / -0.0%
vortex-file-compressed size/Euro2016 157665124 / 157674404 / -0.0%
vortex-file-compressed size/Food 41581624 / 41581624 / +0.0%
vortex-file-compressed size/HashTags 177850636 / 177840364 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 163461696 / 163453384 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 163461696 / 163453384 / +0.0%
vortex-file-compressed size/taxi 51475172 / 51475172 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932744 / 932744 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932744 / 932744 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309944 / 9309944 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309944 / 9309944 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117944 / 93117944 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117944 / 93117944 / +0.0%
vortex / vortex-file-compressed / ratio (0.960x ➖, 9↑ 7↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.415851126 / 0.410925518 / +1.2%
vortex:parquet-zstd ratio compress time/Bimbo 0.352341046 / 0.365013892 / -3.5%
vortex:parquet-zstd ratio compress time/CMSprovider 0.482239416 / 0.524457567 / -8.0%
vortex:parquet-zstd ratio compress time/Euro2016 0.336189537 / 0.34686689 / -3.1%
vortex:parquet-zstd ratio compress time/Food 0.456120464 / 0.477408633 / -4.5%
vortex:parquet-zstd ratio compress time/HashTags 0.332647009 / 0.363981168 / -8.6%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.308190868 / 0.326458599 / -5.6%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.309700027 / 0.318213819 / -2.7%
vortex:parquet-zstd ratio compress time/taxi 0.418138585 / 0.415096165 / +0.7%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.80196315 / 1.61315358 / +11.7% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.79776154 / 1.68235004 / +6.9%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.56397762 / 1.35020408 / +15.8% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.59456487 / 1.34628438 / +18.4% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.69060134 / 1.32391917 / +27.7% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.68222574 / 1.30873318 / +28.5% 🔴
vortex:parquet-zstd ratio decompress time/Arade 0.0203735102 / 0.036888534 / -44.8% 🟢
vortex:parquet-zstd ratio decompress time/Bimbo 0.0370412333 / 0.0481243261 / -23.0% 🟢
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0223275172 / 0.0381031485 / -41.4% 🟢
vortex:parquet-zstd ratio decompress time/Euro2016 0.0261251112 / 0.0374453672 / -30.2% 🟢
vortex:parquet-zstd ratio decompress time/Food 0.0213689556 / 0.0316199793 / -32.4% 🟢
vortex:parquet-zstd ratio decompress time/HashTags 0.13679584 / 0.158832893 / -13.9% 🟢
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0441685127 / 0.0522666296 / -15.5% 🟢
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0443102342 / 0.0528514094 / -16.2% 🟢
vortex:parquet-zstd ratio decompress time/taxi 0.0380813905 / 0.0498121621 / -23.6% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1.07756618 / 1.01127252 / +6.6%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1.07134284 / 1.0406159 / +3.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.883897782 / 0.857924442 / +3.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.876906459 / 0.842788026 / +4.0%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.969421783 / 0.842556898 / +15.1% 🔴
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 1.01904284 / 0.917023088 / +11.1% 🔴
vortex:parquet-zstd size/Arade 0.559895285 / 0.559895285 / -0.0%
vortex:parquet-zstd size/Bimbo 1.20109789 / 1.20109789 / -0.0%
vortex:parquet-zstd size/CMSprovider 1.10163114 / 1.1016338 / -0.0%
vortex:parquet-zstd size/Euro2016 1.28204865 / 1.28212411 / -0.0%
vortex:parquet-zstd size/Food 1.16476769 / 1.16476769 / -0.0%
vortex:parquet-zstd size/HashTags 1.33223855 / 1.33216161 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.0322273 / 1.03217481 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.0322273 / 1.03217481 / +0.0%
vortex:parquet-zstd size/taxi 0.931110481 / 0.931110481 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00036465 / 1.00036465 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00036465 / 1.00036465 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.998492064 / 0.998492064 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.998492064 / 0.998492064 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998690905 / 0.998690905 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998690905 / 0.998690905 / -0.0%
vortex / parquet / ns (0.783x ✅, 30↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2270202355 / 2855644183 / -20.5% 🟢
parquet_rs-zstd compress time/Bimbo 11890304618 / 13868272425 / -14.3% 🟢
parquet_rs-zstd compress time/CMSprovider 6491271734 / 7678014817 / -15.5% 🟢
parquet_rs-zstd compress time/Euro2016 1086826940 / 1512054415 / -28.1% 🟢
parquet_rs-zstd compress time/Food 743423532 / 908993430 / -18.2% 🟢
parquet_rs-zstd compress time/HashTags 1856096699 / 2415166486 / -23.1% 🟢
parquet_rs-zstd compress time/TPC-H l_comment canonical 2681314870 / 3657526966 / -26.7% 🟢
parquet_rs-zstd compress time/TPC-H l_comment chunked 2682125468 / 3681766365 / -27.2% 🟢
parquet_rs-zstd compress time/taxi 1098608335 / 1342919971 / -18.2% 🟢
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3995110 / 5025873 / -20.5% 🟢
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 4016328 / 5050868 / -20.5% 🟢
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 45158499 / 62408148 / -27.6% 🟢
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44921505 / 62783883 / -28.5% 🟢
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 472328650 / 740868461 / -36.2% 🟢
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 474483811 / 742792065 / -36.1% 🟢
parquet_rs-zstd decompress time/Arade 562717365 / 704862709 / -20.2% 🟢
parquet_rs-zstd decompress time/Bimbo 1592249656 / 1907130602 / -16.5% 🟢
parquet_rs-zstd decompress time/CMSprovider 1375548686 / 1911633418 / -28.0% 🟢
parquet_rs-zstd decompress time/Euro2016 330983893 / 415421323 / -20.3% 🟢
parquet_rs-zstd decompress time/Food 171172053 / 221402485 / -22.7% 🟢
parquet_rs-zstd decompress time/HashTags 514885664 / 682254570 / -24.5% 🟢
parquet_rs-zstd decompress time/TPC-H l_comment canonical 494694810 / 662783659 / -25.4% 🟢
parquet_rs-zstd decompress time/TPC-H l_comment chunked 494625415 / 660811195 / -25.1% 🟢
parquet_rs-zstd decompress time/taxi 218518439 / 283719325 / -23.0% 🟢
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2018457 / 2316696 / -12.9% 🟢
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2044578 / 2319412 / -11.8% 🟢
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23550868 / 26623369 / -11.5% 🟢
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23681933 / 26801260 / -11.6% 🟢
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 255977549 / 298162152 / -14.1% 🟢
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 262373444 / 302364409 / -13.2% 🟢
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.526x ✅, 30↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 99195323 / 270802755 / -63.4% 🟢
arrow-ipc compress time/Bimbo 661787062 / 1768629459 / -62.6% 🟢
arrow-ipc compress time/CMSprovider 440869248 / 1453431634 / -69.7% 🟢
arrow-ipc compress time/Euro2016 38518908 / 98501828 / -60.9% 🟢
arrow-ipc compress time/Food 33994465 / 74079297 / -54.1% 🟢
arrow-ipc compress time/HashTags 78603788 / 291491710 / -73.0% 🟢
arrow-ipc compress time/TPC-H l_comment canonical 504591261 / 2129153939 / -76.3% 🟢
arrow-ipc compress time/TPC-H l_comment chunked 514172297 / 2121778879 / -75.8% 🟢
arrow-ipc compress time/taxi 73629093 / 160615016 / -54.2% 🟢
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 206499 / 414441 / -50.2% 🟢
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 206183 / 407735 / -49.4% 🟢
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2255380 / 4930121 / -54.3% 🟢
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2240387 / 4946489 / -54.7% 🟢
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25866363 / 56556134 / -54.3% 🟢
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25956039 / 56649310 / -54.2% 🟢
arrow-ipc decompress time/Arade 140584219 / 185753923 / -24.3% 🟢
arrow-ipc decompress time/Bimbo 411371330 / 592638199 / -30.6% 🟢
arrow-ipc decompress time/CMSprovider 584309355 / 715741545 / -18.4% 🟢
arrow-ipc decompress time/Euro2016 74644710 / 96372573 / -22.5% 🟢
arrow-ipc decompress time/Food 48799399 / 65549547 / -25.6% 🟢
arrow-ipc decompress time/HashTags 142266397 / 209955386 / -32.2% 🟢
arrow-ipc decompress time/TPC-H l_comment canonical 542876852 / 1033293616 / -47.5% 🟢
arrow-ipc decompress time/TPC-H l_comment chunked 543019005 / 1046224757 / -48.1% 🟢
arrow-ipc decompress time/taxi 45495764 / 72221291 / -37.0% 🟢
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 343579 / 390724 / -12.1% 🟢
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 333810 / 395360 / -15.6% 🟢
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3483134 / 4140209 / -15.9% 🟢
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3502451 / 4065180 / -13.8% 🟢
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 35352663 / 50926584 / -30.6% 🟢
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 35021032 / 50569984 / -30.7% 🟢
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.3%
Engines: DataFusion No clear signal (-1.5%, environment too noisy confidence) · DuckDB No clear signal (+12.5%, environment too noisy confidence)
Vortex (geomean): hot 0.611x ✅ · cold 0.459x ✅
Parquet (geomean): hot 0.580x ✅ · cold 0.553x ✅
Shifts: Parquet (control) -42.0% · Median polish -41.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.703x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 238673224 / 230266049 / +3.7% 626816635 / 461020057 / +36.0% 🔴 0.38 / 0.50 / -23.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed 14826842 / 27911398 / -46.9% 🟢 50718989 / 91005767 / -44.3% 🟢 0.29 / 0.31 / -4.7%
clickbench-sorted_q26/datafusion:vortex-file-compressed 13796473 / 23509204 / -41.3% 🟢 46523030 / 90432141 / -48.6% 🟢 0.30 / 0.26 / +14.1%
clickbench-sorted_q36/datafusion:vortex-file-compressed 30790300 / 50452172 / -39.0% 🟢 67243210 / 126284126 / -46.8% 🟢 0.46 / 0.40 / +14.6%
clickbench-sorted_q37/datafusion:vortex-file-compressed 23683185 / 39954728 / -40.7% 🟢 56298434 / 108879588 / -48.3% 🟢 0.42 / 0.37 / +14.6%
clickbench-sorted_q38/datafusion:vortex-file-compressed 36813616 / 51021210 / -27.8% 🟢 68970903 / 110548979 / -37.6% 🟢 0.53 / 0.46 / +15.7%
clickbench-sorted_q39/datafusion:vortex-file-compressed 87618149 / 125701280 / -30.3% 🟢 115284227 / 205738696 / -44.0% 🟢 0.76 / 0.61 / +24.4%
clickbench-sorted_q40/datafusion:vortex-file-compressed 16214198 / 20658600 / -21.5% 🟢 45626772 / 82028409 / -44.4% 🟢 0.36 / 0.25 / +41.1%
clickbench-sorted_q41/datafusion:vortex-file-compressed 15216340 / 20534354 / -25.9% 🟢 43698235 / 81407857 / -46.3% 🟢 0.35 / 0.25 / +38.0%
clickbench-sorted_q42/datafusion:vortex-file-compressed 13712165 / 16004904 / -14.3% 🟢 39817988 / 69845730 / -43.0% 🟢 0.34 / 0.23 / +50.3%
datafusion / vortex-compact / ns (0.490x ✅, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 185849608 / 486919466 / -61.8% 🟢 431008989 / 831476172 / -48.2% 🟢 0.43 / 0.59 / -26.4%
clickbench-sorted_q24/datafusion:vortex-compact 23506762 / 54603540 / -57.0% 🟢 52062493 / 114895592 / -54.7% 🟢 0.45 / 0.48 / -5.0%
clickbench-sorted_q26/datafusion:vortex-compact 23513204 / 54674673 / -57.0% 🟢 50220534 / 115341762 / -56.5% 🟢 0.47 / 0.47 / -1.2%
clickbench-sorted_q36/datafusion:vortex-compact 25226100 / 55761366 / -54.8% 🟢 66360663 / 131605595 / -49.6% 🟢 0.38 / 0.42 / -10.3%
clickbench-sorted_q37/datafusion:vortex-compact 21878818 / 46644820 / -53.1% 🟢 65129448 / 123835199 / -47.4% 🟢 0.34 / 0.38 / -10.8%
clickbench-sorted_q38/datafusion:vortex-compact 22293380 / 44712327 / -50.1% 🟢 64130115 / 117047808 / -45.2% 🟢 0.35 / 0.38 / -9.0%
clickbench-sorted_q39/datafusion:vortex-compact 45206588 / 102314592 / -55.8% 🟢 83830503 / 179642161 / -53.3% 🟢 0.54 / 0.57 / -5.3%
clickbench-sorted_q40/datafusion:vortex-compact 15311689 / 27258840 / -43.8% 🟢 44995299 / 81389801 / -44.7% 🟢 0.34 / 0.33 / +1.6%
clickbench-sorted_q41/datafusion:vortex-compact 14013524 / 22644604 / -38.1% 🟢 42981965 / 79362266 / -45.8% 🟢 0.33 / 0.29 / +14.3%
clickbench-sorted_q42/datafusion:vortex-compact 11359914 / 16381051 / -30.7% 🟢 34452064 / 67892353 / -49.3% 🟢 0.33 / 0.24 / +36.7%
datafusion / parquet / ns (0.596x ✅, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 764855969 / 2508547516 / -69.5% 🟢 923775771 / 2963520272 / -68.8% 🟢 0.83 / 0.85 / -2.2%
clickbench-sorted_q24/datafusion:parquet 8883443 / 17034666 / -47.9% 🟢 70472531 / 120153456 / -41.3% 🟢 0.13 / 0.14 / -11.1%
clickbench-sorted_q26/datafusion:parquet 8829238 / 16427586 / -46.3% 🟢 70616670 / 115958593 / -39.1% 🟢 0.13 / 0.14 / -11.7%
clickbench-sorted_q36/datafusion:parquet 93879344 / 157039270 / -40.2% 🟢 163602015 / 288565486 / -43.3% 🟢 0.57 / 0.54 / +5.4%
clickbench-sorted_q37/datafusion:parquet 65182937 / 92892207 / -29.8% 🟢 129218824 / 209096835 / -38.2% 🟢 0.50 / 0.44 / +13.5%
clickbench-sorted_q38/datafusion:parquet 87440106 / 141518611 / -38.2% 🟢 157387559 / 247547479 / -36.4% 🟢 0.56 / 0.57 / -2.8%
clickbench-sorted_q39/datafusion:parquet 159948134 / 266882233 / -40.1% 🟢 229539639 / 394197900 / -41.8% 🟢 0.70 / 0.68 / +2.9%
clickbench-sorted_q40/datafusion:parquet 44866858 / 58359787 / -23.1% 🟢 110978255 / 173130588 / -35.9% 🟢 0.40 / 0.34 / +19.9%
clickbench-sorted_q41/datafusion:parquet 43025289 / 58316572 / -26.2% 🟢 109852031 / 170627123 / -35.6% 🟢 0.39 / 0.34 / +14.6%
clickbench-sorted_q42/datafusion:parquet 26450458 / 35504638 / -25.5% 🟢 86791397 / 135214624 / -35.8% 🟢 0.30 / 0.26 / +16.1%
duckdb / vortex-file-compressed / ns (0.656x ✅, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 68590254 / 115802332 / -40.8% 🟢 106957738 / 200107936 / -46.5% 🟢 0.64 / 0.58 / +10.8%
clickbench-sorted_q24/duckdb:vortex-file-compressed 25469434 / 30174905 / -15.6% 🟢 33253644 / 77821228 / -57.3% 🟢 0.77 / 0.39 / +97.5%
clickbench-sorted_q26/duckdb:vortex-file-compressed 16239637 / 24864487 / -34.7% 🟢 27486585 / 72539562 / -62.1% 🟢 0.59 / 0.34 / +72.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed 45848975 / 70666896 / -35.1% 🟢 70185446 / 188202509 / -62.7% 🟢 0.65 / 0.38 / +74.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed 37767773 / 62554466 / -39.6% 🟢 63852497 / 173725299 / -63.2% 🟢 0.59 / 0.36 / +64.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed 49247574 / 73483255 / -33.0% 🟢 77365755 / 184361770 / -58.0% 🟢 0.64 / 0.40 / +59.7%
clickbench-sorted_q39/duckdb:vortex-file-compressed 114406474 / 192459156 / -40.6% 🟢 141213958 / 294192835 / -52.0% 🟢 0.81 / 0.65 / +23.8%
clickbench-sorted_q40/duckdb:vortex-file-compressed 21260041 / 32142184 / -33.9% 🟢 39768353 / 120284377 / -66.9% 🟢 0.53 / 0.27 / +100.1%
clickbench-sorted_q41/duckdb:vortex-file-compressed 21363242 / 32315960 / -33.9% 🟢 40483355 / 121494475 / -66.7% 🟢 0.53 / 0.27 / +98.4%
clickbench-sorted_q42/duckdb:vortex-file-compressed 19114030 / 28825318 / -33.7% 🟢 34805486 / 104691430 / -66.8% 🟢 0.55 / 0.28 / +99.5%
duckdb / vortex-compact / ns (0.616x ✅, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 68579468 / 110740048 / -38.1% 🟢 93806830 / 193671621 / -51.6% 🟢 0.73 / 0.57 / +27.9%
clickbench-sorted_q24/duckdb:vortex-compact 28351449 / 32733526 / -13.4% 🟢 35065278 / 85544947 / -59.0% 🟢 0.81 / 0.38 / +111.3%
clickbench-sorted_q26/duckdb:vortex-compact 20681641 / 30264396 / -31.7% 🟢 27594884 / 88621818 / -68.9% 🟢 0.75 / 0.34 / +119.5%
clickbench-sorted_q36/duckdb:vortex-compact 42235520 / 72717776 / -41.9% 🟢 77078978 / 194967444 / -60.5% 🟢 0.55 / 0.37 / +46.9%
clickbench-sorted_q37/duckdb:vortex-compact 33004566 / 59278560 / -44.3% 🟢 65160894 / 169709302 / -61.6% 🟢 0.51 / 0.35 / +45.0%
clickbench-sorted_q38/duckdb:vortex-compact 34771032 / 63017914 / -44.8% 🟢 71925076 / 188302421 / -61.8% 🟢 0.48 / 0.33 / +44.5%
clickbench-sorted_q39/duckdb:vortex-compact 66312104 / 124986676 / -46.9% 🟢 104600274 / 256092731 / -59.2% 🟢 0.63 / 0.49 / +29.9%
clickbench-sorted_q40/duckdb:vortex-compact 20911902 / 33186037 / -37.0% 🟢 42342036 / 127433509 / -66.8% 🟢 0.49 / 0.26 / +89.6%
clickbench-sorted_q41/duckdb:vortex-compact 20013606 / 33638280 / -40.5% 🟢 41117516 / 126586425 / -67.5% 🟢 0.49 / 0.27 / +83.2%
clickbench-sorted_q42/duckdb:vortex-compact 16726602 / 27582510 / -39.4% 🟢 31674044 / 99778500 / -68.3% 🟢 0.53 / 0.28 / +91.0%
duckdb / parquet / ns (0.565x ✅, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 125858130 / 226608774 / -44.5% 🟢 142438698 / 253394212 / -43.8% 🟢 0.88 / 0.89 / -1.2%
clickbench-sorted_q24/duckdb:parquet 17665903 / 30326583 / -41.7% 🟢 26146981 / 54727313 / -52.2% 🟢 0.68 / 0.55 / +21.9%
clickbench-sorted_q26/duckdb:parquet 12851312 / 27649460 / -53.5% 🟢 21486323 / 44321046 / -51.5% 🟢 0.60 / 0.62 / -4.1%
clickbench-sorted_q36/duckdb:parquet 46010432 / 72655658 / -36.7% 🟢 64993559 / 99559062 / -34.7% 🟢 0.71 / 0.73 / -3.0%
clickbench-sorted_q37/duckdb:parquet 30433224 / 61362932 / -50.4% 🟢 46223557 / 92172378 / -49.9% 🟢 0.66 / 0.67 / -1.1%
clickbench-sorted_q38/duckdb:parquet 39837857 / 61961824 / -35.7% 🟢 56563454 / 94464780 / -40.1% 🟢 0.70 / 0.66 / +7.4%
clickbench-sorted_q39/duckdb:parquet 71814746 / 112055923 / -35.9% 🟢 87505131 / 164200107 / -46.7% 🟢 0.82 / 0.68 / +20.3%
clickbench-sorted_q40/duckdb:parquet 16892606 / 31234602 / -45.9% 🟢 35765456 / 73834150 / -51.6% 🟢 0.47 / 0.42 / +11.6%
clickbench-sorted_q41/duckdb:parquet 16840542 / 29645792 / -43.2% 🟢 37066432 / 66440846 / -44.2% 🟢 0.45 / 0.45 / +1.8%
clickbench-sorted_q42/duckdb:parquet 11451602 / 20640986 / -44.5% 🟢 22566881 / 43943230 / -48.6% 🟢 0.51 / 0.47 / +8.0%

File Size Changes (200 files changed, -0.0% overall, 87↑ 113↓)
File Scale Format Base HEAD Change %
hits_002.vortex 1.0 vortex-compact 124.15 MB 125.50 MB +1.35 MB +1.1%
hits_061.vortex 1.0 vortex-compact 123.47 MB 124.70 MB +1.23 MB +1.0%
hits_076.vortex 1.0 vortex-file-compressed 158.47 MB 159.83 MB +1.35 MB +0.9%
hits_093.vortex 1.0 vortex-compact 97.63 MB 98.45 MB +840.90 KB +0.8%
hits_066.vortex 1.0 vortex-file-compressed 162.38 MB 163.71 MB +1.33 MB +0.8%
hits_018.vortex 1.0 vortex-file-compressed 197.59 MB 199.03 MB +1.45 MB +0.7%
hits_041.vortex 1.0 vortex-compact 97.10 MB 97.78 MB +697.45 KB +0.7%
hits_074.vortex 1.0 vortex-file-compressed 197.26 MB 198.63 MB +1.36 MB +0.7%
hits_071.vortex 1.0 vortex-compact 105.55 MB 106.13 MB +592.41 KB +0.5%
hits_019.vortex 1.0 vortex-file-compressed 139.69 MB 140.42 MB +742.38 KB +0.5%
hits_045.vortex 1.0 vortex-file-compressed 138.78 MB 139.49 MB +726.84 KB +0.5%
hits_018.vortex 1.0 vortex-compact 152.88 MB 153.66 MB +798.99 KB +0.5%
hits_089.vortex 1.0 vortex-compact 98.77 MB 99.24 MB +482.89 KB +0.5%
hits_082.vortex 1.0 vortex-compact 105.79 MB 106.26 MB +476.84 KB +0.4%
hits_019.vortex 1.0 vortex-compact 106.18 MB 106.62 MB +447.49 KB +0.4%
hits_025.vortex 1.0 vortex-file-compressed 171.16 MB 171.85 MB +707.33 KB +0.4%
hits_048.vortex 1.0 vortex-compact 152.78 MB 153.39 MB +624.25 KB +0.4%
hits_090.vortex 1.0 vortex-compact 141.21 MB 141.72 MB +522.50 KB +0.4%
hits_058.vortex 1.0 vortex-file-compressed 154.16 MB 154.71 MB +557.35 KB +0.4%
hits_034.vortex 1.0 vortex-compact 133.37 MB 133.83 MB +476.20 KB +0.3%
hits_043.vortex 1.0 vortex-compact 94.26 MB 94.58 MB +330.02 KB +0.3%
hits_030.vortex 1.0 vortex-compact 98.03 MB 98.34 MB +320.65 KB +0.3%
hits_069.vortex 1.0 vortex-compact 99.70 MB 100.02 MB +324.56 KB +0.3%
hits_067.vortex 1.0 vortex-compact 98.45 MB 98.76 MB +318.41 KB +0.3%
hits_015.vortex 1.0 vortex-file-compressed 130.46 MB 130.83 MB +371.41 KB +0.3%
hits_086.vortex 1.0 vortex-compact 139.63 MB 140.02 MB +392.98 KB +0.3%
hits_036.vortex 1.0 vortex-file-compressed 170.71 MB 171.17 MB +470.11 KB +0.3%
hits_031.vortex 1.0 vortex-file-compressed 158.94 MB 159.35 MB +417.60 KB +0.3%
hits_075.vortex 1.0 vortex-file-compressed 188.28 MB 188.70 MB +426.03 KB +0.2%
hits_000.vortex 1.0 vortex-compact 98.20 MB 98.42 MB +220.59 KB +0.2%
hits_042.vortex 1.0 vortex-file-compressed 200.61 MB 201.04 MB +438.66 KB +0.2%
hits_095.vortex 1.0 vortex-file-compressed 153.38 MB 153.66 MB +290.32 KB +0.2%
hits_046.vortex 1.0 vortex-file-compressed 100.51 MB 100.69 MB +187.16 KB +0.2%
hits_096.vortex 1.0 vortex-compact 153.11 MB 153.38 MB +276.90 KB +0.2%
hits_057.vortex 1.0 vortex-compact 111.73 MB 111.92 MB +193.60 KB +0.2%
hits_077.vortex 1.0 vortex-compact 134.18 MB 134.40 MB +229.95 KB +0.2%
hits_024.vortex 1.0 vortex-compact 124.97 MB 125.17 MB +201.11 KB +0.2%
hits_055.vortex 1.0 vortex-file-compressed 199.18 MB 199.48 MB +305.16 KB +0.1%
hits_081.vortex 1.0 vortex-file-compressed 199.29 MB 199.57 MB +284.42 KB +0.1%
hits_077.vortex 1.0 vortex-file-compressed 171.58 MB 171.79 MB +219.90 KB +0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.34 MB 130.50 MB +161.92 KB +0.1%
hits_081.vortex 1.0 vortex-compact 153.58 MB 153.76 MB +186.02 KB +0.1%
hits_014.vortex 1.0 vortex-compact 133.74 MB 133.90 MB +156.67 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 198.52 MB 198.74 MB +226.69 KB +0.1%
hits_098.vortex 1.0 vortex-compact 103.76 MB 103.87 MB +108.63 KB +0.1%
hits_065.vortex 1.0 vortex-file-compressed 160.10 MB 160.26 MB +163.88 KB +0.1%
hits_075.vortex 1.0 vortex-compact 138.98 MB 139.10 MB +131.79 KB +0.1%
hits_011.vortex 1.0 vortex-compact 152.78 MB 152.92 MB +141.11 KB +0.1%
hits_030.vortex 1.0 vortex-file-compressed 130.89 MB 131.00 MB +109.35 KB +0.1%
hits_095.vortex 1.0 vortex-compact 110.53 MB 110.61 MB +87.62 KB +0.1%
hits_002.vortex 1.0 vortex-file-compressed 159.94 MB 160.06 MB +124.09 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.64 MB 101.71 MB +77.35 KB +0.1%
hits_062.vortex 1.0 vortex-compact 132.48 MB 132.57 MB +91.15 KB +0.1%
hits_094.vortex 1.0 vortex-compact 110.70 MB 110.77 MB +74.90 KB +0.1%
hits_083.vortex 1.0 vortex-compact 110.08 MB 110.15 MB +73.49 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 191.86 MB 191.98 MB +123.56 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.82 MB 153.90 MB +84.97 KB +0.1%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.25 MB +40.12 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 166.47 MB 166.55 MB +82.27 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.47 MB 130.53 MB +63.47 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.79 MB 159.86 MB +73.14 KB +0.0%
hits_052.vortex 1.0 vortex-file-compressed 129.89 MB 129.94 MB +54.45 KB +0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.04 MB 168.11 MB +67.35 KB +0.0%
hits_010.vortex 1.0 vortex-compact 123.31 MB 123.36 MB +47.93 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.09 MB 134.14 MB +50.09 KB +0.0%
hits_094.vortex 1.0 vortex-file-compressed 157.81 MB 157.86 MB +57.45 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.02 MB 146.07 MB +49.74 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 170.55 MB 170.60 MB +47.96 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 138.57 MB 138.60 MB +38.44 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.64 MB 125.67 MB +34.55 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 159.93 MB 159.97 MB +41.40 KB +0.0%
hits_056.vortex 1.0 vortex-compact 101.29 MB 101.31 MB +26.13 KB +0.0%
hits_001.vortex 1.0 vortex-file-compressed 188.08 MB 188.12 MB +48.25 KB +0.0%
hits_020.vortex 1.0 vortex-file-compressed 159.36 MB 159.39 MB +39.79 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.64 MB 110.67 MB +24.69 KB +0.0%
hits_074.vortex 1.0 vortex-compact 152.92 MB 152.95 MB +30.29 KB +0.0%
hits_044.vortex 1.0 vortex-compact 153.60 MB 153.63 MB +30.02 KB +0.0%
hits_050.vortex 1.0 vortex-compact 125.37 MB 125.39 MB +24.04 KB +0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.21 MB 159.24 MB +28.41 KB +0.0%
hits_004.vortex 1.0 vortex-compact 98.30 MB 98.31 MB +14.59 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 199.15 MB 199.18 MB +29.46 KB +0.0%
hits_028.vortex 1.0 vortex-compact 115.68 MB 115.70 MB +16.57 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 190.52 MB 190.54 MB +22.25 KB +0.0%
hits_072.vortex 1.0 vortex-compact 75.55 MB 75.55 MB +7.07 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.77 MB 145.79 MB +13.08 KB +0.0%
hits_001.vortex 1.0 vortex-compact 139.00 MB 139.00 MB +4.48 KB +0.0%
hits_040.vortex 1.0 vortex-compact 109.95 MB 109.96 MB +1.12 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.66 MB 141.66 MB 472 B -0.0%
hits_016.vortex 1.0 vortex-compact 127.39 MB 127.39 MB 3.58 KB -0.0%
hits_035.vortex 1.0 vortex-compact 75.91 MB 75.91 MB 2.98 KB -0.0%
hits_036.vortex 1.0 vortex-compact 133.35 MB 133.35 MB 5.45 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.32 MB 160.31 MB 9.70 KB -0.0%
hits_060.vortex 1.0 vortex-compact 141.18 MB 141.17 MB 8.62 KB -0.0%
hits_062.vortex 1.0 vortex-file-compressed 169.98 MB 169.97 MB 13.85 KB -0.0%
hits_021.vortex 1.0 vortex-compact 110.62 MB 110.61 MB 10.95 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.10 MB 130.08 MB 15.30 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 180.94 MB 180.91 MB 21.77 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.61 MB 153.59 MB 22.30 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.00 MB 189.97 MB 27.59 KB -0.0%
hits_022.vortex 1.0 vortex-file-compressed 198.42 MB 198.39 MB 30.82 KB -0.0%
hits_042.vortex 1.0 vortex-compact 136.26 MB 136.24 MB 24.56 KB -0.0%
hits_041.vortex 1.0 vortex-file-compressed 130.25 MB 130.22 MB 28.36 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.20 MB 156.17 MB 34.23 KB -0.0%
hits_038.vortex 1.0 vortex-compact 139.54 MB 139.51 MB 32.06 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.61 MB 110.58 MB 26.59 KB -0.0%
hits_025.vortex 1.0 vortex-compact 133.47 MB 133.44 MB 33.40 KB -0.0%
hits_090.vortex 1.0 vortex-file-compressed 191.56 MB 191.52 MB 48.21 KB -0.0%
hits_031.vortex 1.0 vortex-compact 111.55 MB 111.52 MB 30.72 KB -0.0%
hits_068.vortex 1.0 vortex-compact 112.49 MB 112.46 MB 31.17 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.19 MB 126.16 MB 35.18 KB -0.0%
hits_044.vortex 1.0 vortex-file-compressed 199.40 MB 199.34 MB 58.51 KB -0.0%
hits_007.vortex 1.0 vortex-file-compressed 199.47 MB 199.41 MB 60.84 KB -0.0%
hits_065.vortex 1.0 vortex-compact 124.17 MB 124.13 MB 37.95 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 159.46 MB 159.41 MB 49.61 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.46 MB 153.41 MB 48.20 KB -0.0%
hits_047.vortex 1.0 vortex-compact 110.48 MB 110.45 MB 34.75 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 160.01 MB 159.95 MB 54.50 KB -0.0%
hits_008.vortex 1.0 vortex-compact 105.70 MB 105.66 MB 41.29 KB -0.0%
hits_097.vortex 1.0 vortex-compact 141.89 MB 141.83 MB 62.35 KB -0.0%
hits_022.vortex 1.0 vortex-compact 153.11 MB 153.05 MB 68.91 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.57 MB 104.52 MB 47.06 KB -0.0%
hits_099.vortex 1.0 vortex-compact 133.06 MB 133.00 MB 64.83 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.60 MB 179.52 MB 87.97 KB -0.0%
hits_087.vortex 1.0 vortex-compact 125.77 MB 125.70 MB 62.09 KB -0.0%
hits_027.vortex 1.0 vortex-compact 139.29 MB 139.23 MB 68.97 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 171.36 MB 171.27 MB 85.87 KB -0.0%
hits_033.vortex 1.0 vortex-compact 153.50 MB 153.42 MB 78.75 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.77 MB 130.70 MB 68.14 KB -0.1%
hits_020.vortex 1.0 vortex-compact 111.66 MB 111.60 MB 62.02 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.20 MB 192.08 MB 121.77 KB -0.1%
hits_088.vortex 1.0 vortex-compact 133.96 MB 133.88 MB 87.34 KB -0.1%
hits_079.vortex 1.0 vortex-compact 128.04 MB 127.94 MB 95.02 KB -0.1%
hits_038.vortex 1.0 vortex-file-compressed 189.15 MB 189.01 MB 141.72 KB -0.1%
hits_029.vortex 1.0 vortex-compact 153.48 MB 153.35 MB 129.41 KB -0.1%
hits_045.vortex 1.0 vortex-compact 106.14 MB 106.06 MB 90.06 KB -0.1%
hits_043.vortex 1.0 vortex-file-compressed 125.93 MB 125.82 MB 108.83 KB -0.1%
hits_059.vortex 1.0 vortex-compact 153.09 MB 152.96 MB 133.23 KB -0.1%
hits_046.vortex 1.0 vortex-compact 74.97 MB 74.90 MB 67.30 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 138.79 MB 138.66 MB 127.26 KB -0.1%
hits_023.vortex 1.0 vortex-file-compressed 194.38 MB 194.20 MB 182.27 KB -0.1%
hits_092.vortex 1.0 vortex-compact 153.50 MB 153.36 MB 144.33 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 198.85 MB 198.67 MB 194.23 KB -0.1%
hits_084.vortex 1.0 vortex-file-compressed 153.70 MB 153.55 MB 155.24 KB -0.1%
hits_055.vortex 1.0 vortex-compact 153.43 MB 153.28 MB 155.94 KB -0.1%
hits_003.vortex 1.0 vortex-file-compressed 135.78 MB 135.64 MB 138.02 KB -0.1%
hits_012.vortex 1.0 vortex-compact 140.02 MB 139.88 MB 143.43 KB -0.1%
hits_064.vortex 1.0 vortex-compact 140.14 MB 140.00 MB 144.34 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.80 MB 130.67 MB 134.87 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.09 MB 171.88 MB 217.57 KB -0.1%
hits_037.vortex 1.0 vortex-file-compressed 176.57 MB 176.36 MB 223.41 KB -0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.02 MB 171.80 MB 219.00 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.73 MB 100.60 MB 133.04 KB -0.1%
hits_085.vortex 1.0 vortex-compact 153.33 MB 153.12 MB 214.16 KB -0.1%
hits_029.vortex 1.0 vortex-file-compressed 199.65 MB 199.37 MB 283.82 KB -0.1%
hits_059.vortex 1.0 vortex-file-compressed 198.84 MB 198.53 MB 318.88 KB -0.2%
hits_089.vortex 1.0 vortex-file-compressed 130.95 MB 130.72 MB 233.07 KB -0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.36 MB 102.18 MB 189.90 KB -0.2%
hits_051.vortex 1.0 vortex-compact 134.22 MB 133.97 MB 257.38 KB -0.2%
hits_068.vortex 1.0 vortex-file-compressed 159.88 MB 159.57 MB 315.03 KB -0.2%
hits_039.vortex 1.0 vortex-compact 124.33 MB 124.09 MB 247.25 KB -0.2%
hits_066.vortex 1.0 vortex-compact 118.12 MB 117.89 MB 243.45 KB -0.2%
hits_033.vortex 1.0 vortex-file-compressed 199.66 MB 199.25 MB 427.72 KB -0.2%
hits_079.vortex 1.0 vortex-file-compressed 180.43 MB 180.05 MB 389.20 KB -0.2%
hits_054.vortex 1.0 vortex-compact 112.30 MB 112.05 MB 256.23 KB -0.2%
hits_080.vortex 1.0 vortex-compact 96.61 MB 96.39 MB 227.18 KB -0.2%
hits_007.vortex 1.0 vortex-compact 153.94 MB 153.54 MB 414.56 KB -0.3%
hits_037.vortex 1.0 vortex-compact 132.88 MB 132.47 MB 420.41 KB -0.3%
hits_085.vortex 1.0 vortex-file-compressed 198.93 MB 198.26 MB 684.82 KB -0.3%
hits_006.vortex 1.0 vortex-compact 96.27 MB 95.94 MB 344.33 KB -0.3%
hits_067.vortex 1.0 vortex-file-compressed 131.20 MB 130.74 MB 473.06 KB -0.4%
hits_091.vortex 1.0 vortex-compact 112.26 MB 111.86 MB 406.85 KB -0.4%
hits_098.vortex 1.0 vortex-file-compressed 137.39 MB 136.89 MB 512.08 KB -0.4%
hits_053.vortex 1.0 vortex-file-compressed 190.02 MB 189.32 MB 712.21 KB -0.4%
hits_039.vortex 1.0 vortex-file-compressed 160.68 MB 160.06 MB 628.20 KB -0.4%
hits_000.vortex 1.0 vortex-file-compressed 131.10 MB 130.57 MB 540.77 KB -0.4%
hits_005.vortex 1.0 vortex-compact 116.33 MB 115.86 MB 481.72 KB -0.4%
hits_058.vortex 1.0 vortex-compact 111.75 MB 111.29 MB 470.88 KB -0.4%
hits_051.vortex 1.0 vortex-file-compressed 172.43 MB 171.70 MB 744.74 KB -0.4%
hits_053.vortex 1.0 vortex-compact 139.01 MB 138.42 MB 604.16 KB -0.4%
hits_048.vortex 1.0 vortex-file-compressed 198.89 MB 198.00 MB 910.16 KB -0.4%
hits_040.vortex 1.0 vortex-file-compressed 142.73 MB 142.07 MB 668.75 KB -0.5%
hits_028.vortex 1.0 vortex-file-compressed 151.58 MB 150.88 MB 712.56 KB -0.5%
hits_026.vortex 1.0 vortex-compact 99.01 MB 98.54 MB 478.81 KB -0.5%
hits_070.vortex 1.0 vortex-compact 153.62 MB 152.88 MB 753.55 KB -0.5%
hits_063.vortex 1.0 vortex-compact 98.94 MB 98.46 MB 488.70 KB -0.5%
hits_052.vortex 1.0 vortex-compact 98.46 MB 97.98 MB 495.16 KB -0.5%
hits_056.vortex 1.0 vortex-file-compressed 135.23 MB 134.54 MB 706.66 KB -0.5%
hits_071.vortex 1.0 vortex-file-compressed 139.42 MB 138.71 MB 728.62 KB -0.5%
hits_054.vortex 1.0 vortex-file-compressed 146.77 MB 145.96 MB 826.19 KB -0.5%
hits_027.vortex 1.0 vortex-file-compressed 191.13 MB 190.02 MB 1.11 MB -0.6%
hits_015.vortex 1.0 vortex-compact 98.24 MB 97.64 MB 607.05 KB -0.6%
hits_078.vortex 1.0 vortex-compact 97.77 MB 97.15 MB 638.12 KB -0.6%
hits_017.vortex 1.0 vortex-compact 112.48 MB 111.72 MB 778.78 KB -0.7%
hits_023.vortex 1.0 vortex-compact 142.68 MB 141.67 MB 1.01 MB -0.7%
hits_076.vortex 1.0 vortex-compact 125.51 MB 124.61 MB 926.74 KB -0.7%
hits_070.vortex 1.0 vortex-file-compressed 199.66 MB 198.20 MB 1.46 MB -0.7%
hits_049.vortex 1.0 vortex-compact 140.49 MB 139.38 MB 1.11 MB -0.8%
hits_086.vortex 1.0 vortex-file-compressed 193.18 MB 191.45 MB 1.73 MB -0.9%
hits_064.vortex 1.0 vortex-file-compressed 193.54 MB 191.55 MB 1.98 MB -1.0%
hits_013.vortex 1.0 vortex-compact 125.31 MB 123.92 MB 1.38 MB -1.1%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (-0.0%)
  • vortex-file-compressed: 15.88 GB → 15.88 GB (-0.0%)

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -15.6%
Engines: DataFusion No clear signal (-13.9%, environment too noisy confidence) · DuckDB No clear signal (-17.2%, environment too noisy confidence)
Vortex (geomean): hot 0.642x ✅ · cold 0.513x ✅
Parquet (geomean): hot 0.761x ✅ · cold 0.608x ✅
Shifts: Parquet (control) -23.9% · Median polish -29.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.765x ✅, 90↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24133444 / 29725591 / -18.8% 🟢 43710302 / 80334839 / -45.6% 🟢 0.55 / 0.37 / +49.2%
tpcds_q02/datafusion:vortex-file-compressed 45352842 / 50898544 / -10.9% 🟢 62414785 / 103000460 / -39.4% 🟢 0.73 / 0.49 / +47.0%
tpcds_q03/datafusion:vortex-file-compressed 11452020 / 15032395 / -23.8% 🟢 29376803 / 60087583 / -51.1% 🟢 0.39 / 0.25 / +55.8%
tpcds_q04/datafusion:vortex-file-compressed 112777166 / 193361345 / -41.7% 🟢 140511351 / 270367699 / -48.0% 🟢 0.80 / 0.72 / +12.2%
tpcds_q05/datafusion:vortex-file-compressed 58353594 / 62284902 / -6.3% 81061606 / 126528969 / -35.9% 🟢 0.72 / 0.49 / +46.2%
tpcds_q06/datafusion:vortex-file-compressed 23251848 / 26492492 / -12.2% 🟢 46116335 / 82049900 / -43.8% 🟢 0.50 / 0.32 / +56.2%
tpcds_q07/datafusion:vortex-file-compressed 31573896 / 42198112 / -25.2% 🟢 56658818 / 110536482 / -48.7% 🟢 0.56 / 0.38 / +46.0%
tpcds_q08/datafusion:vortex-file-compressed 25836636 / 29474975 / -12.3% 🟢 45877143 / 84067582 / -45.4% 🟢 0.56 / 0.35 / +60.6%
tpcds_q09/datafusion:vortex-file-compressed 18961722 / 25261890 / -24.9% 🟢 36112538 / 69741837 / -48.2% 🟢 0.53 / 0.36 / +45.0%
tpcds_q10/datafusion:vortex-file-compressed 29645800 / 37725123 / -21.4% 🟢 49801775 / 92740842 / -46.3% 🟢 0.60 / 0.41 / +46.3%
tpcds_q11/datafusion:vortex-file-compressed 61060352 / 108551871 / -43.8% 🟢 85957707 / 172579932 / -50.2% 🟢 0.71 / 0.63 / +12.9%
tpcds_q12/datafusion:vortex-file-compressed 16131894 / 20024108 / -19.4% 🟢 33025850 / 67350516 / -51.0% 🟢 0.49 / 0.30 / +64.3%
tpcds_q13/datafusion:vortex-file-compressed 36777388 / 40828130 / -9.9% 59908972 / 94094996 / -36.3% 🟢 0.61 / 0.43 / +41.5%
tpcds_q14/datafusion:vortex-file-compressed 97063340 / 140201920 / -30.8% 🟢 122988348 / 206294530 / -40.4% 🟢 0.79 / 0.68 / +16.1%
tpcds_q15/datafusion:vortex-file-compressed 25241598 / 30073392 / -16.1% 🟢 45425068 / 83369809 / -45.5% 🟢 0.56 / 0.36 / +54.0%
tpcds_q16/datafusion:vortex-file-compressed 21540434 / 26719631 / -19.4% 🟢 42363981 / 77246709 / -45.2% 🟢 0.51 / 0.35 / +47.0%
tpcds_q17/datafusion:vortex-file-compressed 60422494 / 69563710 / -13.1% 🟢 74580093 / 135505219 / -45.0% 🟢 0.81 / 0.51 / +57.8%
tpcds_q18/datafusion:vortex-file-compressed 68132709 / 81121088 / -16.0% 🟢 96386144 / 160458493 / -39.9% 🟢 0.71 / 0.51 / +39.8%
tpcds_q19/datafusion:vortex-file-compressed 18425448 / 24069269 / -23.4% 🟢 42009979 / 77139913 / -45.5% 🟢 0.44 / 0.31 / +40.6%
tpcds_q20/datafusion:vortex-file-compressed 17443185 / 24394868 / -28.5% 🟢 34909361 / 73230887 / -52.3% 🟢 0.50 / 0.33 / +50.0%
tpcds_q21/datafusion:vortex-file-compressed 16893696 / 28549633 / -40.8% 🟢 40131308 / 88538675 / -54.7% 🟢 0.42 / 0.32 / +30.5%
tpcds_q22/datafusion:vortex-file-compressed 49787780 / 115114028 / -56.7% 🟢 70373125 / 178665398 / -60.6% 🟢 0.71 / 0.64 / +9.8%
tpcds_q23/datafusion:vortex-file-compressed 71334716 / 130428042 / -45.3% 🟢 99852940 / 201986391 / -50.6% 🟢 0.71 / 0.65 / +10.6%
tpcds_q24/datafusion:vortex-file-compressed 68833780 / 83439470 / -17.5% 🟢 95449192 / 152602761 / -37.5% 🟢 0.72 / 0.55 / +31.9%
tpcds_q25/datafusion:vortex-file-compressed 47240020 / 66598732 / -29.1% 🟢 83211633 / 144184315 / -42.3% 🟢 0.57 / 0.46 / +22.9%
tpcds_q26/datafusion:vortex-file-compressed 30112806 / 37687302 / -20.1% 🟢 53577007 / 91779791 / -41.6% 🟢 0.56 / 0.41 / +36.9%
tpcds_q27/datafusion:vortex-file-compressed 59118866 / 93420699 / -36.7% 🟢 87333489 / 168406286 / -48.1% 🟢 0.68 / 0.55 / +22.0%
tpcds_q28/datafusion:vortex-file-compressed 18180028 / 23992670 / -24.2% 🟢 36524509 / 70597634 / -48.3% 🟢 0.50 / 0.34 / +46.5%
tpcds_q29/datafusion:vortex-file-compressed 60549214 / 67920980 / -10.9% 🟢 83043273 / 141910843 / -41.5% 🟢 0.73 / 0.48 / +52.3%
tpcds_q30/datafusion:vortex-file-compressed 28327711 / 33479842 / -15.4% 🟢 46791534 / 87023543 / -46.2% 🟢 0.61 / 0.38 / +57.4%
tpcds_q31/datafusion:vortex-file-compressed 62788294 / 74346504 / -15.5% 🟢 91226021 / 143071339 / -36.2% 🟢 0.69 / 0.52 / +32.5%
tpcds_q32/datafusion:vortex-file-compressed 13792524 / 17703222 / -22.1% 🟢 31747851 / 61052051 / -48.0% 🟢 0.43 / 0.29 / +49.8%
tpcds_q33/datafusion:vortex-file-compressed 26950550 / 33592549 / -19.8% 🟢 49370767 / 90042117 / -45.2% 🟢 0.55 / 0.37 / +46.3%
tpcds_q34/datafusion:vortex-file-compressed 18051023 / 24923604 / -27.6% 🟢 36927054 / 77054180 / -52.1% 🟢 0.49 / 0.32 / +51.1%
tpcds_q35/datafusion:vortex-file-compressed 35008380 / 51194710 / -31.6% 🟢 57701060 / 106939320 / -46.0% 🟢 0.61 / 0.48 / +26.7%
tpcds_q36/datafusion:vortex-file-compressed 48020665 / 59564882 / -19.4% 🟢 73751267 / 133095019 / -44.6% 🟢 0.65 / 0.45 / +45.5%
tpcds_q37/datafusion:vortex-file-compressed 12974866 / 17255730 / -24.8% 🟢 35585896 / 67684301 / -47.4% 🟢 0.36 / 0.25 / +43.0%
tpcds_q38/datafusion:vortex-file-compressed 30920860 / 38731400 / -20.2% 🟢 52174114 / 91259150 / -42.8% 🟢 0.59 / 0.42 / +39.6%
tpcds_q39/datafusion:vortex-file-compressed 65038795 / 94813761 / -31.4% 🟢 93698947 / 152095392 / -38.4% 🟢 0.69 / 0.62 / +11.3%
tpcds_q40/datafusion:vortex-file-compressed 25048602 / 31178573 / -19.7% 🟢 47551174 / 90860276 / -47.7% 🟢 0.53 / 0.34 / +53.5%
tpcds_q41/datafusion:vortex-file-compressed 16306666 / 18813688 / -13.3% 🟢 30995652 / 59542575 / -47.9% 🟢 0.53 / 0.32 / +66.5%
tpcds_q42/datafusion:vortex-file-compressed 11072746 / 13693868 / -19.1% 🟢 29548453 / 58757431 / -49.7% 🟢 0.37 / 0.23 / +60.8%
tpcds_q43/datafusion:vortex-file-compressed 12725970 / 17851176 / -28.7% 🟢 32670966 / 67040384 / -51.3% 🟢 0.39 / 0.27 / +46.3%
tpcds_q44/datafusion:vortex-file-compressed 26682328 / 32795410 / -18.6% 🟢 50493666 / 89916073 / -43.8% 🟢 0.53 / 0.36 / +44.9%
tpcds_q45/datafusion:vortex-file-compressed 28275060 / 32063804 / -11.8% 🟢 49423850 / 86715532 / -43.0% 🟢 0.57 / 0.37 / +54.7%
tpcds_q46/datafusion:vortex-file-compressed 23692998 / 32390990 / -26.9% 🟢 48734245 / 93478587 / -47.9% 🟢 0.49 / 0.35 / +40.3%
tpcds_q47/datafusion:vortex-file-compressed 76855496 / 116526812 / -34.0% 🟢 104357145 / 196183308 / -46.8% 🟢 0.74 / 0.59 / +24.0%
tpcds_q48/datafusion:vortex-file-compressed 32184770 / 32538212 / -1.1% 54279979 / 89374397 / -39.3% 🟢 0.59 / 0.36 / +62.9%
tpcds_q49/datafusion:vortex-file-compressed 58351107 / 64693212 / -9.8% 82925972 / 125616087 / -34.0% 🟢 0.70 / 0.52 / +36.6%
tpcds_q50/datafusion:vortex-file-compressed 32834760 / 44241434 / -25.8% 🟢 56831538 / 99291735 / -42.8% 🟢 0.58 / 0.45 / +29.7%
tpcds_q51/datafusion:vortex-file-compressed 60959396 / 71684813 / -15.0% 🟢 85224638 / 137307292 / -37.9% 🟢 0.72 / 0.52 / +37.0%
tpcds_q52/datafusion:vortex-file-compressed 11251370 / 14277214 / -21.2% 🟢 29759117 / 59350351 / -49.9% 🟢 0.38 / 0.24 / +57.2%
tpcds_q53/datafusion:vortex-file-compressed 18406579 / 21850184 / -15.8% 🟢 39518461 / 72086592 / -45.2% 🟢 0.47 / 0.30 / +53.7%
tpcds_q54/datafusion:vortex-file-compressed 33414127 / 36935378 / -9.5% 60426657 / 92046337 / -34.4% 🟢 0.55 / 0.40 / +37.8%
tpcds_q55/datafusion:vortex-file-compressed 11105563 / 14143113 / -21.5% 🟢 27482555 / 58534335 / -53.0% 🟢 0.40 / 0.24 / +67.2%
tpcds_q56/datafusion:vortex-file-compressed 26511658 / 32082754 / -17.4% 🟢 49690562 / 94909564 / -47.6% 🟢 0.53 / 0.34 / +57.8%
tpcds_q57/datafusion:vortex-file-compressed 73342412 / 93113214 / -21.2% 🟢 98811344 / 171816884 / -42.5% 🟢 0.74 / 0.54 / +37.0%
tpcds_q58/datafusion:vortex-file-compressed 40446565 / 54301881 / -25.5% 🟢 65621861 / 120798981 / -45.7% 🟢 0.62 / 0.45 / +37.1%
tpcds_q59/datafusion:vortex-file-compressed 30962406 / 52714802 / -41.3% 🟢 52401309 / 107741560 / -51.4% 🟢 0.59 / 0.49 / +20.8%
tpcds_q60/datafusion:vortex-file-compressed 26915479 / 32743882 / -17.8% 🟢 48366142 / 84684172 / -42.9% 🟢 0.56 / 0.39 / +43.9%
tpcds_q61/datafusion:vortex-file-compressed 23157236 / 39034022 / -40.7% 🟢 49184549 / 98195980 / -49.9% 🟢 0.47 / 0.40 / +18.4%
tpcds_q62/datafusion:vortex-file-compressed 17511648 / 23679512 / -26.0% 🟢 35974861 / 73672245 / -51.2% 🟢 0.49 / 0.32 / +51.4%
tpcds_q63/datafusion:vortex-file-compressed 18020025 / 22056618 / -18.3% 🟢 38688557 / 74141506 / -47.8% 🟢 0.47 / 0.30 / +56.6%
tpcds_q64/datafusion:vortex-file-compressed 326385272 / 365210196 / -10.6% 🟢 356962588 / 481165364 / -25.8% 🟢 0.91 / 0.76 / +20.5%
tpcds_q65/datafusion:vortex-file-compressed 74566072 / 65624564 / +13.6% 🔴 95008284 / 129514990 / -26.6% 🟢 0.78 / 0.51 / +54.9%
tpcds_q66/datafusion:vortex-file-compressed 52672379 / 71793447 / -26.6% 🟢 76758052 / 138795572 / -44.7% 🟢 0.69 / 0.52 / +32.7%
tpcds_q67/datafusion:vortex-file-compressed 54722344 / 109686252 / -50.1% 🟢 83059489 / 197058493 / -57.9% 🟢 0.66 / 0.56 / +18.4%
tpcds_q68/datafusion:vortex-file-compressed 22945797 / 31106142 / -26.2% 🟢 50139126 / 101457444 / -50.6% 🟢 0.46 / 0.31 / +49.3%
tpcds_q69/datafusion:vortex-file-compressed 28182172 / 38056830 / -25.9% 🟢 48784939 / 89202035 / -45.3% 🟢 0.58 / 0.43 / +35.4%
tpcds_q70/datafusion:vortex-file-compressed 69137586 / 108826342 / -36.5% 🟢 94307177 / 171806354 / -45.1% 🟢 0.73 / 0.63 / +15.7%
tpcds_q71/datafusion:vortex-file-compressed 20070184 / 24458812 / -17.9% 🟢 40398668 / 81698277 / -50.6% 🟢 0.50 / 0.30 / +65.9%
tpcds_q72/datafusion:vortex-file-compressed 464571664 / 1448095803 / -67.9% 🟢 474343590 / 1560943442 / -69.6% 🟢 0.98 / 0.93 / +5.6%
tpcds_q73/datafusion:vortex-file-compressed 16390652 / 24332816 / -32.6% 🟢 38038449 / 81094020 / -53.1% 🟢 0.43 / 0.30 / +43.6%
tpcds_q74/datafusion:vortex-file-compressed 44363614 / 70064732 / -36.7% 🟢 67739427 / 130828331 / -48.2% 🟢 0.65 / 0.54 / +22.3%
tpcds_q75/datafusion:vortex-file-compressed 130754633 / 133822072 / -2.3% 158314074 / 215689593 / -26.6% 🟢 0.83 / 0.62 / +33.1%
tpcds_q76/datafusion:vortex-file-compressed 42116646 / 37958649 / +11.0% 🔴 62246763 / 96193756 / -35.3% 🟢 0.68 / 0.39 / +71.5%
tpcds_q77/datafusion:vortex-file-compressed 35872322 / 41727915 / -14.0% 🟢 58131245 / 107301178 / -45.8% 🟢 0.62 / 0.39 / +58.7%
tpcds_q78/datafusion:vortex-file-compressed 79545828 / 106841621 / -25.5% 🟢 106305878 / 184497685 / -42.4% 🟢 0.75 / 0.58 / +29.2%
tpcds_q79/datafusion:vortex-file-compressed 20283334 / 26778659 / -24.3% 🟢 42051555 / 82011315 / -48.7% 🟢 0.48 / 0.33 / +47.7%
tpcds_q80/datafusion:vortex-file-compressed 76744122 / 96777830 / -20.7% 🟢 105268563 / 193615365 / -45.6% 🟢 0.73 / 0.50 / +45.9%
tpcds_q81/datafusion:vortex-file-compressed 28051488 / 35603198 / -21.2% 🟢 46966068 / 84203718 / -44.2% 🟢 0.60 / 0.42 / +41.3%
tpcds_q82/datafusion:vortex-file-compressed 13487449 / 17491660 / -22.9% 🟢 37978326 / 69860567 / -45.6% 🟢 0.36 / 0.25 / +41.8%
tpcds_q83/datafusion:vortex-file-compressed 37138347 / 45865178 / -19.0% 🟢 57162056 / 98939260 / -42.2% 🟢 0.65 / 0.46 / +40.2%
tpcds_q84/datafusion:vortex-file-compressed 12124360 / 15902404 / -23.8% 🟢 28600273 / 53468774 / -46.5% 🟢 0.42 / 0.30 / +42.5%
tpcds_q85/datafusion:vortex-file-compressed 61871287 / 63498582 / -2.6% 87243877 / 136143765 / -35.9% 🟢 0.71 / 0.47 / +52.1%
tpcds_q86/datafusion:vortex-file-compressed 16173618 / 19589071 / -17.4% 🟢 33067923 / 62185903 / -46.8% 🟢 0.49 / 0.32 / +55.3%
tpcds_q87/datafusion:vortex-file-compressed 30232238 / 38973076 / -22.4% 🟢 52176962 / 95358641 / -45.3% 🟢 0.58 / 0.41 / +41.8%
tpcds_q88/datafusion:vortex-file-compressed 32302388 / 50367776 / -35.9% 🟢 59509719 / 116302342 / -48.8% 🟢 0.54 / 0.43 / +25.3%
tpcds_q89/datafusion:vortex-file-compressed 20747044 / 25733456 / -19.4% 🟢 41225548 / 77662250 / -46.9% 🟢 0.50 / 0.33 / +51.9%
tpcds_q90/datafusion:vortex-file-compressed 11358694 / 14492588 / -21.6% 🟢 28743161 / 54242665 / -47.0% 🟢 0.40 / 0.27 / +47.9%
tpcds_q91/datafusion:vortex-file-compressed 17953650 / 22461810 / -20.1% 🟢 38049976 / 71175127 / -46.5% 🟢 0.47 / 0.32 / +49.5%
tpcds_q92/datafusion:vortex-file-compressed 14248894 / 17424226 / -18.2% 🟢 32556795 / 62799055 / -48.2% 🟢 0.44 / 0.28 / +57.7%
tpcds_q93/datafusion:vortex-file-compressed 22902440 / 30198057 / -24.2% 🟢 45044633 / 86103343 / -47.7% 🟢 0.51 / 0.35 / +45.0%
tpcds_q94/datafusion:vortex-file-compressed 20004572 / 24243276 / -17.5% 🟢 41357453 / 72361315 / -42.8% 🟢 0.48 / 0.34 / +44.4%
tpcds_q95/datafusion:vortex-file-compressed 47340161 / 53510701 / -11.5% 🟢 67644862 / 112293622 / -39.8% 🟢 0.70 / 0.48 / +46.9%
tpcds_q96/datafusion:vortex-file-compressed 8269784 / 11802814 / -29.9% 🟢 26187773 / 55474153 / -52.8% 🟢 0.32 / 0.21 / +48.4%
tpcds_q97/datafusion:vortex-file-compressed 21053752 / 27280985 / -22.8% 🟢 41811909 / 83887125 / -50.2% 🟢 0.50 / 0.33 / +54.8%
tpcds_q98/datafusion:vortex-file-compressed 16689414 / 22433524 / -25.6% 🟢 35801902 / 77419930 / -53.8% 🟢 0.47 / 0.29 / +60.9%
tpcds_q99/datafusion:vortex-file-compressed 19776952 / 27573132 / -28.3% 🟢 40900190 / 78457347 / -47.9% 🟢 0.48 / 0.35 / +37.6%
datafusion / vortex-compact / ns (0.696x ✅, 95↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25736479 / 32039322 / -19.7% 🟢 45444870 / 87807621 / -48.2% 🟢 0.57 / 0.36 / +55.2%
tpcds_q02/datafusion:vortex-compact 47928591 / 58927086 / -18.7% 🟢 64837346 / 107424645 / -39.6% 🟢 0.74 / 0.55 / +34.8%
tpcds_q03/datafusion:vortex-compact 13265672 / 18649038 / -28.9% 🟢 33501755 / 67596788 / -50.4% 🟢 0.40 / 0.28 / +43.5%
tpcds_q04/datafusion:vortex-compact 122578806 / 223966339 / -45.3% 🟢 143251351 / 289881777 / -50.6% 🟢 0.86 / 0.77 / +10.8%
tpcds_q05/datafusion:vortex-compact 60987075 / 64677730 / -5.7% 82425725 / 132524368 / -37.8% 🟢 0.74 / 0.49 / +51.6%
tpcds_q06/datafusion:vortex-compact 25391474 / 30619416 / -17.1% 🟢 46468084 / 86719305 / -46.4% 🟢 0.55 / 0.35 / +54.8%
tpcds_q07/datafusion:vortex-compact 35138796 / 55465226 / -36.6% 🟢 58590550 / 112516067 / -47.9% 🟢 0.60 / 0.49 / +21.7%
tpcds_q08/datafusion:vortex-compact 30767811 / 35014104 / -12.1% 🟢 49421436 / 92891128 / -46.8% 🟢 0.62 / 0.38 / +65.2%
tpcds_q09/datafusion:vortex-compact 22168060 / 43730098 / -49.3% 🟢 39909483 / 90448212 / -55.9% 🟢 0.56 / 0.48 / +14.9%
tpcds_q10/datafusion:vortex-compact 38967054 / 56372852 / -30.9% 🟢 58682642 / 110001216 / -46.7% 🟢 0.66 / 0.51 / +29.6%
tpcds_q11/datafusion:vortex-compact 69238481 / 119373077 / -42.0% 🟢 92636735 / 187930809 / -50.7% 🟢 0.75 / 0.64 / +17.7%
tpcds_q12/datafusion:vortex-compact 20609452 / 26616022 / -22.6% 🟢 39907276 / 77134929 / -48.3% 🟢 0.52 / 0.35 / +49.7%
tpcds_q13/datafusion:vortex-compact 61188914 / 125891009 / -51.4% 🟢 81581297 / 192784195 / -57.7% 🟢 0.75 / 0.65 / +14.9%
tpcds_q14/datafusion:vortex-compact 93931997 / 153008959 / -38.6% 🟢 123996472 / 223631710 / -44.6% 🟢 0.76 / 0.68 / +10.7%
tpcds_q15/datafusion:vortex-compact 27159474 / 33039166 / -17.8% 🟢 45172569 / 83641144 / -46.0% 🟢 0.60 / 0.40 / +52.2%
tpcds_q16/datafusion:vortex-compact 23962260 / 33989498 / -29.5% 🟢 43145079 / 80154844 / -46.2% 🟢 0.56 / 0.42 / +31.0%
tpcds_q17/datafusion:vortex-compact 67760846 / 79450222 / -14.7% 🟢 94357589 / 152499405 / -38.1% 🟢 0.72 / 0.52 / +37.8%
tpcds_q18/datafusion:vortex-compact 69102256 / 92396928 / -25.2% 🟢 92451704 / 150677855 / -38.6% 🟢 0.75 / 0.61 / +21.9%
tpcds_q19/datafusion:vortex-compact 23003228 / 32857802 / -30.0% 🟢 46586981 / 86348089 / -46.0% 🟢 0.49 / 0.38 / +29.8%
tpcds_q20/datafusion:vortex-compact 21768158 / 30615238 / -28.9% 🟢 42156917 / 83491591 / -49.5% 🟢 0.52 / 0.37 / +40.8%
tpcds_q21/datafusion:vortex-compact 17622648 / 32089796 / -45.1% 🟢 41697905 / 93581080 / -55.4% 🟢 0.42 / 0.34 / +23.2%
tpcds_q22/datafusion:vortex-compact 50072225 / 128583820 / -61.1% 🟢 72077714 / 140962197 / -48.9% 🟢 0.69 / 0.91 / -23.8%
tpcds_q23/datafusion:vortex-compact 76739801 / 142570078 / -46.2% 🟢 99717673 / 205372498 / -51.4% 🟢 0.77 / 0.69 / +10.9%
tpcds_q24/datafusion:vortex-compact 76910334 / 96332526 / -20.2% 🟢 101560305 / 162828797 / -37.6% 🟢 0.76 / 0.59 / +28.0%
tpcds_q25/datafusion:vortex-compact 61506372 / 78341934 / -21.5% 🟢 77146490 / 154693394 / -50.1% 🟢 0.80 / 0.51 / +57.4%
tpcds_q26/datafusion:vortex-compact 32163546 / 48181457 / -33.2% 🟢 52364169 / 95352301 / -45.1% 🟢 0.61 / 0.51 / +21.6%
tpcds_q27/datafusion:vortex-compact 65804005 / 111738520 / -41.1% 🟢 86755129 / 180263773 / -51.9% 🟢 0.76 / 0.62 / +22.4%
tpcds_q28/datafusion:vortex-compact 26767107 / 65366723 / -59.1% 🟢 49234025 / 116435937 / -57.7% 🟢 0.54 / 0.56 / -3.2%
tpcds_q29/datafusion:vortex-compact 64535129 / 76253180 / -15.4% 🟢 86893942 / 146664116 / -40.8% 🟢 0.74 / 0.52 / +42.8%
tpcds_q30/datafusion:vortex-compact 29930469 / 38622652 / -22.5% 🟢 47807049 / 84712878 / -43.6% 🟢 0.63 / 0.46 / +37.3%
tpcds_q31/datafusion:vortex-compact 75962590 / 98493062 / -22.9% 🟢 102587594 / 167859236 / -38.9% 🟢 0.74 / 0.59 / +26.2%
tpcds_q32/datafusion:vortex-compact 16247464 / 22541080 / -27.9% 🟢 36493124 / 72696822 / -49.8% 🟢 0.45 / 0.31 / +43.6%
tpcds_q33/datafusion:vortex-compact 28532830 / 38117417 / -25.1% 🟢 51304822 / 100932285 / -49.2% 🟢 0.56 / 0.38 / +47.3%
tpcds_q34/datafusion:vortex-compact 22771294 / 34830300 / -34.6% 🟢 45065259 / 95447383 / -52.8% 🟢 0.51 / 0.36 / +38.5%
tpcds_q35/datafusion:vortex-compact 40776858 / 64663463 / -36.9% 🟢 67955721 / 121175622 / -43.9% 🟢 0.60 / 0.53 / +12.4%
tpcds_q36/datafusion:vortex-compact 51451859 / 70962680 / -27.5% 🟢 76392507 / 140880737 / -45.8% 🟢 0.67 / 0.50 / +33.7%
tpcds_q37/datafusion:vortex-compact 15953018 / 23146382 / -31.1% 🟢 37832697 / 74332622 / -49.1% 🟢 0.42 / 0.31 / +35.4%
tpcds_q38/datafusion:vortex-compact 34202736 / 46172920 / -25.9% 🟢 58337753 / 101225457 / -42.4% 🟢 0.59 / 0.46 / +28.5%
tpcds_q39/datafusion:vortex-compact 66507282 / 100089682 / -33.6% 🟢 87761003 / 156333290 / -43.9% 🟢 0.76 / 0.64 / +18.4%
tpcds_q40/datafusion:vortex-compact 28133158 / 36041886 / -21.9% 🟢 50802037 / 96163270 / -47.2% 🟢 0.55 / 0.37 / +47.8%
tpcds_q41/datafusion:vortex-compact 18321008 / 22210238 / -17.5% 🟢 32798308 / 56675339 / -42.1% 🟢 0.56 / 0.39 / +42.5%
tpcds_q42/datafusion:vortex-compact 11953692 / 17938902 / -33.4% 🟢 33040879 / 63083681 / -47.6% 🟢 0.36 / 0.28 / +27.2%
tpcds_q43/datafusion:vortex-compact 16094676 / 21728300 / -25.9% 🟢 34013048 / 70775445 / -51.9% 🟢 0.47 / 0.31 / +54.1%
tpcds_q44/datafusion:vortex-compact 31212047 / 46945254 / -33.5% 🟢 54097794 / 98081269 / -44.8% 🟢 0.58 / 0.48 / +20.5%
tpcds_q45/datafusion:vortex-compact 31065052 / 37627236 / -17.4% 🟢 49453558 / 87653864 / -43.6% 🟢 0.63 / 0.43 / +46.3%
tpcds_q46/datafusion:vortex-compact 27806496 / 42096621 / -33.9% 🟢 54040495 / 106741008 / -49.4% 🟢 0.51 / 0.39 / +30.5%
tpcds_q47/datafusion:vortex-compact 87147850 / 134498883 / -35.2% 🟢 113443438 / 210359253 / -46.1% 🟢 0.77 / 0.64 / +20.1%
tpcds_q48/datafusion:vortex-compact 50932616 / 93207850 / -45.4% 🟢 68729454 / 137945355 / -50.2% 🟢 0.74 / 0.68 / +9.7%
tpcds_q49/datafusion:vortex-compact 64847633 / 77064548 / -15.9% 🟢 93252323 / 133315987 / -30.1% 🟢 0.70 / 0.58 / +20.3%
tpcds_q50/datafusion:vortex-compact 36636570 / 48465614 / -24.4% 🟢 58608896 / 104396478 / -43.9% 🟢 0.63 / 0.46 / +34.6%
tpcds_q51/datafusion:vortex-compact 62425998 / 77109306 / -19.0% 🟢 85075683 / 135698499 / -37.3% 🟢 0.73 / 0.57 / +29.1%
tpcds_q52/datafusion:vortex-compact 13029837 / 18796274 / -30.7% 🟢 34481435 / 65476727 / -47.3% 🟢 0.38 / 0.29 / +31.6%
tpcds_q53/datafusion:vortex-compact 23127588 / 29233020 / -20.9% 🟢 45563517 / 81777294 / -44.3% 🟢 0.51 / 0.36 / +42.0%
tpcds_q54/datafusion:vortex-compact 39029038 / 47434492 / -17.7% 🟢 63092132 / 110098613 / -42.7% 🟢 0.62 / 0.43 / +43.6%
tpcds_q55/datafusion:vortex-compact 12395659 / 17795428 / -30.3% 🟢 34234521 / 65089440 / -47.4% 🟢 0.36 / 0.27 / +32.4%
tpcds_q56/datafusion:vortex-compact 27767208 / 38420383 / -27.7% 🟢 51308943 / 98485535 / -47.9% 🟢 0.54 / 0.39 / +38.7%
tpcds_q57/datafusion:vortex-compact 79244814 / 102378010 / -22.6% 🟢 104055802 / 173776329 / -40.1% 🟢 0.76 / 0.59 / +29.3%
tpcds_q58/datafusion:vortex-compact 46075646 / 64053870 / -28.1% 🟢 71133657 / 126442259 / -43.7% 🟢 0.65 / 0.51 / +27.9%
tpcds_q59/datafusion:vortex-compact 40042020 / 62093546 / -35.5% 🟢 59585207 / 116051231 / -48.7% 🟢 0.67 / 0.54 / +25.6%
tpcds_q60/datafusion:vortex-compact 28849674 / 35674642 / -19.1% 🟢 50737482 / 97195478 / -47.8% 🟢 0.57 / 0.37 / +54.9%
tpcds_q61/datafusion:vortex-compact 28327382 / 49556222 / -42.8% 🟢 49930876 / 109063556 / -54.2% 🟢 0.57 / 0.45 / +24.9%
tpcds_q62/datafusion:vortex-compact 17939631 / 25650920 / -30.1% 🟢 36011124 / 69685053 / -48.3% 🟢 0.50 / 0.37 / +35.3%
tpcds_q63/datafusion:vortex-compact 22346737 / 29672070 / -24.7% 🟢 43952623 / 82494725 / -46.7% 🟢 0.51 / 0.36 / +41.4%
tpcds_q64/datafusion:vortex-compact 451939040 / 516646908 / -12.5% 🟢 447318636 / 616975395 / -27.5% 🟢 1.01 / 0.84 / +20.7%
tpcds_q65/datafusion:vortex-compact 81565751 / 79775874 / +2.2% 100826608 / 138013345 / -26.9% 🟢 0.81 / 0.58 / +40.0%
tpcds_q66/datafusion:vortex-compact 54688784 / 74929967 / -27.0% 🟢 78341705 / 140139580 / -44.1% 🟢 0.70 / 0.53 / +30.6%
tpcds_q67/datafusion:vortex-compact 58528587 / 120394545 / -51.4% 🟢 87806463 / 199073423 / -55.9% 🟢 0.67 / 0.60 / +10.2%
tpcds_q68/datafusion:vortex-compact 27556148 / 43113000 / -36.1% 🟢 51239044 / 113091052 / -54.7% 🟢 0.54 / 0.38 / +41.1%
tpcds_q69/datafusion:vortex-compact 36648641 / 56321790 / -34.9% 🟢 57240342 / 107437942 / -46.7% 🟢 0.64 / 0.52 / +22.1%
tpcds_q70/datafusion:vortex-compact 74759301 / 116633186 / -35.9% 🟢 96160487 / 181274286 / -47.0% 🟢 0.78 / 0.64 / +20.8%
tpcds_q71/datafusion:vortex-compact 19104996 / 30623252 / -37.6% 🟢 44101733 / 88194396 / -50.0% 🟢 0.43 / 0.35 / +24.8%
tpcds_q72/datafusion:vortex-compact 466570482 / 1474750360 / -68.4% 🟢 487361186 / 1559768444 / -68.8% 🟢 0.96 / 0.95 / +1.3%
tpcds_q73/datafusion:vortex-compact 22151664 / 34007063 / -34.9% 🟢 41554435 / 91696864 / -54.7% 🟢 0.53 / 0.37 / +43.7%
tpcds_q74/datafusion:vortex-compact 49658030 / 80457416 / -38.3% 🟢 72877791 / 139640005 / -47.8% 🟢 0.68 / 0.58 / +18.3%
tpcds_q75/datafusion:vortex-compact 139063650 / 150364425 / -7.5% 160811487 / 229998685 / -30.1% 🟢 0.86 / 0.65 / +32.3%
tpcds_q76/datafusion:vortex-compact 41730448 / 45406590 / -8.1% 57457350 / 100281309 / -42.7% 🟢 0.73 / 0.45 / +60.4%
tpcds_q77/datafusion:vortex-compact 38140390 / 48902808 / -22.0% 🟢 59464227 / 113828807 / -47.8% 🟢 0.64 / 0.43 / +49.3%
tpcds_q78/datafusion:vortex-compact 84796048 / 120898254 / -29.9% 🟢 113307670 / 197753206 / -42.7% 🟢 0.75 / 0.61 / +22.4%
tpcds_q79/datafusion:vortex-compact 28216988 / 37445532 / -24.6% 🟢 45927005 / 90240884 / -49.1% 🟢 0.61 / 0.41 / +48.1%
tpcds_q80/datafusion:vortex-compact 78730046 / 104109736 / -24.4% 🟢 107978802 / 196317900 / -45.0% 🟢 0.73 / 0.53 / +37.5%
tpcds_q81/datafusion:vortex-compact 29565636 / 39152741 / -24.5% 🟢 46099994 / 89484817 / -48.5% 🟢 0.64 / 0.44 / +46.6%
tpcds_q82/datafusion:vortex-compact 15697688 / 24609220 / -36.2% 🟢 40123899 / 79270700 / -49.4% 🟢 0.39 / 0.31 / +26.0%
tpcds_q83/datafusion:vortex-compact 37375382 / 48750294 / -23.3% 🟢 57130104 / 102601283 / -44.3% 🟢 0.65 / 0.48 / +37.7%
tpcds_q84/datafusion:vortex-compact 13042460 / 17415576 / -25.1% 🟢 28958442 / 56883830 / -49.1% 🟢 0.45 / 0.31 / +47.1%
tpcds_q85/datafusion:vortex-compact 107921070 / 154116300 / -30.0% 🟢 131164685 / 223193379 / -41.2% 🟢 0.82 / 0.69 / +19.2%
tpcds_q86/datafusion:vortex-compact 16491986 / 21283784 / -22.5% 🟢 36373568 / 66020471 / -44.9% 🟢 0.45 / 0.32 / +40.6%
tpcds_q87/datafusion:vortex-compact 33346851 / 46684804 / -28.6% 🟢 54432575 / 102727560 / -47.0% 🟢 0.61 / 0.45 / +34.8%
tpcds_q88/datafusion:vortex-compact 41204555 / 81858232 / -49.7% 🟢 60793977 / 139443950 / -56.4% 🟢 0.68 / 0.59 / +15.5%
tpcds_q89/datafusion:vortex-compact 25046207 / 32121987 / -22.0% 🟢 47703263 / 86953530 / -45.1% 🟢 0.53 / 0.37 / +42.1%
tpcds_q90/datafusion:vortex-compact 11604704 / 16964402 / -31.6% 🟢 28361395 / 56685387 / -50.0% 🟢 0.41 / 0.30 / +36.7%
tpcds_q91/datafusion:vortex-compact 27374446 / 45348282 / -39.6% 🟢 49133987 / 91163447 / -46.1% 🟢 0.56 / 0.50 / +12.0%
tpcds_q92/datafusion:vortex-compact 15364711 / 20857004 / -26.3% 🟢 34165965 / 63286512 / -46.0% 🟢 0.45 / 0.33 / +36.5%
tpcds_q93/datafusion:vortex-compact 25350045 / 36082813 / -29.7% 🟢 43682077 / 88290818 / -50.5% 🟢 0.58 / 0.41 / +42.0%
tpcds_q94/datafusion:vortex-compact 22367345 / 29604542 / -24.4% 🟢 42672666 / 74332102 / -42.6% 🟢 0.52 / 0.40 / +31.6%
tpcds_q95/datafusion:vortex-compact 49771643 / 58818986 / -15.4% 🟢 71276612 / 120227361 / -40.7% 🟢 0.70 / 0.49 / +42.7%
tpcds_q96/datafusion:vortex-compact 10624948 / 17814422 / -40.4% 🟢 28501863 / 60685883 / -53.0% 🟢 0.37 / 0.29 / +27.0%
tpcds_q97/datafusion:vortex-compact 23715090 / 34591498 / -31.4% 🟢 46486782 / 90535898 / -48.7% 🟢 0.51 / 0.38 / +33.5%
tpcds_q98/datafusion:vortex-compact 22051061 / 29626467 / -25.6% 🟢 42404937 / 86110827 / -50.8% 🟢 0.52 / 0.34 / +51.1%
tpcds_q99/datafusion:vortex-compact 20995899 / 30088487 / -30.2% 🟢 40863203 / 81906815 / -50.1% 🟢 0.51 / 0.37 / +39.9%
datafusion / parquet / ns (0.848x ✅, 66↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29569127 / 36283692 / -18.5% 🟢 49286189 / 81234060 / -39.3% 🟢 0.60 / 0.45 / +34.3%
tpcds_q02/datafusion:parquet 46031857 / 52877966 / -12.9% 🟢 61217951 / 100451551 / -39.1% 🟢 0.75 / 0.53 / +42.8%
tpcds_q03/datafusion:parquet 18869418 / 22581489 / -16.4% 🟢 33474031 / 63535737 / -47.3% 🟢 0.56 / 0.36 / +58.6%
tpcds_q04/datafusion:parquet 193810202 / 280777708 / -31.0% 🟢 219985335 / 362304035 / -39.3% 🟢 0.88 / 0.77 / +13.7%
tpcds_q05/datafusion:parquet 69810464 / 71624132 / -2.5% 91479233 / 140691151 / -35.0% 🟢 0.76 / 0.51 / +49.9%
tpcds_q06/datafusion:parquet 34540966 / 38475778 / -10.2% 🟢 51394771 / 86422626 / -40.5% 🟢 0.67 / 0.45 / +51.0%
tpcds_q07/datafusion:parquet 45314378 / 57940085 / -21.8% 🟢 70704297 / 120774379 / -41.5% 🟢 0.64 / 0.48 / +33.6%
tpcds_q08/datafusion:parquet 39521370 / 42797697 / -7.7% 52403487 / 94597769 / -44.6% 🟢 0.75 / 0.45 / +66.7%
tpcds_q09/datafusion:parquet 31404808 / 32383394 / -3.0% 45359855 / 77246258 / -41.3% 🟢 0.69 / 0.42 / +65.2%
tpcds_q10/datafusion:parquet 50703702 / 55602183 / -8.8% 62951814 / 101912646 / -38.2% 🟢 0.81 / 0.55 / +47.6%
tpcds_q11/datafusion:parquet 92272834 / 144453106 / -36.1% 🟢 116095800 / 210640273 / -44.9% 🟢 0.79 / 0.69 / +15.9%
tpcds_q12/datafusion:parquet 23877386 / 30214202 / -21.0% 🟢 35775792 / 69908581 / -48.8% 🟢 0.67 / 0.43 / +54.4%
tpcds_q13/datafusion:parquet 45747456 / 58573133 / -21.9% 🟢 66270880 / 118560307 / -44.1% 🟢 0.69 / 0.49 / +39.7%
tpcds_q14/datafusion:parquet 138440608 / 176294868 / -21.5% 🟢 154096424 / 225681261 / -31.7% 🟢 0.90 / 0.78 / +15.0%
tpcds_q15/datafusion:parquet 29870598 / 30945960 / -3.5% 49135039 / 76992961 / -36.2% 🟢 0.61 / 0.40 / +51.3%
tpcds_q16/datafusion:parquet 36890980 / 38283082 / -3.6% 55896880 / 88265570 / -36.7% 🟢 0.66 / 0.43 / +52.2%
tpcds_q17/datafusion:parquet 74029712 / 77246826 / -4.2% 102543709 / 162847247 / -37.0% 🟢 0.72 / 0.47 / +52.2%
tpcds_q18/datafusion:parquet 55446932 / 65747741 / -15.7% 🟢 77732312 / 134021908 / -42.0% 🟢 0.71 / 0.49 / +45.4%
tpcds_q19/datafusion:parquet 31465972 / 37221003 / -15.5% 🟢 52358352 / 88647581 / -40.9% 🟢 0.60 / 0.42 / +43.1%
tpcds_q20/datafusion:parquet 25353484 / 34347300 / -26.2% 🟢 36557731 / 73308644 / -50.1% 🟢 0.69 / 0.47 / +48.0%
tpcds_q21/datafusion:parquet 20419698 / 25725864 / -20.6% 🟢 33400126 / 72040918 / -53.6% 🟢 0.61 / 0.36 / +71.2%
tpcds_q22/datafusion:parquet 76989824 / 120607942 / -36.2% 🟢 91224072 / 167107426 / -45.4% 🟢 0.84 / 0.72 / +16.9%
tpcds_q23/datafusion:parquet 114556998 / 158039522 / -27.5% 🟢 137738041 / 235205126 / -41.4% 🟢 0.83 / 0.67 / +23.8%
tpcds_q24/datafusion:parquet 91705974 / 101830010 / -9.9% 116901370 / 172738725 / -32.3% 🟢 0.78 / 0.59 / +33.1%
tpcds_q25/datafusion:parquet 74281182 / 83048156 / -10.6% 🟢 99943402 / 160565719 / -37.8% 🟢 0.74 / 0.52 / +43.7%
tpcds_q26/datafusion:parquet 41596322 / 46032848 / -9.6% 60738995 / 94875084 / -36.0% 🟢 0.68 / 0.49 / +41.1%
tpcds_q27/datafusion:parquet 77675039 / 110183226 / -29.5% 🟢 102066134 / 199269328 / -48.8% 🟢 0.76 / 0.55 / +37.6%
tpcds_q28/datafusion:parquet 26567164 / 36032952 / -26.3% 🟢 44155187 / 91318001 / -51.6% 🟢 0.60 / 0.39 / +52.5%
tpcds_q29/datafusion:parquet 75062436 / 81802098 / -8.2% 101740058 / 160806012 / -36.7% 🟢 0.74 / 0.51 / +45.0%
tpcds_q30/datafusion:parquet 45331166 / 55207702 / -17.9% 🟢 65476180 / 106720517 / -38.6% 🟢 0.69 / 0.52 / +33.8%
tpcds_q31/datafusion:parquet 88710982 / 94481100 / -6.1% 105672634 / 147563505 / -28.4% 🟢 0.84 / 0.64 / +31.1%
tpcds_q32/datafusion:parquet 25800640 / 26298434 / -1.9% 39929999 / 64774768 / -38.4% 🟢 0.65 / 0.41 / +59.2%
tpcds_q33/datafusion:parquet 39308974 / 43636254 / -9.9% 55329686 / 97184628 / -43.1% 🟢 0.71 / 0.45 / +58.2%
tpcds_q34/datafusion:parquet 23779918 / 30389886 / -21.8% 🟢 38031221 / 70247953 / -45.9% 🟢 0.63 / 0.43 / +44.5%
tpcds_q35/datafusion:parquet 52640354 / 71607714 / -26.5% 🟢 72626113 / 115920755 / -37.3% 🟢 0.72 / 0.62 / +17.3%
tpcds_q36/datafusion:parquet 51249834 / 67091992 / -23.6% 🟢 70516130 / 142192061 / -50.4% 🟢 0.73 / 0.47 / +54.0%
tpcds_q37/datafusion:parquet 25894674 / 24259836 / +6.7% 42573067 / 71755872 / -40.7% 🟢 0.61 / 0.34 / +79.9%
tpcds_q38/datafusion:parquet 44592009 / 51017540 / -12.6% 🟢 64413829 / 105734299 / -39.1% 🟢 0.69 / 0.48 / +43.5%
tpcds_q39/datafusion:parquet 70540658 / 85486639 / -17.5% 🟢 88197879 / 140727958 / -37.3% 🟢 0.80 / 0.61 / +31.7%
tpcds_q40/datafusion:parquet 27795214 / 32739752 / -15.1% 🟢 49752593 / 85011441 / -41.5% 🟢 0.56 / 0.39 / +45.1%
tpcds_q41/datafusion:parquet 19771954 / 23627780 / -16.3% 🟢 33046637 / 64877268 / -49.1% 🟢 0.60 / 0.36 / +64.3%
tpcds_q42/datafusion:parquet 17968320 / 20277914 / -11.4% 🟢 30663640 / 59110844 / -48.1% 🟢 0.59 / 0.34 / +70.8%
tpcds_q43/datafusion:parquet 19463650 / 25184346 / -22.7% 🟢 32812112 / 68600477 / -52.2% 🟢 0.59 / 0.37 / +61.6%
tpcds_q44/datafusion:parquet 33649701 / 39442540 / -14.7% 🟢 50990728 / 94832200 / -46.2% 🟢 0.66 / 0.42 / +58.7%
tpcds_q45/datafusion:parquet 37908158 / 39900652 / -5.0% 54729998 / 98802099 / -44.6% 🟢 0.69 / 0.40 / +71.5%
tpcds_q46/datafusion:parquet 28936555 / 39310170 / -26.4% 🟢 48384886 / 98593936 / -50.9% 🟢 0.60 / 0.40 / +50.0%
tpcds_q47/datafusion:parquet 98215330 / 142277840 / -31.0% 🟢 123518677 / 211747821 / -41.7% 🟢 0.80 / 0.67 / +18.3%
tpcds_q48/datafusion:parquet 41076838 / 53554153 / -23.3% 🟢 62322011 / 107030588 / -41.8% 🟢 0.66 / 0.50 / +31.7%
tpcds_q49/datafusion:parquet 73691534 / 76721002 / -3.9% 99585855 / 141289799 / -29.5% 🟢 0.74 / 0.54 / +36.3%
tpcds_q50/datafusion:parquet 46999738 / 56933463 / -17.4% 🟢 68177484 / 116219502 / -41.3% 🟢 0.69 / 0.49 / +40.7%
tpcds_q51/datafusion:parquet 70211650 / 82729314 / -15.1% 🟢 92853763 / 142845366 / -35.0% 🟢 0.76 / 0.58 / +30.6%
tpcds_q52/datafusion:parquet 18434754 / 20589010 / -10.5% 🟢 31394061 / 57689357 / -45.6% 🟢 0.59 / 0.36 / +64.5%
tpcds_q53/datafusion:parquet 22754638 / 26062956 / -12.7% 🟢 40584873 / 73464191 / -44.8% 🟢 0.56 / 0.35 / +58.0%
tpcds_q54/datafusion:parquet 54557279 / 53932054 / +1.2% 73085432 / 102302283 / -28.6% 🟢 0.75 / 0.53 / +41.6%
tpcds_q55/datafusion:parquet 17989434 / 21418592 / -16.0% 🟢 32867056 / 59302756 / -44.6% 🟢 0.55 / 0.36 / +51.5%
tpcds_q56/datafusion:parquet 44747710 / 44705716 / +0.1% 59930404 / 100978120 / -40.7% 🟢 0.75 / 0.44 / +68.7%
tpcds_q57/datafusion:parquet 100378319 / 118766058 / -15.5% 🟢 115443938 / 182338414 / -36.7% 🟢 0.87 / 0.65 / +33.5%
tpcds_q58/datafusion:parquet 63929866 / 73181658 / -12.6% 🟢 81963154 / 134192417 / -38.9% 🟢 0.78 / 0.55 / +43.0%
tpcds_q59/datafusion:parquet 46997712 / 70431544 / -33.3% 🟢 63849749 / 123796762 / -48.4% 🟢 0.74 / 0.57 / +29.4%
tpcds_q60/datafusion:parquet 45430046 / 44607015 / +1.8% 61997970 / 98218333 / -36.9% 🟢 0.73 / 0.45 / +61.3%
tpcds_q61/datafusion:parquet 37517720 / 52348038 / -28.3% 🟢 59610303 / 113930720 / -47.7% 🟢 0.63 / 0.46 / +37.0%
tpcds_q62/datafusion:parquet 25039982 / 28315156 / -11.6% 🟢 39375615 / 81804126 / -51.9% 🟢 0.64 / 0.35 / +83.7%
tpcds_q63/datafusion:parquet 22351758 / 26450762 / -15.5% 🟢 40674015 / 72440757 / -43.9% 🟢 0.55 / 0.37 / +50.5%
tpcds_q64/datafusion:parquet 201788750 / 281788878 / -28.4% 🟢 231106257 / 358645582 / -35.6% 🟢 0.87 / 0.79 / +11.1%
tpcds_q65/datafusion:parquet 38050834 / 43417883 / -12.4% 🟢 51889948 / 100451153 / -48.3% 🟢 0.73 / 0.43 / +69.7%
tpcds_q66/datafusion:parquet 62010318 / 82983548 / -25.3% 🟢 77748156 / 128231487 / -39.4% 🟢 0.80 / 0.65 / +23.2%
tpcds_q67/datafusion:parquet 68701371 / 136869266 / -49.8% 🟢 94050583 / 215247417 / -56.3% 🟢 0.73 / 0.64 / +14.9%
tpcds_q68/datafusion:parquet 29396367 / 37565831 / -21.7% 🟢 50106977 / 101982411 / -50.9% 🟢 0.59 / 0.37 / +59.3%
tpcds_q69/datafusion:parquet 50148955 / 58967198 / -15.0% 🟢 66857017 / 98865683 / -32.4% 🟢 0.75 / 0.60 / +25.8%
tpcds_q70/datafusion:parquet 36393436 / 48888860 / -25.6% 🟢 55755320 / 103840029 / -46.3% 🟢 0.65 / 0.47 / +38.6%
tpcds_q71/datafusion:parquet 27339287 / 34176094 / -20.0% 🟢 44590608 / 81939803 / -45.6% 🟢 0.61 / 0.42 / +47.0%
tpcds_q72/datafusion:parquet 553405364 / 392164832 / +41.1% 🔴 573628501 / 521481982 / +10.0% 0.96 / 0.75 / +28.3%
tpcds_q73/datafusion:parquet 22735848 / 30888395 / -26.4% 🟢 38642325 / 78361860 / -50.7% 🟢 0.59 / 0.39 / +49.3%
tpcds_q74/datafusion:parquet 67966644 / 91160091 / -25.4% 🟢 86707263 / 146911802 / -41.0% 🟢 0.78 / 0.62 / +26.3%
tpcds_q75/datafusion:parquet 142132639 / 148211452 / -4.1% 170371636 / 233617221 / -27.1% 🟢 0.83 / 0.63 / +31.5%
tpcds_q76/datafusion:parquet 54898466 / 47707535 / +15.1% 🔴 74766116 / 110712841 / -32.5% 🟢 0.73 / 0.43 / +70.4%
tpcds_q77/datafusion:parquet 55831421 / 57484674 / -2.9% 77614373 / 120750544 / -35.7% 🟢 0.72 / 0.48 / +51.1%
tpcds_q78/datafusion:parquet 89318476 / 117182664 / -23.8% 🟢 121696748 / 213467559 / -43.0% 🟢 0.73 / 0.55 / +33.7%
tpcds_q79/datafusion:parquet 26057284 / 34575099 / -24.6% 🟢 45542678 / 89234208 / -49.0% 🟢 0.57 / 0.39 / +47.7%
tpcds_q80/datafusion:parquet 78112688 / 96163958 / -18.8% 🟢 108955602 / 197855350 / -44.9% 🟢 0.72 / 0.49 / +47.5%
tpcds_q81/datafusion:parquet 44204484 / 51436269 / -14.1% 🟢 60337413 / 98387095 / -38.7% 🟢 0.73 / 0.52 / +40.1%
tpcds_q82/datafusion:parquet 26381114 / 27937386 / -5.6% 41286049 / 74375263 / -44.5% 🟢 0.64 / 0.38 / +70.1%
tpcds_q83/datafusion:parquet 58287178 / 61363235 / -5.0% 75305132 / 109377944 / -31.2% 🟢 0.77 / 0.56 / +38.0%
tpcds_q84/datafusion:parquet 30650514 / 34289137 / -10.6% 🟢 46620575 / 76296688 / -38.9% 🟢 0.66 / 0.45 / +46.3%
tpcds_q85/datafusion:parquet 82200693 / 90019107 / -8.7% 107441760 / 166745754 / -35.6% 🟢 0.77 / 0.54 / +41.7%
tpcds_q86/datafusion:parquet 20618639 / 22827416 / -9.7% 36055559 / 61768504 / -41.6% 🟢 0.57 / 0.37 / +54.7%
tpcds_q87/datafusion:parquet 45322441 / 48635282 / -6.8% 60884776 / 102330814 / -40.5% 🟢 0.74 / 0.48 / +56.6%
tpcds_q88/datafusion:parquet 46907591 / 56562930 / -17.1% 🟢 63613865 / 119406901 / -46.7% 🟢 0.74 / 0.47 / +55.7%
tpcds_q89/datafusion:parquet 25480170 / 29788615 / -14.5% 🟢 43205089 / 80463630 / -46.3% 🟢 0.59 / 0.37 / +59.3%
tpcds_q90/datafusion:parquet 19214845 / 21309314 / -9.8% 34075482 / 58415079 / -41.7% 🟢 0.56 / 0.36 / +54.6%
tpcds_q91/datafusion:parquet 36570560 / 43979552 / -16.8% 🟢 55380849 / 83756452 / -33.9% 🟢 0.66 / 0.53 / +25.8%
tpcds_q92/datafusion:parquet 25818561 / 26182258 / -1.4% 44742115 / 69886319 / -36.0% 🟢 0.58 / 0.37 / +54.0%
tpcds_q93/datafusion:parquet 26603124 / 34234256 / -22.3% 🟢 50468487 / 92365755 / -45.4% 🟢 0.53 / 0.37 / +42.2%
tpcds_q94/datafusion:parquet 34553510 / 35285800 / -2.1% 50764788 / 77311002 / -34.3% 🟢 0.68 / 0.46 / +49.1%
tpcds_q95/datafusion:parquet 64840042 / 61284348 / +5.8% 82499208 / 117403935 / -29.7% 🟢 0.79 / 0.52 / +50.6%
tpcds_q96/datafusion:parquet 16481356 / 18915406 / -12.9% 🟢 29067550 / 54079231 / -46.3% 🟢 0.57 / 0.35 / +62.1%
tpcds_q97/datafusion:parquet 35057316 / 40342503 / -13.1% 🟢 54846116 / 88439786 / -38.0% 🟢 0.64 / 0.46 / +40.1%
tpcds_q98/datafusion:parquet 25033312 / 30659179 / -18.3% 🟢 38680873 / 77855186 / -50.3% 🟢 0.65 / 0.39 / +64.3%
tpcds_q99/datafusion:parquet 30581401 / 33649148 / -9.1% 44658077 / 76168384 / -41.4% 🟢 0.68 / 0.44 / +55.0%
duckdb / vortex-file-compressed / ns (0.587x ✅, 99↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15571300 / 23709576 / -34.3% 🟢 23485642 / 45473646 / -48.4% 🟢 0.66 / 0.52 / +27.2%
tpcds_q02/duckdb:vortex-file-compressed 15503504 / 28665785 / -45.9% 🟢 21286107 / 47665966 / -55.3% 🟢 0.73 / 0.60 / +21.1%
tpcds_q03/duckdb:vortex-file-compressed 13409148 / 19802494 / -32.3% 🟢 20484121 / 41494092 / -50.6% 🟢 0.65 / 0.48 / +37.2%
tpcds_q04/duckdb:vortex-file-compressed 52053141 / 90837958 / -42.7% 🟢 64286605 / 121843565 / -47.2% 🟢 0.81 / 0.75 / +8.6%
tpcds_q05/duckdb:vortex-file-compressed 19481730 / 34150462 / -43.0% 🟢 26795570 / 55149800 / -51.4% 🟢 0.73 / 0.62 / +17.4%
tpcds_q06/duckdb:vortex-file-compressed 27821168 / 43504298 / -36.0% 🟢 42117817 / 70228543 / -40.0% 🟢 0.66 / 0.62 / +6.6%
tpcds_q07/duckdb:vortex-file-compressed 16195046 / 29540912 / -45.2% 🟢 29479140 / 61914393 / -52.4% 🟢 0.55 / 0.48 / +15.1%
tpcds_q08/duckdb:vortex-file-compressed 23178300 / 37249331 / -37.8% 🟢 33111407 / 57310150 / -42.2% 🟢 0.70 / 0.65 / +7.7%
tpcds_q09/duckdb:vortex-file-compressed 11908300 / 17052058 / -30.2% 🟢 17139263 / 52798344 / -67.5% 🟢 0.69 / 0.32 / +115.1%
tpcds_q10/duckdb:vortex-file-compressed 31090700 / 49877650 / -37.7% 🟢 43553186 / 75553489 / -42.4% 🟢 0.71 / 0.66 / +8.1%
tpcds_q11/duckdb:vortex-file-compressed 41233162 / 72748082 / -43.3% 🟢 53279171 / 108433807 / -50.9% 🟢 0.77 / 0.67 / +15.4%
tpcds_q12/duckdb:vortex-file-compressed 10899265 / 17154959 / -36.5% 🟢 18202463 / 33087230 / -45.0% 🟢 0.60 / 0.52 / +15.5%
tpcds_q13/duckdb:vortex-file-compressed 22081966 / 36737458 / -39.9% 🟢 3490879 / 70215132 / -50.3% 🟢 0.63 / 0.52 / +20.9%
tpcds_q14/duckdb:vortex-file-compressed 58529085 / 104653262 / -44.1% 🟢 70770043 / 152975612 / -53.7% 🟢 0.83 / 0.68 / +20.9%
tpcds_q15/duckdb:vortex-file-compressed 22893713 / 33338778 / -31.3% 🟢 28466370 / 47169573 / -39.7% 🟢 0.80 / 0.71 / +13.8%
tpcds_q16/duckdb:vortex-file-compressed 19131451 / 31765316 / -39.8% 🟢 28600785 / 53185679 / -46.2% 🟢 0.67 / 0.60 / +12.0%
tpcds_q17/duckdb:vortex-file-compressed 31972264 / 50770618 / -37.0% 🟢 47250383 / 87769112 / -46.2% 🟢 0.68 / 0.58 / +17.0%
tpcds_q18/duckdb:vortex-file-compressed 29856910 / 47072822 / -36.6% 🟢 39244880 / 71505577 / -45.1% 🟢 0.76 / 0.66 / +15.6%
tpcds_q19/duckdb:vortex-file-compressed 25043536 / 39068493 / -35.9% 🟢 36618075 / 64696633 / -43.4% 🟢 0.68 / 0.60 / +13.3%
tpcds_q20/duckdb:vortex-file-compressed 11164683 / 18026558 / -38.1% 🟢 18147652 / 37481682 / -51.6% 🟢 0.62 / 0.48 / +27.9%
tpcds_q21/duckdb:vortex-file-compressed 10380446 / 22175640 / -53.2% 🟢 22772071 / 48237237 / -52.8% 🟢 0.46 / 0.46 / -0.8%
tpcds_q22/duckdb:vortex-file-compressed 29850652 / 67862966 / -56.0% 🟢 46231529 / 104543256 / -55.8% 🟢 0.65 / 0.65 / -0.5%
tpcds_q23/duckdb:vortex-file-compressed 36169508 / 69605258 / -48.0% 🟢 51701906 / 112087274 / -53.9% 🟢 0.70 / 0.62 / +12.7%
tpcds_q24/duckdb:vortex-file-compressed 28702546 / 51179688 / -43.9% 🟢 40599867 / 78858454 / -48.5% 🟢 0.71 / 0.65 / +8.9%
tpcds_q25/duckdb:vortex-file-compressed 27121266 / 43156450 / -37.2% 🟢 39521487 / 69837354 / -43.4% 🟢 0.69 / 0.62 / +11.1%
tpcds_q26/duckdb:vortex-file-compressed 15171678 / 22155674 / -31.5% 🟢 21345473 / 40895289 / -47.8% 🟢 0.71 / 0.54 / +31.2%
tpcds_q27/duckdb:vortex-file-compressed 17510028 / 29939928 / -41.5% 🟢 27718179 / 60964665 / -54.5% 🟢 0.63 / 0.49 / +28.6%
tpcds_q28/duckdb:vortex-file-compressed 8159742 / 12731146 / -35.9% 🟢 12440469 / 24384024 / -49.0% 🟢 0.66 / 0.52 / +25.6%
tpcds_q29/duckdb:vortex-file-compressed 30769844 / 47215808 / -34.8% 🟢 47481246 / 83507089 / -43.1% 🟢 0.65 / 0.57 / +14.6%
tpcds_q30/duckdb:vortex-file-compressed 20231716 / 31973519 / -36.7% 🟢 28866290 / 53518789 / -46.1% 🟢 0.70 / 0.60 / +17.3%
tpcds_q31/duckdb:vortex-file-compressed 20032542 / 32757864 / -38.8% 🟢 28902461 / 57352261 / -49.6% 🟢 0.69 / 0.57 / +21.3%
tpcds_q32/duckdb:vortex-file-compressed 11232882 / 18437780 / -39.1% 🟢 17931797 / 32007088 / -44.0% 🟢 0.63 / 0.58 / +8.7%
tpcds_q33/duckdb:vortex-file-compressed 18151924 / 28888605 / -37.2% 🟢 29901486 / 59318293 / -49.6% 🟢 0.61 / 0.49 / +24.6%
tpcds_q34/duckdb:vortex-file-compressed 14864621 / 24441713 / -39.2% 🟢 22656814 / 44961369 / -49.6% 🟢 0.66 / 0.54 / +20.7%
tpcds_q35/duckdb:vortex-file-compressed 49136652 / 76518793 / -35.8% 🟢 62968511 / 114588619 / -45.0% 🟢 0.78 / 0.67 / +16.9%
tpcds_q36/duckdb:vortex-file-compressed 15474306 / 27754997 / -44.2% 🟢 29542164 / 57843516 / -48.9% 🟢 0.52 / 0.48 / +9.2%
tpcds_q37/duckdb:vortex-file-compressed 14069700 / 28837185 / -51.2% 🟢 24430528 / 54170091 / -54.9% 🟢 0.58 / 0.53 / +8.2%
tpcds_q38/duckdb:vortex-file-compressed 22337450 / 38474907 / -41.9% 🟢 30020495 / 66927955 / -55.1% 🟢 0.74 / 0.57 / +29.4%
tpcds_q39/duckdb:vortex-file-compressed 18747882 / 32889260 / -43.0% 🟢 30320546 / 63749803 / -52.4% 🟢 0.62 / 0.52 / +19.9%
tpcds_q40/duckdb:vortex-file-compressed 13585444 / 22442342 / -39.5% 🟢 20060087 / 41130330 / -51.2% 🟢 0.68 / 0.55 / +24.1%
tpcds_q41/duckdb:vortex-file-compressed 6690312 / 9562816 / -30.0% 🟢 11116472 / 19729302 / -43.7% 🟢 0.60 / 0.48 / +24.2%
tpcds_q42/duckdb:vortex-file-compressed 8619361 / 16184114 / -46.7% 🟢 18129289 / 39858918 / -54.5% 🟢 0.48 / 0.41 / +17.1%
tpcds_q43/duckdb:vortex-file-compressed 11757244 / 19284900 / -39.0% 🟢 18383799 / 39399116 / -53.3% 🟢 0.64 / 0.49 / +30.7%
tpcds_q44/duckdb:vortex-file-compressed 14208131 / 24363630 / -41.7% 🟢 26266248 / 62613093 / -58.0% 🟢 0.54 / 0.39 / +39.0%
tpcds_q45/duckdb:vortex-file-compressed 23720314 / 35567907 / -33.3% 🟢 30510039 / 49668176 / -38.6% 🟢 0.78 / 0.72 / +8.6%
tpcds_q46/duckdb:vortex-file-compressed 17522452 / 33724319 / -48.0% 🟢 31411637 / 59553006 / -47.3% 🟢 0.56 / 0.57 / -1.5%
tpcds_q47/duckdb:vortex-file-compressed 30807567 / 53109812 / -42.0% 🟢 40817783 / 85386712 / -52.2% 🟢 0.75 / 0.62 / +21.3%
tpcds_q48/duckdb:vortex-file-compressed 20277200 / 34502634 / -41.2% 🟢 34919939 / 68689799 / -49.2% 🟢 0.58 / 0.50 / +15.6%
tpcds_q49/duckdb:vortex-file-compressed 18755734 / 30748593 / -39.0% 🟢 34291418 / 71822576 / -52.3% 🟢 0.55 / 0.43 / +27.8%
tpcds_q50/duckdb:vortex-file-compressed 17433307 / 29127540 / -40.1% 🟢 29701330 / 57940859 / -48.7% 🟢 0.59 / 0.50 / +16.8%
tpcds_q51/duckdb:vortex-file-compressed 54238202 / 131098275 / -58.6% 🟢 88192176 / 122077931 / -27.8% 🟢 0.62 / 1.07 / -42.7%
tpcds_q52/duckdb:vortex-file-compressed 10623354 / 17123469 / -38.0% 🟢 18585929 / 39487383 / -52.9% 🟢 0.57 / 0.43 / +31.8%
tpcds_q53/duckdb:vortex-file-compressed 14415734 / 25109466 / -42.6% 🟢 24387333 / 48675878 / -49.9% 🟢 0.59 / 0.52 / +14.6%
tpcds_q54/duckdb:vortex-file-compressed 21014712 / 37070228 / -43.3% 🟢 31813472 / 59797236 / -46.8% 🟢 0.66 / 0.62 / +6.6%
tpcds_q55/duckdb:vortex-file-compressed 8854238 / 18073067 / -51.0% 🟢 18999986 / 42502079 / -55.3% 🟢 0.47 / 0.43 / +9.6%
tpcds_q56/duckdb:vortex-file-compressed 18434886 / 31368422 / -41.2% 🟢 30792225 / 61712454 / -50.1% 🟢 0.60 / 0.51 / +17.8%
tpcds_q57/duckdb:vortex-file-compressed 24703000 / 40160761 / -38.5% 🟢 32632281 / 61887419 / -47.3% 🟢 0.76 / 0.65 / +16.7%
tpcds_q58/duckdb:vortex-file-compressed 18398208 / 32213514 / -42.9% 🟢 31314968 / 58875383 / -46.8% 🟢 0.59 / 0.55 / +7.4%
tpcds_q59/duckdb:vortex-file-compressed 18720547 / 38362720 / -51.2% 🟢 25713352 / 56974417 / -54.9% 🟢 0.73 / 0.67 / +8.1%
tpcds_q60/duckdb:vortex-file-compressed 18085954 / 30470667 / -40.6% 🟢 30309030 / 62789942 / -51.7% 🟢 0.60 / 0.49 / +23.0%
tpcds_q61/duckdb:vortex-file-compressed 21623558 / 35910150 / -39.8% 🟢 33494706 / 80373312 / -58.3% 🟢 0.65 / 0.45 / +44.5%
tpcds_q62/duckdb:vortex-file-compressed 10749172 / 18329504 / -41.4% 🟢 19750629 / 34088346 / -42.1% 🟢 0.54 / 0.54 / +1.2%
tpcds_q63/duckdb:vortex-file-compressed 13610228 / 21881221 / -37.8% 🟢 23488735 / 51063425 / -54.0% 🟢 0.58 / 0.43 / +35.2%
tpcds_q64/duckdb:vortex-file-compressed 63546027 / 107991262 / -41.2% 🟢 84312943 / 150616713 / -44.0% 🟢 0.75 / 0.72 / +5.1%
tpcds_q65/duckdb:vortex-file-compressed 13933267 / 23388496 / -40.4% 🟢 21781843 / 45472205 / -52.1% 🟢 0.64 / 0.51 / +24.4%
tpcds_q66/duckdb:vortex-file-compressed 23938524 / 37530986 / -36.2% 🟢 31508214 / 68646491 / -54.1% 🟢 0.76 / 0.55 / +39.0%
tpcds_q67/duckdb:vortex-file-compressed 67199088 / 124453922 / -46.0% 🟢 97010961 / 164865234 / -41.2% 🟢 0.69 / 0.75 / -8.2%
tpcds_q68/duckdb:vortex-file-compressed 18939934 / 29679482 / -36.2% 🟢 32551072 / 62232455 / -47.7% 🟢 0.58 / 0.48 / +22.0%
tpcds_q69/duckdb:vortex-file-compressed 31606127 / 52722828 / -40.1% 🟢 43889305 / 84485585 / -48.1% 🟢 0.72 / 0.62 / +15.4%
tpcds_q70/duckdb:vortex-file-compressed 18997453 / 32817190 / -42.1% 🟢 30068229 / 67063160 / -55.2% 🟢 0.63 / 0.49 / +29.1%
tpcds_q71/duckdb:vortex-file-compressed 13331738 / 24158307 / -44.8% 🟢 25109083 / 56582306 / -55.6% 🟢 0.53 / 0.43 / +24.4%
tpcds_q72/duckdb:vortex-file-compressed 64096316 / 143065148 / -55.2% 🟢 82130888 / 191621687 / -57.1% 🟢 0.78 / 0.75 / +4.5%
tpcds_q73/duckdb:vortex-file-compressed 13240812 / 24204096 / -45.3% 🟢 22029355 / 44665728 / -50.7% 🟢 0.60 / 0.54 / +10.9%
tpcds_q74/duckdb:vortex-file-compressed 28145999 / 49336790 / -43.0% 🟢 38634225 / 74592836 / -48.2% 🟢 0.73 / 0.66 / +10.1%
tpcds_q75/duckdb:vortex-file-compressed 28911470 / 53109449 / -45.6% 🟢 41548429 / 87002623 / -52.2% 🟢 0.70 / 0.61 / +14.0%
tpcds_q76/duckdb:vortex-file-compressed 13867160 / 23510192 / -41.0% 🟢 27448408 / 56647436 / -51.5% 🟢 0.51 / 0.42 / +21.7%
tpcds_q77/duckdb:vortex-file-compressed 16377552 / 27532720 / -40.5% 🟢 25725498 / 55239078 / -53.4% 🟢 0.64 / 0.50 / +27.7%
tpcds_q78/duckdb:vortex-file-compressed 38692950 / 70691455 / -45.3% 🟢 46888663 / 101454157 / -53.8% 🟢 0.83 / 0.70 / +18.4%
tpcds_q79/duckdb:vortex-file-compressed 14715812 / 28078773 / -47.6% 🟢 28987130 / 57576807 / -49.7% 🟢 0.51 / 0.49 / +4.1%
tpcds_q80/duckdb:vortex-file-compressed 28764912 / 50679260 / -43.2% 🟢 44683680 / 86963853 / -48.6% 🟢 0.64 / 0.58 / +10.5%
tpcds_q81/duckdb:vortex-file-compressed 23270300 / 39268564 / -40.7% 🟢 33353016 / 58110497 / -42.6% 🟢 0.70 / 0.68 / +3.2%
tpcds_q82/duckdb:vortex-file-compressed 32816291 / 53163056 / -38.3% 🟢 41212670 / 74990170 / -45.0% 🟢 0.80 / 0.71 / +12.3%
tpcds_q83/duckdb:vortex-file-compressed 21232396 / 31351054 / -32.3% 🟢 26599271 / 47164295 / -43.6% 🟢 0.80 / 0.66 / +20.1%
tpcds_q84/duckdb:vortex-file-compressed 13726993 / 25114798 / -45.3% 🟢 20408777 / 40620168 / -49.8% 🟢 0.67 / 0.62 / +8.8%
tpcds_q85/duckdb:vortex-file-compressed 33420435 / 50113500 / -33.3% 🟢 43176686 / 75328630 / -42.7% 🟢 0.77 / 0.67 / +16.4%
tpcds_q86/duckdb:vortex-file-compressed 11433304 / 20385974 / -43.9% 🟢 18659695 / 37666973 / -50.5% 🟢 0.61 / 0.54 / +13.2%
tpcds_q87/duckdb:vortex-file-compressed 24802553 / 40982276 / -39.5% 🟢 33372972 / 66641901 / -49.9% 🟢 0.74 / 0.61 / +20.9%
tpcds_q88/duckdb:vortex-file-compressed 36410446 / 61275280 / -40.6% 🟢 48190113 / 122101642 / -60.5% 🟢 0.76 / 0.50 / +50.6%
tpcds_q89/duckdb:vortex-file-compressed 14064172 / 25858351 / -45.6% 🟢 24632991 / 50324465 / -51.1% 🟢 0.57 / 0.51 / +11.1%
tpcds_q90/duckdb:vortex-file-compressed 8541760 / 14908972 / -42.7% 🟢 13438784 / 29418461 / -54.3% 🟢 0.64 / 0.51 / +25.4%
tpcds_q91/duckdb:vortex-file-compressed 17339607 / 27933116 / -37.9% 🟢 25842479 / 45287930 / -42.9% 🟢 0.67 / 0.62 / +8.8%
tpcds_q92/duckdb:vortex-file-compressed 14764684 / 21034046 / -29.8% 🟢 23065432 / 43806516 / -47.3% 🟢 0.64 / 0.48 / +33.3%
tpcds_q93/duckdb:vortex-file-compressed 16643646 / 29016604 / -42.6% 🟢 23610165 / 48436699 / -51.3% 🟢 0.70 / 0.60 / +17.7%
tpcds_q94/duckdb:vortex-file-compressed 17660772 / 30601982 / -42.3% 🟢 28390955 / 50242083 / -43.5% 🟢 0.62 / 0.61 / +2.1%
tpcds_q95/duckdb:vortex-file-compressed 72992924 / 141438531 / -48.4% 🟢 79516058 / 159075523 / -50.0% 🟢 0.92 / 0.89 / +3.2%
tpcds_q96/duckdb:vortex-file-compressed 8932336 / 14715449 / -39.3% 🟢 18600577 / 39853986 / -53.3% 🟢 0.48 / 0.37 / +30.1%
tpcds_q97/duckdb:vortex-file-compressed 23302952 / 38441851 / -39.4% 🟢 31547728 / 67715885 / -53.4% 🟢 0.74 / 0.57 / +30.1%
tpcds_q98/duckdb:vortex-file-compressed 13806161 / 22571805 / -38.8% 🟢 22963411 / 51643326 / -55.5% 🟢 0.60 / 0.44 / +37.6%
tpcds_q99/duckdb:vortex-file-compressed 14485820 / 24589096 / -41.1% 🟢 21178695 / 40944674 / -48.3% 🟢 0.68 / 0.60 / +13.9%
duckdb / vortex-compact / ns (0.544x ✅, 99↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16777470 / 25635586 / -34.6% 🟢 25021925 / 46023851 / -45.6% 🟢 0.67 / 0.56 / +20.4%
tpcds_q02/duckdb:vortex-compact 16260978 / 30297914 / -46.3% 🟢 21773757 / 48056366 / -54.7% 🟢 0.75 / 0.63 / +18.5%
tpcds_q03/duckdb:vortex-compact 21999072 / 44949454 / -51.1% 🟢 30235826 / 65865765 / -54.1% 🟢 0.73 / 0.68 / +6.6%
tpcds_q04/duckdb:vortex-compact 54401824 / 97910750 / -44.4% 🟢 65529759 / 133302144 / -50.8% 🟢 0.83 / 0.73 / +13.0%
tpcds_q05/duckdb:vortex-compact 22484129 / 42218186 / -46.7% 🟢 30570282 / 68436374 / -55.3% 🟢 0.74 / 0.62 / +19.2%
tpcds_q06/duckdb:vortex-compact 32647258 / 57887740 / -43.6% 🟢 45477471 / 84670647 / -46.3% 🟢 0.72 / 0.68 / +5.0%
tpcds_q07/duckdb:vortex-compact 28959308 / 5847766 / -50.5% 🟢 39655070 / 95741346 / -58.6% 🟢 0.73 / 0.61 / +19.6%
tpcds_q08/duckdb:vortex-compact 50077276 / 99443308 / -49.6% 🟢 58618370 / 115254512 / -49.1% 🟢 0.85 / 0.86 / -1.0%
tpcds_q09/duckdb:vortex-compact 12364966 / 23347440 / -47.0% 🟢 20145000 / 64017217 / -68.5% 🟢 0.61 / 0.36 / +68.3%
tpcds_q10/duckdb:vortex-compact 45991305 / 86662694 / -46.9% 🟢 61059337 / 113412137 / -46.2% 🟢 0.75 / 0.76 / -1.4%
tpcds_q11/duckdb:vortex-compact 45232036 / 84854852 / -46.7% 🟢 57043879 / 102137514 / -44.1% 🟢 0.79 / 0.83 / -4.6%
tpcds_q12/duckdb:vortex-compact 13674968 / 22052295 / -38.0% 🟢 19757710 / 36241345 / -45.5% 🟢 0.69 / 0.61 / +13.7%
tpcds_q13/duckdb:vortex-compact 36915612 / 77008837 / -52.1% 🟢 48396543 / 107577300 / -55.0% 🟢 0.76 / 0.72 / +6.6%
tpcds_q14/duckdb:vortex-compact 68254048 / 125942272 / -45.8% 🟢 78615219 / 175591438 / -55.2% 🟢 0.87 / 0.72 / +21.0%
tpcds_q15/duckdb:vortex-compact 26401233 / 39919143 / -33.9% 🟢 31466969 / 54579152 / -42.3% 🟢 0.84 / 0.73 / +14.7%
tpcds_q16/duckdb:vortex-compact 25527551 / 41008250 / -37.8% 🟢 34146002 / 61692055 / -44.7% 🟢 0.75 / 0.66 / +12.5%
tpcds_q17/duckdb:vortex-compact 46059666 / 81375946 / -43.4% 🟢 59287206 / 108223257 / -45.2% 🟢 0.78 / 0.75 / +3.3%
tpcds_q18/duckdb:vortex-compact 37237386 / 60380968 / -38.3% 🟢 44967938 / 82898982 / -45.8% 🟢 0.83 / 0.73 / +13.7%
tpcds_q19/duckdb:vortex-compact 36520464 / 63277306 / -42.3% 🟢 47493826 / 86971449 / -45.4% 🟢 0.77 / 0.73 / +5.7%
tpcds_q20/duckdb:vortex-compact 14311910 / 23120612 / -38.1% 🟢 19690682 / 42034280 / -53.2% 🟢 0.73 / 0.55 / +32.1%
tpcds_q21/duckdb:vortex-compact 11444816 / 21644128 / -47.1% 🟢 20462824 / 62608469 / -67.3% 🟢 0.56 / 0.35 / +61.8%
tpcds_q22/duckdb:vortex-compact 31087944 / 67016816 / -53.6% 🟢 43137217 / 114256671 / -62.2% 🟢 0.72 / 0.59 / +22.9%
tpcds_q23/duckdb:vortex-compact 42800857 / 88557290 / -51.7% 🟢 53088390 / 132746289 / -60.0% 🟢 0.81 / 0.67 / +20.9%
tpcds_q24/duckdb:vortex-compact 40191287 / 76759073 / -47.6% 🟢 50860919 / 100147767 / -49.2% 🟢 0.79 / 0.77 / +3.1%
tpcds_q25/duckdb:vortex-compact 44128732 / 73029322 / -39.6% 🟢 55512196 / 99567587 / -44.2% 🟢 0.79 / 0.73 / +8.4%
tpcds_q26/duckdb:vortex-compact 25501446 / 48790522 / -47.7% 🟢 33560519 / 64358800 / -47.9% 🟢 0.76 / 0.76 / +0.2%
tpcds_q27/duckdb:vortex-compact 34142736 / 66621600 / -48.8% 🟢 44260413 / 92898441 / -52.4% 🟢 0.77 / 0.72 / +7.6%
tpcds_q28/duckdb:vortex-compact 11304003 / 22653366 / -50.1% 🟢 17337446 / 41801917 / -58.5% 🟢 0.65 / 0.54 / +20.3%
tpcds_q29/duckdb:vortex-compact 45483190 / 83671895 / -45.6% 🟢 59574512 / 106921773 / -44.3% 🟢 0.76 / 0.78 / -2.4%
tpcds_q30/duckdb:vortex-compact 22814324 / 36513065 / -37.5% 🟢 33046894 / 59616757 / -44.6% 🟢 0.69 / 0.61 / +12.7%
tpcds_q31/duckdb:vortex-compact 24250075 / 43401768 / -44.1% 🟢 31433648 / 66737031 / -52.9% 🟢 0.77 / 0.65 / +18.6%
tpcds_q32/duckdb:vortex-compact 14553523 / 25546662 / -43.0% 🟢 21833776 / 42835094 / -49.0% 🟢 0.67 / 0.60 / +11.8%
tpcds_q33/duckdb:vortex-compact 23862092 / 44702651 / -46.6% 🟢 34190564 / 74107589 / -53.9% 🟢 0.70 / 0.60 / +15.7%
tpcds_q34/duckdb:vortex-compact 22460247 / 46536179 / -51.7% 🟢 33062761 / 66274240 / -50.1% 🟢 0.68 / 0.70 / -3.3%
tpcds_q35/duckdb:vortex-compact 63168517 / 113667432 / -44.4% 🟢 75802810 / 152538965 / -50.3% 🟢 0.83 / 0.75 / +11.8%
tpcds_q36/duckdb:vortex-compact 22819672 / 43568184 / -47.6% 🟢 32308703 / 70514172 / -54.2% 🟢 0.71 / 0.62 / +14.3%
tpcds_q37/duckdb:vortex-compact 15422744 / 27886655 / -44.7% 🟢 25322779 / 54769460 / -53.8% 🟢 0.61 / 0.51 / +19.6%
tpcds_q38/duckdb:vortex-compact 26449880 / 50405074 / -47.5% 🟢 34035467 / 71648026 / -52.5% 🟢 0.78 / 0.70 / +10.5%
tpcds_q39/duckdb:vortex-compact 20188000 / 37885867 / -46.7% 🟢 32368898 / 80654210 / -59.9% 🟢 0.62 / 0.47 / +32.8%
tpcds_q40/duckdb:vortex-compact 16268066 / 26822914 / -39.4% 🟢 21507056 / 45269527 / -52.5% 🟢 0.76 / 0.59 / +27.7%
tpcds_q41/duckdb:vortex-compact 7907376 / 11283062 / -29.9% 🟢 12657236 / 23248520 / -45.6% 🟢 0.62 / 0.49 / +28.7%
tpcds_q42/duckdb:vortex-compact 12047437 / 22330719 / -46.0% 🟢 21228557 / 44647744 / -52.5% 🟢 0.57 / 0.50 / +13.5%
tpcds_q43/duckdb:vortex-compact 17093152 / 35572546 / -51.9% 🟢 27205327 / 52086431 / -47.8% 🟢 0.63 / 0.68 / -8.0%
tpcds_q44/duckdb:vortex-compact 19930970 / 34954679 / -43.0% 🟢 29898788 / 72222078 / -58.6% 🟢 0.67 / 0.48 / +37.7%
tpcds_q45/duckdb:vortex-compact 27928778 / 42943274 / -35.0% 🟢 33534521 / 58727165 / -42.9% 🟢 0.83 / 0.73 / +13.9%
tpcds_q46/duckdb:vortex-compact 29541529 / 60872640 / -51.5% 🟢 39953638 / 77876379 / -48.7% 🟢 0.74 / 0.78 / -5.4%
tpcds_q47/duckdb:vortex-compact 37236911 / 65624854 / -43.3% 🟢 47530713 / 99705822 / -52.3% 🟢 0.78 / 0.66 / +19.0%
tpcds_q48/duckdb:vortex-compact 38097027 / 69658153 / -45.3% 🟢 51753703 / 96224900 / -46.2% 🟢 0.74 / 0.72 / +1.7%
tpcds_q49/duckdb:vortex-compact 24703199 / 47435458 / -47.9% 🟢 36294404 / 86064765 / -57.8% 🟢 0.68 / 0.55 / +23.5%
tpcds_q50/duckdb:vortex-compact 28133186 / 54534706 / -48.4% 🟢 37292407 / 83352328 / -55.3% 🟢 0.75 / 0.65 / +15.3%
tpcds_q51/duckdb:vortex-compact 55187907 / 99673422 / -44.6% 🟢 63313759 / 147910322 / -57.2% 🟢 0.87 / 0.67 / +29.3%
tpcds_q52/duckdb:vortex-compact 12163644 / 25605063 / -52.5% 🟢 21151779 / 48553041 / -56.4% 🟢 0.58 / 0.53 / +9.0%
tpcds_q53/duckdb:vortex-compact 22403918 / 41214035 / -45.6% 🟢 31133445 / 64801063 / -52.0% 🟢 0.72 / 0.64 / +13.1%
tpcds_q54/duckdb:vortex-compact 25966002 / 45686226 / -43.2% 🟢 35476635 / 75024758 / -52.7% 🟢 0.73 / 0.61 / +20.2%
tpcds_q55/duckdb:vortex-compact 11993308 / 24519526 / -51.1% 🟢 21599660 / 46914416 / -54.0% 🟢 0.56 / 0.52 / +6.2%
tpcds_q56/duckdb:vortex-compact 24751074 / 45660727 / -45.8% 🟢 35252691 / 75529707 / -53.3% 🟢 0.70 / 0.60 / +16.1%
tpcds_q57/duckdb:vortex-compact 27967639 / 46684615 / -40.1% 🟢 34952379 / 65870944 / -46.9% 🟢 0.80 / 0.71 / +12.9%
tpcds_q58/duckdb:vortex-compact 22055066 / 38324066 / -42.5% 🟢 32151238 / 67941616 / -52.7% 🟢 0.69 / 0.56 / +21.6%
tpcds_q59/duckdb:vortex-compact 23474507 / 48422910 / -51.5% 🟢 30345269 / 68260984 / -55.5% 🟢 0.77 / 0.71 / +9.1%
tpcds_q60/duckdb:vortex-compact 24886678 / 45100247 / -44.8% 🟢 36328027 / 78856329 / -53.9% 🟢 0.69 / 0.57 / +19.8%
tpcds_q61/duckdb:vortex-compact 32541360 / 64346640 / -49.4% 🟢 43500245 / 105042440 / -58.6% 🟢 0.75 / 0.61 / +22.1%
tpcds_q62/duckdb:vortex-compact 11866401 / 22863093 / -48.1% 🟢 17780458 / 37031818 / -52.0% 🟢 0.67 / 0.62 / +8.1%
tpcds_q63/duckdb:vortex-compact 21255448 / 38382917 / -44.6% 🟢 29392377 / 62364311 / -52.9% 🟢 0.72 / 0.62 / +17.5%
tpcds_q64/duckdb:vortex-compact 86130656 / 164563110 / -47.7% 🟢 98763499 / 195594775 / -49.5% 🟢 0.87 / 0.84 / +3.7%
tpcds_q65/duckdb:vortex-compact 18490151 / 36288138 / -49.0% 🟢 26493664 / 60192382 / -56.0% 🟢 0.70 / 0.60 / +15.8%
tpcds_q66/duckdb:vortex-compact 26150072 / 44466303 / -41.2% 🟢 34692087 / 72136216 / -51.9% 🟢 0.75 / 0.62 / +22.3%
tpcds_q67/duckdb:vortex-compact 71817446 / 138504119 / -48.1% 🟢 90221559 / 170295507 / -47.0% 🟢 0.80 / 0.81 / -2.1%
tpcds_q68/duckdb:vortex-compact 29963043 / 61294260 / -51.1% 🟢 39723074 / 84937145 / -53.2% 🟢 0.75 / 0.72 / +4.5%
tpcds_q69/duckdb:vortex-compact 48004896 / 89248488 / -46.2% 🟢 58059862 / 120441723 / -51.8% 🟢 0.83 / 0.74 / +11.6%
tpcds_q70/duckdb:vortex-compact 31780302 / 65148430 / -51.2% 🟢 50030894 / 86713842 / -42.3% 🟢 0.64 / 0.75 / -15.5%
tpcds_q71/duckdb:vortex-compact 19535042 / 40028010 / -51.2% 🟢 31583882 / 65050522 / -51.4% 🟢 0.62 / 0.62 / +0.5%
tpcds_q72/duckdb:vortex-compact 70561120 / 163372958 / -56.8% 🟢 88937894 / 220287249 / -59.6% 🟢 0.79 / 0.74 / +7.0%
tpcds_q73/duckdb:vortex-compact 21966021 / 44342456 / -50.5% 🟢 31292427 / 68900124 / -54.6% 🟢 0.70 / 0.64 / +9.1%
tpcds_q74/duckdb:vortex-compact 32736578 / 58854564 / -44.4% 🟢 41596893 / 91965787 / -54.8% 🟢 0.79 / 0.64 / +23.0%
tpcds_q75/duckdb:vortex-compact 32664962 / 66242369 / -50.7% 🟢 44637391 / 104498629 / -57.3% 🟢 0.73 / 0.63 / +15.4%
tpcds_q76/duckdb:vortex-compact 17418933 / 30811017 / -43.5% 🟢 31198864 / 65431616 / -52.3% 🟢 0.56 / 0.47 / +18.6%
tpcds_q77/duckdb:vortex-compact 24872002 / 43946222 / -43.4% 🟢 32383592 / 76742117 / -57.8% 🟢 0.77 / 0.57 / +34.1%
tpcds_q78/duckdb:vortex-compact 41795760 / 84218764 / -50.4% 🟢 52080071 / 108339833 / -51.9% 🟢 0.80 / 0.78 / +3.2%
tpcds_q79/duckdb:vortex-compact 38800677 / 84391578 / -54.0% 🟢 68871776 / 104465776 / -34.1% 🟢 0.56 / 0.81 / -30.3%
tpcds_q80/duckdb:vortex-compact 39001798 / 71225884 / -45.2% 🟢 58680911 / 96310172 / -39.1% 🟢 0.66 / 0.74 / -10.1%
tpcds_q81/duckdb:vortex-compact 24815374 / 38532152 / -35.6% 🟢 32872964 / 64157489 / -48.8% 🟢 0.75 / 0.60 / +25.7%
tpcds_q82/duckdb:vortex-compact 35972371 / 60314137 / -40.4% 🟢 43657482 / 82305967 / -47.0% 🟢 0.82 / 0.73 / +12.4%
tpcds_q83/duckdb:vortex-compact 28997122 / 46282694 / -37.3% 🟢 32146902 / 61230948 / -47.5% 🟢 0.90 / 0.76 / +19.3%
tpcds_q84/duckdb:vortex-compact 15112566 / 24846013 / -39.2% 🟢 20699488 / 44375212 / -53.4% 🟢 0.73 / 0.56 / +30.4%
tpcds_q85/duckdb:vortex-compact 42275608 / 69572058 / -39.2% 🟢 50953961 / 90436185 / -43.7% 🟢 0.83 / 0.77 / +7.8%
tpcds_q86/duckdb:vortex-compact 12287866 / 21392048 / -42.6% 🟢 21088777 / 37729324 / -44.1% 🟢 0.58 / 0.57 / +2.8%
tpcds_q87/duckdb:vortex-compact 29098048 / 52319462 / -44.4% 🟢 37046800 / 72654581 / -49.0% 🟢 0.79 / 0.72 / +9.1%
tpcds_q88/duckdb:vortex-compact 67539090 / 121448417 / -44.4% 🟢 88588491 / 187255237 / -52.7% 🟢 0.76 / 0.65 / +17.5%
tpcds_q89/duckdb:vortex-compact 22972534 / 40833436 / -43.7% 🟢 29884182 / 67046980 / -55.4% 🟢 0.77 / 0.61 / +26.2%
tpcds_q90/duckdb:vortex-compact 11811144 / 21486482 / -45.0% 🟢 18687700 / 41180758 / -54.6% 🟢 0.63 / 0.52 / +21.1%
tpcds_q91/duckdb:vortex-compact 33656612 / 66693722 / -49.5% 🟢 40461755 / 84709447 / -52.2% 🟢 0.83 / 0.79 / +5.7%
tpcds_q92/duckdb:vortex-compact 21329119 / 35798339 / -40.4% 🟢 28782661 / 52217243 / -44.9% 🟢 0.74 / 0.69 / +8.1%
tpcds_q93/duckdb:vortex-compact 18455636 / 36639774 / -49.6% 🟢 25447229 / 64624580 / -60.6% 🟢 0.73 / 0.57 / +27.9%
tpcds_q94/duckdb:vortex-compact 22781478 / 39369948 / -42.1% 🟢 30515995 / 61954773 / -50.7% 🟢 0.75 / 0.64 / +17.5%
tpcds_q95/duckdb:vortex-compact 78032034 / 153442106 / -49.1% 🟢 86742632 / 173860328 / -50.1% 🟢 0.90 / 0.88 / +1.9%
tpcds_q96/duckdb:vortex-compact 17615662 / 34706532 / -49.2% 🟢 28566973 / 57264252 / -50.1% 🟢 0.62 / 0.61 / +1.7%
tpcds_q97/duckdb:vortex-compact 25518319 / 47749086 / -46.6% 🟢 32499186 / 64752815 / -49.8% 🟢 0.79 / 0.74 / +6.5%
tpcds_q98/duckdb:vortex-compact 18462890 / 31988165 / -42.3% 🟢 28647721 / 57028309 / -49.8% 🟢 0.64 / 0.56 / +14.9%
tpcds_q99/duckdb:vortex-compact 17224126 / 2757862 / -37.5% 🟢 22862216 / 45665276 / -49.9% 🟢 0.75 / 0.60 / +24.7%
duckdb / parquet / ns (0.683x ✅, 99↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24899175 / 32317048 / -23.0% 🟢 34938041 / 45787749 / -23.7% 🟢 0.71 / 0.71 / +1.0%
tpcds_q02/duckdb:parquet 15486592 / 22387552 / -30.8% 🟢 19904586 / 32654508 / -39.0% 🟢 0.78 / 0.69 / +13.5%
tpcds_q03/duckdb:parquet 8728678 / 12423147 / -29.7% 🟢 14858955 / 22395567 / -33.7% 🟢 0.59 / 0.55 / +5.9%
tpcds_q04/duckdb:parquet 127674884 / 193572593 / -34.0% 🟢 137943114 / 205153235 / -32.8% 🟢 0.93 / 0.94 / -1.9%
tpcds_q05/duckdb:parquet 21967690 / 32333356 / -32.1% 🟢 32257178 / 42716778 / -24.5% 🟢 0.68 / 0.76 / -10.0%
tpcds_q06/duckdb:parquet 26341940 / 35400502 / -25.6% 🟢 39754858 / 54301484 / -26.8% 🟢 0.66 / 0.65 / +1.6%
tpcds_q07/duckdb:parquet 15139158 / 21569910 / -29.8% 🟢 24054988 / 35803823 / -32.8% 🟢 0.63 / 0.60 / +4.5%
tpcds_q08/duckdb:parquet 27350164 / 33510936 / -18.4% 🟢 33428622 / 45015843 / -25.7% 🟢 0.82 / 0.74 / +9.9%
tpcds_q09/duckdb:parquet 19890431 / 31557464 / -37.0% 🟢 23519308 / 38210835 / -38.4% 🟢 0.85 / 0.83 / +2.4%
tpcds_q10/duckdb:parquet 28461402 / 39748214 / -28.4% 🟢 37883368 / 60132366 / -37.0% 🟢 0.75 / 0.66 / +13.7%
tpcds_q11/duckdb:parquet 71421989 / 104480510 / -31.6% 🟢 78613347 / 114549369 / -31.4% 🟢 0.91 / 0.91 / -0.4%
tpcds_q12/duckdb:parquet 12842799 / 17866056 / -28.1% 🟢 17606882 / 27018869 / -34.8% 🟢 0.73 / 0.66 / +10.3%
tpcds_q13/duckdb:parquet 23900221 / 34321696 / -30.4% 🟢 32053650 / 50240596 / -36.2% 🟢 0.75 / 0.68 / +9.1%
tpcds_q14/duckdb:parquet 61262182 / 103908720 / -41.0% 🟢 66375428 / 117194473 / -43.4% 🟢 0.92 / 0.89 / +4.1%
tpcds_q15/duckdb:parquet 25149843 / 35042373 / -28.2% 🟢 30840453 / 47006915 / -34.4% 🟢 0.82 / 0.75 / +9.4%
tpcds_q16/duckdb:parquet 19993014 / 27309796 / -26.8% 🟢 28623493 / 43162966 / -33.7% 🟢 0.70 / 0.63 / +10.4%
tpcds_q17/duckdb:parquet 32429464 / 44432462 / -27.0% 🟢 41940095 / 56406514 / -25.6% 🟢 0.77 / 0.79 / -1.8%
tpcds_q18/duckdb:parquet 39081700 / 57341868 / -31.8% 🟢 49756343 / 76373703 / -34.9% 🟢 0.79 / 0.75 / +4.6%
tpcds_q19/duckdb:parquet 24490821 / 33612052 / -27.1% 🟢 32141486 / 46522084 / -30.9% 🟢 0.76 / 0.72 / +5.5%
tpcds_q20/duckdb:parquet 13767770 / 19397260 / -29.0% 🟢 18080403 / 34662958 / -47.8% 🟢 0.76 / 0.56 / +36.1%
tpcds_q21/duckdb:parquet 9435349 / 14512242 / -35.0% 🟢 13005140 / 30123638 / -56.8% 🟢 0.73 / 0.48 / +50.6%
tpcds_q22/duckdb:parquet 35028952 / 56272406 / -37.8% 🟢 39093019 / 77079806 / -49.3% 🟢 0.90 / 0.73 / +22.7%
tpcds_q23/duckdb:parquet 43175547 / 68216878 / -36.7% 🟢 55992295 / 81066947 / -30.9% 🟢 0.77 / 0.84 / -8.4%
tpcds_q24/duckdb:parquet 33405281 / 49166633 / -32.1% 🟢 44336888 / 69605168 / -36.3% 🟢 0.75 / 0.71 / +6.7%
tpcds_q25/duckdb:parquet 31918271 / 41846615 / -23.7% 🟢 40351972 / 57210384 / -29.5% 🟢 0.79 / 0.73 / +8.1%
tpcds_q26/duckdb:parquet 31290990 / 43598212 / -28.2% 🟢 38345076 / 55072272 / -30.4% 🟢 0.82 / 0.79 / +3.1%
tpcds_q27/duckdb:parquet 31941159 / 56956951 / -43.9% 🟢 41599322 / 69969611 / -40.5% 🟢 0.77 / 0.81 / -5.7%
tpcds_q28/duckdb:parquet 17086218 / 28366980 / -39.8% 🟢 20350520 / 38330724 / -46.9% 🟢 0.84 / 0.74 / +13.4%
tpcds_q29/duckdb:parquet 30688878 / 42725754 / -28.2% 🟢 40162612 / 56609418 / -29.1% 🟢 0.76 / 0.75 / +1.2%
tpcds_q30/duckdb:parquet 32571478 / 42844947 / -24.0% 🟢 41237554 / 61717590 / -33.2% 🟢 0.79 / 0.69 / +13.8%
tpcds_q31/duckdb:parquet 20235437 / 29312290 / -31.0% 🟢 24613933 / 41727132 / -41.0% 🟢 0.82 / 0.70 / +17.0%
tpcds_q32/duckdb:parquet 11252806 / 15905922 / -29.3% 🟢 18932235 / 27685364 / -31.6% 🟢 0.59 / 0.57 / +3.5%
tpcds_q33/duckdb:parquet 16156954 / 24187074 / -33.2% 🟢 24209580 / 38541041 / -37.2% 🟢 0.67 / 0.63 / +6.3%
tpcds_q34/duckdb:parquet 15897520 / 22234396 / -28.5% 🟢 22467895 / 34299340 / -34.5% 🟢 0.71 / 0.65 / +9.2%
tpcds_q35/duckdb:parquet 46898175 / 66190742 / -29.1% 🟢 56507381 / 85580146 / -34.0% 🟢 0.83 / 0.77 / +7.3%
tpcds_q36/duckdb:parquet 15951948 / 22582320 / -29.4% 🟢 25862519 / 39590146 / -34.7% 🟢 0.62 / 0.57 / +8.1%
tpcds_q37/duckdb:parquet 11755283 / 17206177 / -31.7% 🟢 17727712 / 32617002 / -45.6% 🟢 0.66 / 0.53 / +25.7%
tpcds_q38/duckdb:parquet 26246531 / 40424984 / -35.1% 🟢 30651076 / 52581747 / -41.7% 🟢 0.86 / 0.77 / +11.4%
tpcds_q39/duckdb:parquet 24682615 / 37453686 / -34.1% 🟢 29195239 / 51187213 / -43.0% 🟢 0.85 / 0.73 / +15.5%
tpcds_q40/duckdb:parquet 15883482 / 23002736 / -30.9% 🟢 22041482 / 33462212 / -34.1% 🟢 0.72 / 0.69 / +4.8%
tpcds_q41/duckdb:parquet 7838772 / 10453702 / -25.0% 🟢 13220634 / 25045262 / -47.2% 🟢 0.59 / 0.42 / +42.1%
tpcds_q42/duckdb:parquet 8389113 / 12091169 / -30.6% 🟢 14852902 / 21267686 / -30.2% 🟢 0.56 / 0.57 / -0.7%
tpcds_q43/duckdb:parquet 10597936 / 14759287 / -28.2% 🟢 15472919 / 26443365 / -41.5% 🟢 0.68 / 0.56 / +22.7%
tpcds_q44/duckdb:parquet 17574455 / 25846535 / -32.0% 🟢 24827402 / 38994137 / -36.3% 🟢 0.71 / 0.66 / +6.8%
tpcds_q45/duckdb:parquet 23328402 / 32793370 / -28.9% 🟢 30109377 / 43778924 / -31.2% 🟢 0.77 / 0.75 / +3.4%
tpcds_q46/duckdb:parquet 35972162 / 52293226 / -31.2% 🟢 45673718 / 65115599 / -29.9% 🟢 0.79 / 0.80 / -1.9%
tpcds_q47/duckdb:parquet 31720853 / 50237382 / -36.9% 🟢 39198931 / 63094354 / -37.9% 🟢 0.81 / 0.80 / +1.6%
tpcds_q48/duckdb:parquet 21261570 / 30538212 / -30.4% 🟢 28742563 / 49728580 / -42.2% 🟢 0.74 / 0.61 / +20.5%
tpcds_q49/duckdb:parquet 18969381 / 29271002 / -35.2% 🟢 29417220 / 43525693 / -32.4% 🟢 0.64 / 0.67 / -4.1%
tpcds_q50/duckdb:parquet 17561595 / 25224469 / -30.4% 🟢 25504853 / 36598459 / -30.3% 🟢 0.69 / 0.69 / -0.1%
tpcds_q51/duckdb:parquet 53871317 / 94522557 / -43.0% 🟢 62920830 / 145363033 / -56.7% 🟢 0.86 / 0.65 / +31.7%
tpcds_q52/duckdb:parquet 8592632 / 13726322 / -37.4% 🟢 14765451 / 25019564 / -41.0% 🟢 0.58 / 0.55 / +6.1%
tpcds_q53/duckdb:parquet 11689432 / 16391856 / -28.7% 🟢 17079137 / 29699998 / -42.5% 🟢 0.68 / 0.55 / +24.0%
tpcds_q54/duckdb:parquet 20794126 / 30488630 / -31.8% 🟢 29896662 / 46010653 / -35.0% 🟢 0.70 / 0.66 / +5.0%
tpcds_q55/duckdb:parquet 8487577 / 13718776 / -38.1% 🟢 14833514 / 23860243 / -37.8% 🟢 0.57 / 0.57 / -0.5%
tpcds_q56/duckdb:parquet 16356413 / 24926415 / -34.4% 🟢 23340661 / 38807497 / -39.9% 🟢 0.70 / 0.64 / +9.1%
tpcds_q57/duckdb:parquet 28956111 / 43980511 / -34.2% 🟢 36068632 / 56110160 / -35.7% 🟢 0.80 / 0.78 / +2.4%
tpcds_q58/duckdb:parquet 19588704 / 26757778 / -26.8% 🟢 25497175 / 39690022 / -35.8% 🟢 0.77 / 0.67 / +14.0%
tpcds_q59/duckdb:parquet 20158266 / 29913732 / -32.6% 🟢 25355824 / 53255485 / -52.4% 🟢 0.80 / 0.56 / +41.5%
tpcds_q60/duckdb:parquet 16744939 / 27113364 / -38.2% 🟢 24715485 / 40888549 / -39.6% 🟢 0.68 / 0.66 / +2.2%
tpcds_q61/duckdb:parquet 21634114 / 32622806 / -33.7% 🟢 28862968 / 42551764 / -32.2% 🟢 0.75 / 0.77 / -2.2%
tpcds_q62/duckdb:parquet 10825864 / 15097566 / -28.3% 🟢 14711739 / 22675389 / -35.1% 🟢 0.74 / 0.67 / +10.5%
tpcds_q63/duckdb:parquet 11017354 / 17508506 / -37.1% 🟢 16763656 / 29944684 / -44.0% 🟢 0.66 / 0.58 / +12.4%
tpcds_q64/duckdb:parquet 52531922 / 80027398 / -34.4% 🟢 69762216 / 104850566 / -33.5% 🟢 0.75 / 0.76 / -1.3%
tpcds_q65/duckdb:parquet 14506336 / 21766151 / -33.4% 🟢 21336811 / 36327491 / -41.3% 🟢 0.68 / 0.60 / +13.5%
tpcds_q66/duckdb:parquet 24670328 / 35802368 / -31.1% 🟢 31541383 / 46992420 / -32.9% 🟢 0.78 / 0.76 / +2.7%
tpcds_q67/duckdb:parquet 77939682 / 124523440 / -37.4% 🟢 85796853 / 133784186 / -35.9% 🟢 0.91 / 0.93 / -2.4%
tpcds_q68/duckdb:parquet 29178790 / 39740302 / -26.6% 🟢 40988319 / 58778944 / -30.3% 🟢 0.71 / 0.68 / +5.3%
tpcds_q69/duckdb:parquet 29017906 / 41487183 / -30.1% 🟢 38018279 / 63709188 / -40.3% 🟢 0.76 / 0.65 / +17.2%
tpcds_q70/duckdb:parquet 16113020 / 28277714 / -43.0% 🟢 25543236 / 44382816 / -42.4% 🟢 0.63 / 0.64 / -1.0%
tpcds_q71/duckdb:parquet 14711464 / 21573095 / -31.8% 🟢 20933805 / 36919352 / -43.3% 🟢 0.70 / 0.58 / +20.3%
tpcds_q72/duckdb:parquet 81889434 / 131588069 / -37.8% 🟢 88632687 / 132847216 / -33.3% 🟢 0.92 / 0.99 / -6.7%
tpcds_q73/duckdb:parquet 13552964 / 18804694 / -27.9% 🟢 19754057 / 32284513 / -38.8% 🟢 0.69 / 0.58 / +17.8%
tpcds_q74/duckdb:parquet 99522624 / 146195980 / -31.9% 🟢 108061448 / 162246430 / -33.4% 🟢 0.92 / 0.90 / +2.2%
tpcds_q75/duckdb:parquet 40209338 / 60051390 / -33.0% 🟢 53369720 / 79909749 / -33.2% 🟢 0.75 / 0.75 / +0.3%
tpcds_q76/duckdb:parquet 13591326 / 19793437 / -31.3% 🟢 21408177 / 33651180 / -36.4% 🟢 0.63 / 0.59 / +7.9%
tpcds_q77/duckdb:parquet 16869700 / 27252595 / -38.1% 🟢 25121491 / 40019640 / -37.2% 🟢 0.67 / 0.68 / -1.4%
tpcds_q78/duckdb:parquet 48371439 / 77733072 / -37.8% 🟢 54697867 / 91046656 / -39.9% 🟢 0.88 / 0.85 / +3.6%
tpcds_q79/duckdb:parquet 20395014 / 30835768 / -33.9% 🟢 29401868 / 46651101 / -37.0% 🟢 0.69 / 0.66 / +4.9%
tpcds_q80/duckdb:parquet 31434960 / 49440260 / -36.4% 🟢 39545367 / 60474602 / -34.6% 🟢 0.79 / 0.82 / -2.8%
tpcds_q81/duckdb:parquet 30271792 / 41213694 / -26.5% 🟢 41569842 / 57270252 / -27.4% 🟢 0.73 / 0.72 / +1.2%
tpcds_q82/duckdb:parquet 13450975 / 19119628 / -29.6% 🟢 21971003 / 32688646 / -32.8% 🟢 0.61 / 0.58 / +4.7%
tpcds_q83/duckdb:parquet 15793479 / 22309993 / -29.2% 🟢 20693400 / 31576765 / -34.5% 🟢 0.76 / 0.71 / +8.0%
tpcds_q84/duckdb:parquet 17555810 / 23979829 / -26.8% 🟢 23645227 / 33166105 / -28.7% 🟢 0.74 / 0.72 / +2.7%
tpcds_q85/duckdb:parquet 35181976 / 48842469 / -28.0% 🟢 45897514 / 67993691 / -32.5% 🟢 0.77 / 0.72 / +6.7%
tpcds_q86/duckdb:parquet 11043114 / 15019348 / -26.5% 🟢 15864929 / 25492717 / -37.8% 🟢 0.70 / 0.59 / +18.1%
tpcds_q87/duckdb:parquet 29154444 / 44773684 / -34.9% 🟢 32857107 / 54424005 / -39.6% 🟢 0.89 / 0.82 / +7.9%
tpcds_q88/duckdb:parquet 27198002 / 43438634 / -37.4% 🟢 31712064 / 52636446 / -39.8% 🟢 0.86 / 0.83 / +3.9%
tpcds_q89/duckdb:parquet 12761587 / 19270080 / -33.8% 🟢 18636680 / 34266691 / -45.6% 🟢 0.68 / 0.56 / +21.8%
tpcds_q90/duckdb:parquet 7237764 / 9834613 / -26.4% 🟢 11363371 / 20778461 / -45.3% 🟢 0.64 / 0.47 / +34.6%
tpcds_q91/duckdb:parquet 20721816 / 28013814 / -26.0% 🟢 31563007 / 41251618 / -23.5% 🟢 0.66 / 0.68 / -3.3%
tpcds_q92/duckdb:parquet 11562316 / 15636914 / -26.1% 🟢 1826358 / 26983352 / -32.3% 🟢 0.63 / 0.58 / +9.2%
tpcds_q93/duckdb:parquet 21409872 / 31286202 / -31.6% 🟢 29784249 / 47133692 / -36.8% 🟢 0.72 / 0.66 / +8.3%
tpcds_q94/duckdb:parquet 16150520 / 21580781 / -25.2% 🟢 25263725 / 36921525 / -31.6% 🟢 0.64 / 0.58 / +9.4%
tpcds_q95/duckdb:parquet 90014486 / 139546692 / -35.5% 🟢 98282959 / 155037704 / -36.6% 🟢 0.92 / 0.90 / +1.8%
tpcds_q96/duckdb:parquet 7105406 / 9605488 / -26.0% 🟢 10970900 / 17237953 / -36.4% 🟢 0.65 / 0.56 / +16.2%
tpcds_q97/duckdb:parquet 26162619 / 40025908 / -34.6% 🟢 31766012 / 49616613 / -36.0% 🟢 0.82 / 0.81 / +2.1%
tpcds_q98/duckdb:parquet 15165124 / 22165671 / -31.6% 🟢 22550999 / 33250491 / -32.2% 🟢 0.67 / 0.67 / +0.9%
tpcds_q99/duckdb:parquet 17189546 / 24022795 / -28.4% 🟢 20916825 / 31859977 / -34.3% 🟢 0.82 / 0.75 / +9.0%

File Size Changes (3 files changed, -0.0% overall, 1↑ 2↓)
File Scale Format Base HEAD Change %
catalog_page.vortex 1.0 vortex-file-compressed 545.95 KB 546.16 KB +208 B +0.0%
customer.vortex 1.0 vortex-file-compressed 4.18 MB 4.18 MB 1.03 KB -0.0%
date_dim.vortex 1.0 vortex-file-compressed 576.08 KB 551.28 KB 24.80 KB -4.3%

Totals:

  • vortex-compact: 207.80 MB → 207.80 MB (0.0%)
  • vortex-file-compressed: 265.99 MB → 265.96 MB (-0.0%)

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR a42e6d50 vs base 792cef74


vortex / vortex-file-compressed / ms (0.674x ✅, 8↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 36.170411 / 52.890143 / -31.6% 🟢
read/clickbench/URL/shard-0/onpair-12 24.475853 / 37.511877 / -34.8% 🟢
read/tpch/l_comment/fsst 66.689687 / 110.769123 / -39.8% 🟢
read/tpch/l_comment/onpair-12 64.759225 / 110.682099 / -41.5% 🟢
write/clickbench/URL/shard-0/fsst 616.940311 / 872.729637 / -29.3% 🟢
write/clickbench/URL/shard-0/onpair-12 1719.13959 / 2096.63607 / -18.0% 🟢
write/tpch/l_comment/fsst 2119.95959 / 3197.0225 / -33.7% 🟢
write/tpch/l_comment/onpair-12 2897.21833 / 4093.418 / -29.2% 🟢
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 46.3288099 / 46.3396896 / -0.0%
size/clickbench/URL/shard-0/onpair-12 29.7417587 / 29.7417587 / +0.0%
size/tpch/l_comment/fsst 26.895123 / 26.8917906 / +0.0%
size/tpch/l_comment/onpair-12 22.6668097 / 22.6668097 / +0.0%

Signed-off-by: Robert Kruszewski <github@robertk.io>
@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.5%
Engines: DuckDB No clear signal (-9.5%, environment too noisy confidence)
Vortex (geomean): hot 0.651x ✅ · cold 0.633x ✅
Parquet (geomean): hot 0.720x ✅ · cold 0.696x ✅
Shifts: Parquet (control) -28.0% · Median polish -35.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.644x ✅, 11↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9343814 / 12633670 / -26.0% 🟢 9744074 / 13584630 / -28.3% 🟢 0.96 / 0.93 / +3.1%
statpopgen_q01/duckdb:vortex-file-compressed 10825346 / 13831510 / -21.7% 🟢 14603141 / 24557702 / -40.5% 🟢 0.74 / 0.56 / +31.6%
statpopgen_q02/duckdb:vortex-file-compressed 379963834 / 611214797 / -37.8% 🟢 418138409 / 632353033 / -33.9% 🟢 0.91 / 0.97 / -6.0%
statpopgen_q03/duckdb:vortex-file-compressed 907688720 / 1321320534 / -31.3% 🟢 912545446 / 1308559215 / -30.3% 🟢 0.99 / 1.01 / -1.5%
statpopgen_q04/duckdb:vortex-file-compressed 898591380 / 1326567513 / -32.3% 🟢 921591847 / 1290715752 / -28.6% 🟢 0.98 / 1.03 / -5.1%
statpopgen_q05/duckdb:vortex-file-compressed 426626062 / 903920840 / -52.8% 🟢 438683314 / 661275147 / -33.7% 🟢 0.97 / 1.37 / -28.9%
statpopgen_q06/duckdb:vortex-file-compressed 1171014846 / 2265974002 / -48.3% 🟢 1175679166 / 1793048265 / -34.4% 🟢 1.00 / 1.26 / -21.2%
statpopgen_q07/duckdb:vortex-file-compressed 182633672 / 240813611 / -24.2% 🟢 196355292 / 351145112 / -44.1% 🟢 0.93 / 0.69 / +35.6%
statpopgen_q08/duckdb:vortex-file-compressed 198833190 / 267489144 / -25.7% 🟢 218534053 / 310590521 / -29.6% 🟢 0.91 / 0.86 / +5.6%
statpopgen_q09/duckdb:vortex-file-compressed 707958099 / 1284623354 / -44.9% 🟢 738845940 / 1072451009 / -31.1% 🟢 0.96 / 1.20 / -20.0%
statpopgen_q10/duckdb:vortex-file-compressed 2005031586 / 3223961742 / -37.8% 🟢 1981512110 / 3194811928 / -38.0% 🟢 1.01 / 1.01 / +0.3%
duckdb / vortex-compact / ns (0.659x ✅, 11↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 9420908 / 11981802 / -21.4% 🟢 9843042 / 14470542 / -32.0% 🟢 0.96 / 0.83 / +15.6%
statpopgen_q01/duckdb:vortex-compact 10666595 / 13427852 / -20.6% 🟢 14156197 / 22953076 / -38.3% 🟢 0.75 / 0.59 / +28.8%
statpopgen_q02/duckdb:vortex-compact 394333228 / 670095538 / -41.2% 🟢 405935039 / 691531307 / -41.3% 🟢 0.97 / 0.97 / +0.2%
statpopgen_q03/duckdb:vortex-compact 917523152 / 1408947648 / -34.9% 🟢 930495152 / 1815387704 / -48.7% 🟢 0.99 / 0.78 / +27.1%
statpopgen_q04/duckdb:vortex-compact 913972105 / 1396770562 / -34.6% 🟢 913937943 / 1484961834 / -38.5% 🟢 1.00 / 0.94 / +6.3%
statpopgen_q05/duckdb:vortex-compact 440863830 / 692409665 / -36.3% 🟢 448868054 / 696673700 / -35.6% 🟢 0.98 / 0.99 / -1.2%
statpopgen_q06/duckdb:vortex-compact 1186952382 / 1816388634 / -34.7% 🟢 1185733349 / 1821449710 / -34.9% 🟢 1.00 / 1.00 / +0.4%
statpopgen_q07/duckdb:vortex-compact 316210179 / 498610188 / -36.6% 🟢 328557979 / 559495052 / -41.3% 🟢 0.96 / 0.89 / +8.0%
statpopgen_q08/duckdb:vortex-compact 332636931 / 513243392 / -35.2% 🟢 342468541 / 563065637 / -39.2% 🟢 0.97 / 0.91 / +6.6%
statpopgen_q09/duckdb:vortex-compact 728941968 / 1224288419 / -40.5% 🟢 730207054 / 1376344629 / -46.9% 🟢 1.00 / 0.89 / +12.2%
statpopgen_q10/duckdb:vortex-compact 2030406289 / 3183553964 / -36.2% 🟢 1999590336 / 2987184092 / -33.1% 🟢 1.02 / 1.07 / -4.7%
duckdb / parquet / ns (0.720x ✅, 11↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 247832252 / 376852060 / -34.2% 🟢 248048222 / 380187540 / -34.8% 🟢 1.00 / 0.99 / +0.8%
statpopgen_q01/duckdb:parquet 304271726 / 466266268 / -34.7% 🟢 307641558 / 478974976 / -35.8% 🟢 0.99 / 0.97 / +1.6%
statpopgen_q02/duckdb:parquet 534083914 / 769573821 / -30.6% 🟢 554223896 / 804210172 / -31.1% 🟢 0.96 / 0.96 / +0.7%
statpopgen_q03/duckdb:parquet 843739214 / 1058045237 / -20.3% 🟢 838746197 / 1130328104 / -25.8% 🟢 1.01 / 0.94 / +7.5%
statpopgen_q04/duckdb:parquet 834844444 / 1056611624 / -21.0% 🟢 852039814 / 1117460660 / -23.8% 🟢 0.98 / 0.95 / +3.6%
statpopgen_q05/duckdb:parquet 575477234 / 769961702 / -25.3% 🟢 586247068 / 813212856 / -27.9% 🟢 0.98 / 0.95 / +3.7%
statpopgen_q06/duckdb:parquet 735912358 / 1023296180 / -28.1% 🟢 721148841 / 1038595178 / -30.6% 🟢 1.02 / 0.99 / +3.6%
statpopgen_q07/duckdb:parquet 615432947 / 937687145 / -34.4% 🟢 696525106 / 1099687130 / -36.7% 🟢 0.88 / 0.85 / +3.6%
statpopgen_q08/duckdb:parquet 620916392 / 972829454 / -36.2% 🟢 710021547 / 1148747214 / -38.2% 🟢 0.87 / 0.85 / +3.3%
statpopgen_q09/duckdb:parquet 774284864 / 993741858 / -22.1% 🟢 802387195 / 1031524769 / -22.2% 🟢 0.96 / 0.96 / +0.2%
statpopgen_q10/duckdb:parquet 1351652006 / 1647790020 / -18.0% 🟢 1247556578 / 1675730296 / -25.6% 🟢 1.08 / 0.98 / +10.2%

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.55 GB 1.55 GB 8.03 KB -0.0%

Totals:

  • vortex-compact: 960.83 MB → 960.83 MB (0.0%)
  • vortex-file-compressed: 1.55 GB → 1.55 GB (-0.0%)

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-6.3%, environment too noisy confidence) · DuckDB No clear signal (+5.2%, environment too noisy confidence)
Vortex (geomean): hot 0.512x ✅ · cold 0.436x ✅
Parquet (geomean): hot 0.515x ✅ · cold 0.521x ✅
Shifts: Parquet (control) -48.5% · Median polish -52.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.498x ✅, 43↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1249572 / 1948896 / -35.9% 🟢 21349770 / 40849926 / -47.7% 🟢 0.06 / 0.05 / +22.7%
clickbench_q01/datafusion:vortex-file-compressed 8988986 / 12074758 / -25.6% 🟢 35263347 / 59988928 / -41.2% 🟢 0.25 / 0.20 / +26.6%
clickbench_q02/datafusion:vortex-file-compressed 14367074 / 25955878 / -44.6% 🟢 36729504 / 76390333 / -51.9% 🟢 0.39 / 0.34 / +15.1%
clickbench_q03/datafusion:vortex-file-compressed 13988822 / 26989758 / -48.2% 🟢 49472238 / 96973641 / -49.0% 🟢 0.28 / 0.28 / +1.6%
clickbench_q04/datafusion:vortex-file-compressed 55347147 / 159603173 / -65.3% 🟢 90915586 / 232036568 / -60.8% 🟢 0.61 / 0.69 / -11.5%
clickbench_q05/datafusion:vortex-file-compressed 81095572 / 217357066 / -62.7% 🟢 114589004 / 295619628 / -61.2% 🟢 0.71 / 0.74 / -3.7%
clickbench_q06/datafusion:vortex-file-compressed 1235720 / 1928178 / -35.9% 🟢 22097572 / 41854588 / -47.2% 🟢 0.06 / 0.05 / +21.4%
clickbench_q07/datafusion:vortex-file-compressed 14281570 / 18082204 / -21.0% 🟢 38201026 / 68981679 / -44.6% 🟢 0.37 / 0.26 / +42.6%
clickbench_q08/datafusion:vortex-file-compressed 82302348 / 217125464 / -62.1% 🟢 121835806 / 308794556 / -60.5% 🟢 0.68 / 0.70 / -3.9%
clickbench_q09/datafusion:vortex-file-compressed 172864154 / 352035971 / -50.9% 🟢 206146419 / 410605328 / -49.8% 🟢 0.84 / 0.86 / -2.2%
clickbench_q10/datafusion:vortex-file-compressed 41430307 / 66754855 / -37.9% 🟢 68138384 / 132404332 / -48.5% 🟢 0.61 / 0.50 / +20.6%
clickbench_q11/datafusion:vortex-file-compressed 56922051 / 86041428 / -33.8% 🟢 87441988 / 150413334 / -41.9% 🟢 0.65 / 0.57 / +13.8%
clickbench_q12/datafusion:vortex-file-compressed 75768542 / 192836172 / -60.7% 🟢 117682750 / 279971020 / -58.0% 🟢 0.64 / 0.69 / -6.5%
clickbench_q13/datafusion:vortex-file-compressed 126399764 / 329475628 / -61.6% 🟢 175703548 / 443044644 / -60.3% 🟢 0.72 / 0.74 / -3.3%
clickbench_q14/datafusion:vortex-file-compressed 84236782 / 201807876 / -58.3% 🟢 120771582 / 288242352 / -58.1% 🟢 0.70 / 0.70 / -0.4%
clickbench_q15/datafusion:vortex-file-compressed 62736655 / 184395978 / -66.0% 🟢 94523510 / 262443092 / -64.0% 🟢 0.66 / 0.70 / -5.5%
clickbench_q16/datafusion:vortex-file-compressed 156592584 / 467286492 / -66.5% 🟢 201122758 / 571835307 / -64.8% 🟢 0.78 / 0.82 / -4.7%
clickbench_q17/datafusion:vortex-file-compressed 156236502 / 454539872 / -65.6% 🟢 209212106 / 590144012 / -64.5% 🟢 0.75 / 0.77 / -3.0%
clickbench_q18/datafusion:vortex-file-compressed 304044512 / 890268564 / -65.8% 🟢 370890815 / 993300116 / -62.7% 🟢 0.82 / 0.90 / -8.5%
clickbench_q19/datafusion:vortex-file-compressed 9710803 / 16409744 / -40.8% 🟢 49195277 / 87616508 / -43.9% 🟢 0.20 / 0.19 / +5.4%
clickbench_q20/datafusion:vortex-file-compressed 68965944 / 183409282 / -62.4% 🟢 233054177 / 372398380 / -37.4% 🟢 0.30 / 0.49 / -39.9%
clickbench_q21/datafusion:vortex-file-compressed 98768464 / 264312768 / -62.6% 🟢 265631732 / 466559947 / -43.1% 🟢 0.37 / 0.57 / -34.4%
clickbench_q22/datafusion:vortex-file-compressed 123137835 / 321300689 / -61.7% 🟢 349071318 / 602680479 / -42.1% 🟢 0.35 / 0.53 / -33.8%
clickbench_q23/datafusion:vortex-file-compressed 355921211 / 583115736 / -39.0% 🟢 639581395 / 858253303 / -25.5% 🟢 0.56 / 0.68 / -18.1%
clickbench_q24/datafusion:vortex-file-compressed 21538072 / 41024666 / -47.5% 🟢 65852022 / 117635547 / -44.0% 🟢 0.33 / 0.35 / -6.2%
clickbench_q25/datafusion:vortex-file-compressed 26078434 / 54108476 / -51.8% 🟢 59065250 / 122560192 / -51.8% 🟢 0.44 / 0.44 / +0.0%
clickbench_q26/datafusion:vortex-file-compressed 21611254 / 41402312 / -47.8% 🟢 64764104 / 124965719 / -48.2% 🟢 0.33 / 0.33 / +0.7%
clickbench_q27/datafusion:vortex-file-compressed 101692455 / 271378806 / -62.5% 🟢 244192362 / 451399373 / -45.9% 🟢 0.42 / 0.60 / -30.7%
clickbench_q28/datafusion:vortex-file-compressed 567544563 / 1425963002 / -60.2% 🟢 610373536 / 1506893167 / -59.5% 🟢 0.93 / 0.95 / -1.7%
clickbench_q29/datafusion:vortex-file-compressed 25646644 / 38018090 / -32.5% 🟢 49972262 / 93477899 / -46.5% 🟢 0.51 / 0.41 / +26.2%
clickbench_q30/datafusion:vortex-file-compressed 86213622 / 171102150 / -49.6% 🟢 121763497 / 249801381 / -51.3% 🟢 0.71 / 0.68 / +3.4%
clickbench_q31/datafusion:vortex-file-compressed 85161307 / 195101996 / -56.4% 🟢 155143532 / 320135302 / -51.5% 🟢 0.55 / 0.61 / -9.9%
clickbench_q32/datafusion:vortex-file-compressed 303899488 / 827491971 / -63.3% 🟢 370278849 / 944363975 / -60.8% 🟢 0.82 / 0.88 / -6.3%
clickbench_q33/datafusion:vortex-file-compressed 334792886 / 1008411260 / -66.8% 🟢 415013403 / 1212630290 / -65.8% 🟢 0.81 / 0.83 / -3.0%
clickbench_q34/datafusion:vortex-file-compressed 342586358 / 1008888868 / -66.0% 🟢 427945824 / 1181763217 / -63.8% 🟢 0.80 / 0.85 / -6.2%
clickbench_q35/datafusion:vortex-file-compressed 57908958 / 150893917 / -61.6% 🟢 89805336 / 219337418 / -59.1% 🟢 0.64 / 0.69 / -6.3%
clickbench_q36/datafusion:vortex-file-compressed 37589754 / 57273442 / -34.4% 🟢 67443513 / 117796463 / -42.7% 🟢 0.56 / 0.49 / +14.6%
clickbench_q37/datafusion:vortex-file-compressed 22231494 / 28891052 / -23.1% 🟢 48411949 / 82252628 / -41.1% 🟢 0.46 / 0.35 / +30.7%
clickbench_q38/datafusion:vortex-file-compressed 12195406 / 14946248 / -18.4% 🟢 41812629 / 70249370 / -40.5% 🟢 0.29 / 0.21 / +37.1%
clickbench_q39/datafusion:vortex-file-compressed 79184246 / 111502420 / -29.0% 🟢 111461655 / 183728266 / -39.3% 🟢 0.71 / 0.61 / +17.1%
clickbench_q40/datafusion:vortex-file-compressed 11538083 / 13498886 / -14.5% 🟢 38994868 / 65255804 / -40.2% 🟢 0.30 / 0.21 / +43.0%
clickbench_q41/datafusion:vortex-file-compressed 10927617 / 12773094 / -14.4% 🟢 36522224 / 63842765 / -42.8% 🟢 0.30 / 0.20 / +49.5%
clickbench_q42/datafusion:vortex-file-compressed 11267454 / 13531858 / -16.7% 🟢 35943031 / 61497726 / -41.6% 🟢 0.31 / 0.22 / +42.5%
datafusion / vortex-compact / ns (0.433x ✅, 43↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1234450 / 1907006 / -35.3% 🟢 20834461 / 39572904 / -47.4% 🟢 0.06 / 0.05 / +23.0%
clickbench_q01/datafusion:vortex-compact 8799726 / 14530223 / -39.4% 🟢 30412422 / 61056868 / -50.2% 🟢 0.29 / 0.24 / +21.6%
clickbench_q02/datafusion:vortex-compact 22135942 / 56273096 / -60.7% 🟢 44961561 / 99351264 / -54.7% 🟢 0.49 / 0.57 / -13.1%
clickbench_q03/datafusion:vortex-compact 14782783 / 34896204 / -57.6% 🟢 41733789 / 83277741 / -49.9% 🟢 0.35 / 0.42 / -15.5%
clickbench_q04/datafusion:vortex-compact 56614534 / 159929766 / -64.6% 🟢 83871974 / 232055944 / -63.9% 🟢 0.68 / 0.69 / -2.1%
clickbench_q05/datafusion:vortex-compact 86321668 / 233630559 / -63.1% 🟢 119690461 / 309869577 / -61.4% 🟢 0.72 / 0.75 / -4.3%
clickbench_q06/datafusion:vortex-compact 1249074 / 1895645 / -34.1% 🟢 21720995 / 37944815 / -42.8% 🟢 0.06 / 0.05 / +15.1%
clickbench_q07/datafusion:vortex-compact 13204164 / 25033066 / -47.3% 🟢 36472712 / 69506541 / -47.5% 🟢 0.36 / 0.36 / +0.5%
clickbench_q08/datafusion:vortex-compact 85819904 / 247871364 / -65.4% 🟢 116050191 / 323208080 / -64.1% 🟢 0.74 / 0.77 / -3.6%
clickbench_q09/datafusion:vortex-compact 196572608 / 393792217 / -50.1% 🟢 224286771 / 455507495 / -50.8% 🟢 0.88 / 0.86 / +1.4%
clickbench_q10/datafusion:vortex-compact 44470650 / 117226104 / -62.1% 🟢 72403646 / 169010200 / -57.2% 🟢 0.61 / 0.69 / -11.4%
clickbench_q11/datafusion:vortex-compact 57149978 / 158418759 / -63.9% 🟢 84049017 / 208415947 / -59.7% 🟢 0.68 / 0.76 / -10.5%
clickbench_q12/datafusion:vortex-compact 86971635 / 226897817 / -61.7% 🟢 124980443 / 310273144 / -59.7% 🟢 0.70 / 0.73 / -4.8%
clickbench_q13/datafusion:vortex-compact 138430540 / 380791222 / -63.6% 🟢 179090878 / 469289007 / -61.8% 🟢 0.77 / 0.81 / -4.7%
clickbench_q14/datafusion:vortex-compact 94517218 / 227172694 / -58.4% 🟢 132259154 / 316245552 / -58.2% 🟢 0.71 / 0.72 / -0.5%
clickbench_q15/datafusion:vortex-compact 61899214 / 189596274 / -67.4% 🟢 93899548 / 257857338 / -63.6% 🟢 0.66 / 0.74 / -10.3%
clickbench_q16/datafusion:vortex-compact 166248467 / 501624896 / -66.9% 🟢 207918227 / 576553452 / -63.9% 🟢 0.80 / 0.87 / -8.1%
clickbench_q17/datafusion:vortex-compact 165488900 / 498578434 / -66.8% 🟢 209848413 / 583603089 / -64.0% 🟢 0.79 / 0.85 / -7.7%
clickbench_q18/datafusion:vortex-compact 302197387 / 890211436 / -66.1% 🟢 352826367 / 988159180 / -64.3% 🟢 0.86 / 0.90 / -4.9%
clickbench_q19/datafusion:vortex-compact 10866202 / 23666205 / -54.1% 🟢 40101005 / 74054377 / -45.8% 🟢 0.27 / 0.32 / -15.2%
clickbench_q20/datafusion:vortex-compact 72592908 / 224318381 / -67.6% 🟢 198262307 / 353108726 / -43.9% 🟢 0.37 / 0.64 / -42.4%
clickbench_q21/datafusion:vortex-compact 118033451 / 378116760 / -68.8% 🟢 230654597 / 504016821 / -54.2% 🟢 0.51 / 0.75 / -31.8%
clickbench_q22/datafusion:vortex-compact 187413266 / 606246524 / -69.1% 🟢 270270162 / 719500657 / -62.4% 🟢 0.69 / 0.84 / -17.7%
clickbench_q23/datafusion:vortex-compact 582508966 / 1703889878 / -65.8% 🟢 666210062 / 2085449436 / -68.1% 🟢 0.87 / 0.82 / +7.0%
clickbench_q24/datafusion:vortex-compact 29299436 / 74026157 / -60.4% 🟢 63080685 / 129748697 / -51.4% 🟢 0.46 / 0.57 / -18.6%
clickbench_q25/datafusion:vortex-compact 38320174 / 104736548 / -63.4% 🟢 72875818 / 163276859 / -55.4% 🟢 0.53 / 0.64 / -18.0%
clickbench_q26/datafusion:vortex-compact 28653188 / 73717714 / -61.1% 🟢 62687288 / 132354766 / -52.6% 🟢 0.46 / 0.56 / -17.9%
clickbench_q27/datafusion:vortex-compact 105494296 / 319946218 / -67.0% 🟢 210579685 / 468501261 / -55.1% 🟢 0.50 / 0.68 / -26.6%
clickbench_q28/datafusion:vortex-compact 581397308 / 1531265486 / -62.0% 🟢 611377581 / 1584624375 / -61.4% 🟢 0.95 / 0.97 / -1.6%
clickbench_q29/datafusion:vortex-compact 31363761 / 64454266 / -51.3% 🟢 56260789 / 112972170 / -50.2% 🟢 0.56 / 0.57 / -2.3%
clickbench_q30/datafusion:vortex-compact 96231351 / 262237904 / -63.3% 🟢 130834297 / 328148594 / -60.1% 🟢 0.74 / 0.80 / -8.0%
clickbench_q31/datafusion:vortex-compact 102951329 / 279795554 / -63.2% 🟢 152832328 / 377344731 / -59.5% 🟢 0.67 / 0.74 / -9.2%
clickbench_q32/datafusion:vortex-compact 305043041 / 828113358 / -63.2% 🟢 369148078 / 935373767 / -60.5% 🟢 0.83 / 0.89 / -6.7%
clickbench_q33/datafusion:vortex-compact 344944638 / 1022439194 / -66.3% 🟢 411222693 / 1202163117 / -65.8% 🟢 0.84 / 0.85 / -1.4%
clickbench_q34/datafusion:vortex-compact 340362778 / 1018466426 / -66.6% 🟢 419457409 / 1228322404 / -65.9% 🟢 0.81 / 0.83 / -2.1%
clickbench_q35/datafusion:vortex-compact 63048791 / 161896408 / -61.1% 🟢 91582395 / 230840420 / -60.3% 🟢 0.69 / 0.70 / -1.8%
clickbench_q36/datafusion:vortex-compact 38512116 / 57748602 / -33.3% 🟢 67290747 / 117247989 / -42.6% 🟢 0.57 / 0.49 / +16.2%
clickbench_q37/datafusion:vortex-compact 22349952 / 29625656 / -24.6% 🟢 47309409 / 84230654 / -43.8% 🟢 0.47 / 0.35 / +34.3%
clickbench_q38/datafusion:vortex-compact 12700858 / 16963668 / -25.1% 🟢 42078237 / 73201255 / -42.5% 🟢 0.30 / 0.23 / +30.2%
clickbench_q39/datafusion:vortex-compact 79603096 / 114831748 / -30.7% 🟢 111926620 / 183922140 / -39.1% 🟢 0.71 / 0.62 / +13.9%
clickbench_q40/datafusion:vortex-compact 12370660 / 15583308 / -20.6% 🟢 37269120 / 65289829 / -42.9% 🟢 0.33 / 0.24 / +39.1%
clickbench_q41/datafusion:vortex-compact 12823876 / 17215112 / -25.5% 🟢 37588725 / 64010262 / -41.3% 🟢 0.34 / 0.27 / +26.9%
clickbench_q42/datafusion:vortex-compact 11228279 / 14051164 / -20.1% 🟢 34503941 / 59911595 / -42.4% 🟢 0.33 / 0.23 / +38.8%
datafusion / parquet / ns (0.495x ✅, 41↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1347023 / 1919190 / -29.8% 🟢 48414789 / 74850592 / -35.3% 🟢 0.03 / 0.03 / +8.5%
clickbench_q01/datafusion:parquet 15959068 / 16752490 / -4.7% 67693869 / 110526433 / -38.8% 🟢 0.24 / 0.15 / +55.5%
clickbench_q02/datafusion:parquet 19266051 / 31948106 / -39.7% 🟢 80546045 / 137411338 / -41.4% 🟢 0.24 / 0.23 / +2.9%
clickbench_q03/datafusion:parquet 17328818 / 27828592 / -37.7% 🟢 81387276 / 135624270 / -40.0% 🟢 0.21 / 0.21 / +3.8%
clickbench_q04/datafusion:parquet 61274614 / 173589226 / -64.7% 🟢 124673126 / 299970538 / -58.4% 🟢 0.49 / 0.58 / -15.1%
clickbench_q05/datafusion:parquet 87079944 / 234298674 / -62.8% 🟢 155323373 / 369069805 / -57.9% 🟢 0.56 / 0.63 / -11.7%
clickbench_q06/datafusion:parquet 1263214 / 1920754 / -34.2% 🟢 48592478 / 75838884 / -35.9% 🟢 0.03 / 0.03 / +2.6%
clickbench_q07/datafusion:parquet 16839284 / 18185464 / -7.4% 68977427 / 108352263 / -36.3% 🟢 0.24 / 0.17 / +45.5%
clickbench_q08/datafusion:parquet 83731610 / 232312739 / -64.0% 🟢 162418712 / 373495391 / -56.5% 🟢 0.52 / 0.62 / -17.1%
clickbench_q09/datafusion:parquet 188860362 / 359187688 / -47.4% 🟢 269589846 / 499471247 / -46.0% 🟢 0.70 / 0.72 / -2.6%
clickbench_q10/datafusion:parquet 35439569 / 71999924 / -50.8% 🟢 101808539 / 192105415 / -47.0% 🟢 0.35 / 0.37 / -7.1%
clickbench_q11/datafusion:parquet 42271540 / 87272802 / -51.6% 🟢 108378425 / 208633673 / -48.1% 🟢 0.39 / 0.42 / -6.8%
clickbench_q12/datafusion:parquet 93648904 / 238996602 / -60.8% 🟢 159800356 / 374133171 / -57.3% 🟢 0.59 / 0.64 / -8.3%
clickbench_q13/datafusion:parquet 144171204 / 397056362 / -63.7% 🟢 220339156 / 539930731 / -59.2% 🟢 0.65 / 0.74 / -11.0%
clickbench_q14/datafusion:parquet 100132432 / 255107037 / -60.7% 🟢 172767959 / 399168417 / -56.7% 🟢 0.58 / 0.64 / -9.3%
clickbench_q15/datafusion:parquet 73071279 / 196985632 / -62.9% 🟢 128540310 / 324885504 / -60.4% 🟢 0.57 / 0.61 / -6.2%
clickbench_q16/datafusion:parquet 154248732 / 476857338 / -67.7% 🟢 230286094 / 625755324 / -63.2% 🟢 0.67 / 0.76 / -12.1%
clickbench_q17/datafusion:parquet 154898940 / 465933312 / -66.8% 🟢 234452355 / 628220577 / -62.7% 🟢 0.66 / 0.74 / -10.9%
clickbench_q18/datafusion:parquet 309867488 / 892808319 / -65.3% 🟢 410532716 / 1063188462 / -61.4% 🟢 0.75 / 0.84 / -10.1%
clickbench_q19/datafusion:parquet 19534276 / 23982830 / -18.5% 🟢 77413742 / 118401396 / -34.6% 🟢 0.25 / 0.20 / +24.6%
clickbench_q20/datafusion:parquet 167865395 / 453125058 / -63.0% 🟢 280270659 / 607849669 / -53.9% 🟢 0.60 / 0.75 / -19.7%
clickbench_q21/datafusion:parquet 163577448 / 434209160 / -62.3% 🟢 293521364 / 617457088 / -52.5% 🟢 0.56 / 0.70 / -20.8%
clickbench_q22/datafusion:parquet 248254578 / 609464877 / -59.3% 🟢 420147773 / 831305469 / -49.5% 🟢 0.59 / 0.73 / -19.4%
clickbench_q23/datafusion:parquet 959128446 / 2397198856 / -60.0% 🟢 1192279549 / 2898438302 / -58.9% 🟢 0.80 / 0.83 / -2.7%
clickbench_q24/datafusion:parquet 29808502 / 40765839 / -26.9% 🟢 89334974 / 140703816 / -36.5% 🟢 0.33 / 0.29 / +15.2%
clickbench_q25/datafusion:parquet 35911236 / 87921712 / -59.2% 🟢 101124286 / 197015927 / -48.7% 🟢 0.36 / 0.45 / -20.4%
clickbench_q26/datafusion:parquet 30798001 / 42415082 / -27.4% 🟢 89688769 / 144479578 / -37.9% 🟢 0.34 / 0.29 / +17.0%
clickbench_q27/datafusion:parquet 181092002 / 526143124 / -65.6% 🟢 290875724 / 673606984 / -56.8% 🟢 0.62 / 0.78 / -20.3%
clickbench_q28/datafusion:parquet 615995566 / 1532893528 / -59.8% 🟢 693508415 / 1648480377 / -57.9% 🟢 0.89 / 0.93 / -4.5%
clickbench_q29/datafusion:parquet 29527788 / 40404672 / -26.9% 🟢 89944834 / 144329488 / -37.7% 🟢 0.33 / 0.28 / +17.3%
clickbench_q30/datafusion:parquet 88324552 / 232152649 / -62.0% 🟢 174032248 / 385895129 / -54.9% 🟢 0.51 / 0.60 / -15.6%
clickbench_q31/datafusion:parquet 99260322 / 263763431 / -62.4% 🟢 200165903 / 432008273 / -53.7% 🟢 0.50 / 0.61 / -18.8%
clickbench_q32/datafusion:parquet 318177166 / 844309537 / -62.3% 🟢 411842245 / 1032339393 / -60.1% 🟢 0.77 / 0.82 / -5.5%
clickbench_q33/datafusion:parquet 365745028 / 1087611999 / -66.4% 🟢 456016434 / 1252587388 / -63.6% 🟢 0.80 / 0.87 / -7.6%
clickbench_q34/datafusion:parquet 365671914 / 1090460556 / -66.5% 🟢 459457785 / 1292142935 / -64.4% 🟢 0.80 / 0.84 / -5.7%
clickbench_q35/datafusion:parquet 63601784 / 163360808 / -61.1% 🟢 124384850 / 283058452 / -56.1% 🟢 0.51 / 0.58 / -11.4%
clickbench_q36/datafusion:parquet 73387208 / 107740537 / -31.9% 🟢 137087862 / 216068578 / -36.6% 🟢 0.54 / 0.50 / +7.4%
clickbench_q37/datafusion:parquet 35742228 / 48355936 / -26.1% 🟢 92673581 / 143962033 / -35.6% 🟢 0.39 / 0.34 / +14.8%
clickbench_q38/datafusion:parquet 47373380 / 65593433 / -27.8% 🟢 108294955 / 167786231 / -35.5% 🟢 0.44 / 0.39 / +11.9%
clickbench_q39/datafusion:parquet 143300298 / 202941156 / -29.4% 🟢 211964412 / 321776316 / -34.1% 🟢 0.68 / 0.63 / +7.2%
clickbench_q40/datafusion:parquet 20549664 / 26958328 / -23.8% 🟢 77576933 / 124836837 / -37.9% 🟢 0.26 / 0.22 / +22.7%
clickbench_q41/datafusion:parquet 19121009 / 25953585 / -26.3% 🟢 77402824 / 118085541 / -34.5% 🟢 0.25 / 0.22 / +12.4%
clickbench_q42/datafusion:parquet 19801648 / 25981906 / -23.8% 🟢 76613027 / 117291859 / -34.7% 🟢 0.26 / 0.22 / +16.7%
duckdb / vortex-file-compressed / ns (0.566x ✅, 43↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1728249 / 2027081 / -14.7% 🟢 27553969 / 74182868 / -62.9% 🟢 0.06 / 0.03 / +129.5%
clickbench_q01/duckdb:vortex-file-compressed 12750334 / 18922216 / -32.6% 🟢 30703391 / 102934726 / -70.2% 🟢 0.42 / 0.18 / +125.9%
clickbench_q02/duckdb:vortex-file-compressed 14104280 / 24642278 / -42.8% 🟢 35974451 / 109768357 / -67.2% 🟢 0.39 / 0.22 / +74.6%
clickbench_q03/duckdb:vortex-file-compressed 18894042 / 33043206 / -42.8% 🟢 48913856 / 113511305 / -56.9% 🟢 0.39 / 0.29 / +32.7%
clickbench_q04/duckdb:vortex-file-compressed 70160608 / 132086008 / -46.9% 🟢 101207362 / 206484585 / -51.0% 🟢 0.69 / 0.64 / +8.4%
clickbench_q05/duckdb:vortex-file-compressed 69701532 / 156892894 / -55.6% 🟢 92291065 / 242855677 / -62.0% 🟢 0.76 / 0.65 / +16.9%
clickbench_q06/duckdb:vortex-file-compressed 2066992 / 2475513 / -16.5% 🟢 30378061 / 93217768 / -67.4% 🟢 0.07 / 0.03 / +156.2%
clickbench_q07/duckdb:vortex-file-compressed 15836201 / 22566738 / -29.8% 🟢 31356131 / 99078923 / -68.4% 🟢 0.51 / 0.23 / +121.7%
clickbench_q08/duckdb:vortex-file-compressed 85658678 / 171690977 / -50.1% 🟢 128667743 / 288712675 / -55.4% 🟢 0.67 / 0.59 / +11.9%
clickbench_q09/duckdb:vortex-file-compressed 113363008 / 211619386 / -46.4% 🟢 149287523 / 335311698 / -55.5% 🟢 0.76 / 0.63 / +20.3%
clickbench_q10/duckdb:vortex-file-compressed 45054818 / 73943003 / -39.1% 🟢 78245137 / 182403735 / -57.1% 🟢 0.58 / 0.41 / +42.0%
clickbench_q11/duckdb:vortex-file-compressed 58609880 / 92282208 / -36.5% 🟢 88712592 / 197401273 / -55.1% 🟢 0.66 / 0.47 / +41.3%
clickbench_q12/duckdb:vortex-file-compressed 76260614 / 172712882 / -55.8% 🟢 108643911 / 291647616 / -62.7% 🟢 0.70 / 0.59 / +18.5%
clickbench_q13/duckdb:vortex-file-compressed 144237208 / 319893279 / -54.9% 🟢 182906368 / 446116731 / -59.0% 🟢 0.79 / 0.72 / +10.0%
clickbench_q14/duckdb:vortex-file-compressed 87482158 / 188509591 / -53.6% 🟢 112888288 / 311323839 / -63.7% 🟢 0.77 / 0.61 / +28.0%
clickbench_q15/duckdb:vortex-file-compressed 92772778 / 190257292 / -51.2% 🟢 131464509 / 289953909 / -54.7% 🟢 0.71 / 0.66 / +7.5%
clickbench_q16/duckdb:vortex-file-compressed 163317831 / 375892397 / -56.6% 🟢 232592684 / 484219247 / -52.0% 🟢 0.70 / 0.78 / -9.5%
clickbench_q17/duckdb:vortex-file-compressed 165050086 / 366346696 / -54.9% 🟢 210793826 / 490955044 / -57.1% 🟢 0.78 / 0.75 / +4.9%
clickbench_q18/duckdb:vortex-file-compressed 323314298 / 735897868 / -56.1% 🟢 388073788 / 897007083 / -56.7% 🟢 0.83 / 0.82 / +1.6%
clickbench_q19/duckdb:vortex-file-compressed 17252329 / 26901372 / -35.9% 🟢 43126670 / 110019419 / -60.8% 🟢 0.40 / 0.24 / +63.6%
clickbench_q20/duckdb:vortex-file-compressed 126516432 / 243208596 / -48.0% 🟢 209184931 / 450659328 / -53.6% 🟢 0.60 / 0.54 / +12.1%
clickbench_q21/duckdb:vortex-file-compressed 180940218 / 365200389 / -50.5% 🟢 322075110 / 658540060 / -51.1% 🟢 0.56 / 0.55 / +1.3%
clickbench_q22/duckdb:vortex-file-compressed 283191230 / 561729649 / -49.6% 🟢 540357595 / 969460395 / -44.3% 🟢 0.52 / 0.58 / -9.6%
clickbench_q23/duckdb:vortex-file-compressed 69779756 / 123060230 / -43.3% 🟢 115330505 / 233902433 / -50.7% 🟢 0.61 / 0.53 / +15.0%
clickbench_q24/duckdb:vortex-file-compressed 29285656 / 38832162 / -24.6% 🟢 46784406 / 98636241 / -52.6% 🟢 0.63 / 0.39 / +59.0%
clickbench_q25/duckdb:vortex-file-compressed 36329827 / 60958140 / -40.4% 🟢 53469703 / 145485553 / -63.2% 🟢 0.68 / 0.42 / +62.2%
clickbench_q26/duckdb:vortex-file-compressed 24005718 / 34840538 / -31.1% 🟢 37259878 / 85977098 / -56.7% 🟢 0.64 / 0.41 / +59.0%
clickbench_q27/duckdb:vortex-file-compressed 172853259 / 247733218 / -30.2% 🟢 285868603 / 497374838 / -42.5% 🟢 0.60 / 0.50 / +21.4%
clickbench_q28/duckdb:vortex-file-compressed 620438092 / 1179517654 / -47.4% 🟢 700111034 / 1556108099 / -55.0% 🟢 0.89 / 0.76 / +16.9%
clickbench_q29/duckdb:vortex-file-compressed 18837080 / 30237942 / -37.7% 🟢 40982394 / 117412150 / -65.1% 🟢 0.46 / 0.26 / +78.5%
clickbench_q30/duckdb:vortex-file-compressed 95399040 / 167712246 / -43.1% 🟢 130638210 / 296147810 / -55.9% 🟢 0.73 / 0.57 / +28.9%
clickbench_q31/duckdb:vortex-file-compressed 144007104 / 312298199 / -53.9% 🟢 227110500 / 479350080 / -52.6% 🟢 0.63 / 0.65 / -2.7%
clickbench_q32/duckdb:vortex-file-compressed 430474784 / 910016020 / -52.7% 🟢 486410644 / 1067928290 / -54.5% 🟢 0.89 / 0.85 / +3.9%
clickbench_q33/duckdb:vortex-file-compressed 415866762 / 1047606028 / -60.3% 🟢 538363050 / 1265611491 / -57.5% 🟢 0.77 / 0.83 / -6.7%
clickbench_q34/duckdb:vortex-file-compressed 429005748 / 1075733080 / -60.1% 🟢 553694659 / 1343204094 / -58.8% 🟢 0.77 / 0.80 / -3.3%
clickbench_q35/duckdb:vortex-file-compressed 104716266 / 209806304 / -50.1% 🟢 137075376 / 288696916 / -52.5% 🟢 0.76 / 0.73 / +5.1%
clickbench_q36/duckdb:vortex-file-compressed 18362662 / 30321250 / -39.4% 🟢 38626374 / 127046859 / -69.6% 🟢 0.48 / 0.24 / +99.2%
clickbench_q37/duckdb:vortex-file-compressed 13716515 / 18585794 / -26.2% 🟢 29314489 / 97414496 / -69.9% 🟢 0.47 / 0.19 / +145.2%
clickbench_q38/duckdb:vortex-file-compressed 14979655 / 22151942 / -32.4% 🟢 30982462 / 88265282 / -64.9% 🟢 0.48 / 0.25 / +92.6%
clickbench_q39/duckdb:vortex-file-compressed 26972004 / 45708143 / -41.0% 🟢 42109754 / 126094748 / -66.6% 🟢 0.64 / 0.36 / +76.7%
clickbench_q40/duckdb:vortex-file-compressed 12326672 / 17015213 / -27.6% 🟢 26803567 / 72918517 / -63.2% 🟢 0.46 / 0.23 / +97.1%
clickbench_q41/duckdb:vortex-file-compressed 13383418 / 19834565 / -32.5% 🟢 27396875 / 92012646 / -70.2% 🟢 0.49 / 0.22 / +126.6%
clickbench_q42/duckdb:vortex-file-compressed 13634238 / 17801492 / -23.4% 🟢 30389900 / 100369932 / -69.7% 🟢 0.45 / 0.18 / +153.0%
duckdb / vortex-compact / ns (0.564x ✅, 43↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1705126 / 2031874 / -16.1% 🟢 26161603 / 76049731 / -65.6% 🟢 0.07 / 0.03 / +143.9%
clickbench_q01/duckdb:vortex-compact 12879910 / 20816995 / -38.1% 🟢 27240943 / 99546746 / -72.6% 🟢 0.47 / 0.21 / +126.1%
clickbench_q02/duckdb:vortex-compact 20818420 / 35148480 / -40.8% 🟢 41258343 / 118000777 / -65.0% 🟢 0.50 / 0.30 / +69.4%
clickbench_q03/duckdb:vortex-compact 21137121 / 36217868 / -41.6% 🟢 47247560 / 96547933 / -51.1% 🟢 0.45 / 0.38 / +19.3%
clickbench_q04/duckdb:vortex-compact 72708178 / 140655722 / -48.3% 🟢 104076418 / 204611014 / -49.1% 🟢 0.70 / 0.69 / +1.6%
clickbench_q05/duckdb:vortex-compact 77042246 / 161467103 / -52.3% 🟢 98741084 / 240171978 / -58.9% 🟢 0.78 / 0.67 / +16.1%
clickbench_q06/duckdb:vortex-compact 2094717 / 2436110 / -14.0% 🟢 29782917 / 98218113 / -69.7% 🟢 0.07 / 0.02 / +183.6%
clickbench_q07/duckdb:vortex-compact 15425773 / 22330820 / -30.9% 🟢 33294074 / 103007988 / -67.7% 🟢 0.46 / 0.22 / +113.7%
clickbench_q08/duckdb:vortex-compact 102061478 / 188949864 / -46.0% 🟢 134172372 / 296039617 / -54.7% 🟢 0.76 / 0.64 / +19.2%
clickbench_q09/duckdb:vortex-compact 140267090 / 264714688 / -47.0% 🟢 177719404 / 380762899 / -53.3% 🟢 0.79 / 0.70 / +13.5%
clickbench_q10/duckdb:vortex-compact 53575797 / 87139406 / -38.5% 🟢 90680407 / 193233512 / -53.1% 🟢 0.59 / 0.45 / +31.0%
clickbench_q11/duckdb:vortex-compact 68753630 / 109874072 / -37.4% 🟢 105555293 / 221608971 / -52.4% 🟢 0.65 / 0.50 / +31.4%
clickbench_q12/duckdb:vortex-compact 92123216 / 188918949 / -51.2% 🟢 119940313 / 295149355 / -59.4% 🟢 0.77 / 0.64 / +20.0%
clickbench_q13/duckdb:vortex-compact 163381130 / 347262398 / -53.0% 🟢 209107497 / 471725699 / -55.7% 🟢 0.78 / 0.74 / +6.1%
clickbench_q14/duckdb:vortex-compact 98313767 / 204988294 / -52.0% 🟢 129004206 / 309467960 / -58.3% 🟢 0.76 / 0.66 / +15.1%
clickbench_q15/duckdb:vortex-compact 96573847 / 190915928 / -49.4% 🟢 131657403 / 296349946 / -55.6% 🟢 0.73 / 0.64 / +13.9%
clickbench_q16/duckdb:vortex-compact 183772796 / 396464476 / -53.6% 🟢 224932682 / 512060370 / -56.1% 🟢 0.82 / 0.77 / +5.5%
clickbench_q17/duckdb:vortex-compact 181742370 / 390814082 / -53.5% 🟢 230956976 / 494725454 / -53.3% 🟢 0.79 / 0.79 / -0.4%
clickbench_q18/duckdb:vortex-compact 326687884 / 735545736 / -55.6% 🟢 384610519 / 844127190 / -54.4% 🟢 0.85 / 0.87 / -2.5%
clickbench_q19/duckdb:vortex-compact 18227086 / 26120072 / -30.2% 🟢 40714409 / 101060559 / -59.7% 🟢 0.45 / 0.26 / +73.2%
clickbench_q20/duckdb:vortex-compact 111764534 / 215531689 / -48.1% 🟢 182352717 / 393942166 / -53.7% 🟢 0.61 / 0.55 / +12.0%
clickbench_q21/duckdb:vortex-compact 195123385 / 357406499 / -45.4% 🟢 374021857 / 659382583 / -43.3% 🟢 0.52 / 0.54 / -3.8%
clickbench_q22/duckdb:vortex-compact 383557540 / 685398222 / -44.0% 🟢 658942689 / 1083407985 / -39.2% 🟢 0.58 / 0.63 / -8.0%
clickbench_q23/duckdb:vortex-compact 97373898 / 199956518 / -51.3% 🟢 132466370 / 275181591 / -51.9% 🟢 0.74 / 0.73 / +1.2%
clickbench_q24/duckdb:vortex-compact 34024733 / 45820666 / -25.7% 🟢 43313963 / 101356981 / -57.3% 🟢 0.79 / 0.45 / +73.8%
clickbench_q25/duckdb:vortex-compact 49016396 / 82286288 / -40.4% 🟢 70338221 / 148208445 / -52.5% 🟢 0.70 / 0.56 / +25.5%
clickbench_q26/duckdb:vortex-compact 26699496 / 40105709 / -33.4% 🟢 35805739 / 92278667 / -61.2% 🟢 0.75 / 0.43 / +71.6%
clickbench_q27/duckdb:vortex-compact 206794119 / 398412841 / -48.1% 🟢 357317403 / 648638006 / -44.9% 🟢 0.58 / 0.61 / -5.8%
clickbench_q28/duckdb:vortex-compact 635103957 / 1132281209 / -43.9% 🟢 718426485 / 1368371737 / -47.5% 🟢 0.88 / 0.83 / +6.8%
clickbench_q29/duckdb:vortex-compact 24669935 / 42210434 / -41.6% 🟢 47081766 / 126108818 / -62.7% 🟢 0.52 / 0.33 / +56.5%
clickbench_q30/duckdb:vortex-compact 112534862 / 206369386 / -45.5% 🟢 151972387 / 315125270 / -51.8% 🟢 0.74 / 0.65 / +13.1%
clickbench_q31/duckdb:vortex-compact 174525438 / 333340703 / -47.6% 🟢 253903026 / 543860652 / -53.3% 🟢 0.69 / 0.61 / +12.1%
clickbench_q32/duckdb:vortex-compact 467919157 / 942690998 / -50.4% 🟢 513653663 / 1083279379 / -52.6% 🟢 0.91 / 0.87 / +4.7%
clickbench_q33/duckdb:vortex-compact 401155836 / 982286930 / -59.2% 🟢 546335231 / 1208561522 / -54.8% 🟢 0.73 / 0.81 / -9.7%
clickbench_q34/duckdb:vortex-compact 421195612 / 1027511486 / -59.0% 🟢 574319035 / 1302578657 / -55.9% 🟢 0.73 / 0.79 / -7.0%
clickbench_q35/duckdb:vortex-compact 106985430 / 220235765 / -51.4% 🟢 140103218 / 309804041 / -54.8% 🟢 0.76 / 0.71 / +7.4%
clickbench_q36/duckdb:vortex-compact 17608202 / 29525859 / -40.4% 🟢 34275649 / 132127189 / -74.1% 🟢 0.51 / 0.22 / +129.9%
clickbench_q37/duckdb:vortex-compact 16474246 / 22755177 / -27.6% 🟢 30220145 / 111251866 / -72.8% 🟢 0.55 / 0.20 / +166.5%
clickbench_q38/duckdb:vortex-compact 15268368 / 24738896 / -38.3% 🟢 30619429 / 114339673 / -73.2% 🟢 0.50 / 0.22 / +130.5%
clickbench_q39/duckdb:vortex-compact 26639078 / 50319936 / -47.1% 🟢 46076727 / 134453267 / -65.7% 🟢 0.58 / 0.37 / +54.5%
clickbench_q40/duckdb:vortex-compact 13848866 / 20440657 / -32.2% 🟢 29142620 / 82500576 / -64.7% 🟢 0.48 / 0.25 / +91.8%
clickbench_q41/duckdb:vortex-compact 14456258 / 22595871 / -36.0% 🟢 28801012 / 91147742 / -68.4% 🟢 0.50 / 0.25 / +102.5%
clickbench_q42/duckdb:vortex-compact 12643849 / 18301276 / -30.9% 🟢 26958255 / 89509871 / -69.9% 🟢 0.47 / 0.20 / +129.4%
duckdb / parquet / ns (0.537x ✅, 43↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 7778374 / 17294224 / -55.0% 🟢 18914171 / 42959747 / -56.0% 🟢 0.41 / 0.40 / +2.2%
clickbench_q01/duckdb:parquet 8863141 / 17116173 / -48.2% 🟢 22095199 / 35449707 / -37.7% 🟢 0.40 / 0.48 / -16.9%
clickbench_q02/duckdb:parquet 15379026 / 26023850 / -40.9% 🟢 33213179 / 56610092 / -41.3% 🟢 0.46 / 0.46 / +0.7%
clickbench_q03/duckdb:parquet 16092476 / 28860072 / -44.2% 🟢 53859177 / 82198516 / -34.5% 🟢 0.30 / 0.35 / -14.9%
clickbench_q04/duckdb:parquet 67964176 / 132846530 / -48.8% 🟢 88298081 / 180005450 / -50.9% 🟢 0.77 / 0.74 / +4.3%
clickbench_q05/duckdb:parquet 79980984 / 185947438 / -57.0% 🟢 115543647 / 251074512 / -54.0% 🟢 0.69 / 0.74 / -6.5%
clickbench_q06/duckdb:parquet 15073754 / 23470941 / -35.8% 🟢 27945832 / 45618259 / -38.7% 🟢 0.54 / 0.51 / +4.8%
clickbench_q07/duckdb:parquet 10841818 / 20496084 / -47.1% 🟢 23042900 / 41693954 / -44.7% 🟢 0.47 / 0.49 / -4.3%
clickbench_q08/duckdb:parquet 83303254 / 165007386 / -49.5% 🟢 125662631 / 246086562 / -48.9% 🟢 0.66 / 0.67 / -1.1%
clickbench_q09/duckdb:parquet 115398288 / 225912234 / -48.9% 🟢 165371016 / 302223498 / -45.3% 🟢 0.70 / 0.75 / -6.6%
clickbench_q10/duckdb:parquet 33229429 / 66591129 / -50.1% 🟢 71246416 / 113298197 / -37.1% 🟢 0.47 / 0.59 / -20.6%
clickbench_q11/duckdb:parquet 36479260 / 68925530 / -47.1% 🟢 75906544 / 124487335 / -39.0% 🟢 0.48 / 0.55 / -13.2%
clickbench_q12/duckdb:parquet 91702364 / 174098502 / -47.3% 🟢 131011716 / 289501006 / -54.7% 🟢 0.70 / 0.60 / +16.4%
clickbench_q13/duckdb:parquet 144837086 / 312693498 / -53.7% 🟢 213341889 / 423492076 / -49.6% 🟢 0.68 / 0.74 / -8.1%
clickbench_q14/duckdb:parquet 105960914 / 192515028 / -45.0% 🟢 138362834 / 274545496 / -49.6% 🟢 0.77 / 0.70 / +9.2%
clickbench_q15/duckdb:parquet 94796708 / 187604224 / -49.5% 🟢 120252590 / 222896426 / -46.1% 🟢 0.79 / 0.84 / -6.3%
clickbench_q16/duckdb:parquet 169273791 / 354766567 / -52.3% 🟢 240955595 / 476751942 / -49.5% 🟢 0.70 / 0.74 / -5.6%
clickbench_q17/duckdb:parquet 197824512 / 365338842 / -45.9% 🟢 250559226 / 453245776 / -44.7% 🟢 0.79 / 0.81 / -2.0%
clickbench_q18/duckdb:parquet 338249338 / 692554676 / -51.2% 🟢 404561430 / 889889445 / -54.5% 🟢 0.84 / 0.78 / +7.4%
clickbench_q19/duckdb:parquet 13079820 / 23652302 / -44.7% 🟢 44577487 / 63099384 / -29.4% 🟢 0.29 / 0.37 / -21.7%
clickbench_q20/duckdb:parquet 133842516 / 265328384 / -49.6% 🟢 241706628 / 444996793 / -45.7% 🟢 0.55 / 0.60 / -7.1%
clickbench_q21/duckdb:parquet 178900632 / 328588344 / -45.6% 🟢 323357345 / 572030962 / -43.5% 🟢 0.55 / 0.57 / -3.7%
clickbench_q22/duckdb:parquet 236701632 / 477184879 / -50.4% 🟢 415170948 / 723773855 / -42.6% 🟢 0.57 / 0.66 / -13.5%
clickbench_q23/duckdb:parquet 148445241 / 263031605 / -43.6% 🟢 183588000 / 327716709 / -44.0% 🟢 0.81 / 0.80 / +0.7%
clickbench_q24/duckdb:parquet 43154923 / 79501993 / -45.7% 🟢 62313885 / 112129989 / -44.4% 🟢 0.69 / 0.71 / -2.3%
clickbench_q25/duckdb:parquet 39637572 / 74316556 / -46.7% 🟢 94947789 / 168117217 / -43.5% 🟢 0.42 / 0.44 / -5.6%
clickbench_q26/duckdb:parquet 29827357 / 57407063 / -48.0% 🟢 49479075 / 89552877 / -44.7% 🟢 0.60 / 0.64 / -6.0%
clickbench_q27/duckdb:parquet 149233632 / 269327945 / -44.6% 🟢 258893536 / 486073004 / -46.7% 🟢 0.58 / 0.55 / +4.0%
clickbench_q28/duckdb:parquet 901105016 / 1721897053 / -47.7% 🟢 997576295 / 2234437927 / -55.4% 🟢 0.90 / 0.77 / +17.2%
clickbench_q29/duckdb:parquet 16901492 / 29531124 / -42.8% 🟢 32505419 / 59631145 / -45.5% 🟢 0.52 / 0.50 / +5.0%
clickbench_q30/duckdb:parquet 91087336 / 177233130 / -48.6% 🟢 171376495 / 313183348 / -45.3% 🟢 0.53 / 0.57 / -6.1%
clickbench_q31/duckdb:parquet 144324820 / 320584399 / -55.0% 🟢 292652522 / 546116146 / -46.4% 🟢 0.49 / 0.59 / -16.0%
clickbench_q32/duckdb:parquet 474580082 / 928010454 / -48.9% 🟢 492425772 / 1045135561 / -52.9% 🟢 0.96 / 0.89 / +8.5%
clickbench_q33/duckdb:parquet 450818302 / 787106722 / -42.7% 🟢 505965782 / 966898061 / -47.7% 🟢 0.89 / 0.81 / +9.5%
clickbench_q34/duckdb:parquet 447504830 / 800966443 / -44.1% 🟢 488284126 / 995761456 / -51.0% 🟢 0.92 / 0.80 / +13.9%
clickbench_q35/duckdb:parquet 109014936 / 208435098 / -47.7% 🟢 124983217 / 247917729 / -49.6% 🟢 0.87 / 0.84 / +3.7%
clickbench_q36/duckdb:parquet 30863965 / 51416306 / -40.0% 🟢 41714774 / 72139474 / -42.2% 🟢 0.74 / 0.71 / +3.8%
clickbench_q37/duckdb:parquet 22693064 / 37047140 / -38.7% 🟢 32080753 / 56900149 / -43.6% 🟢 0.71 / 0.65 / +8.6%
clickbench_q38/duckdb:parquet 24090090 / 38399276 / -37.3% 🟢 33680287 / 60000297 / -43.9% 🟢 0.72 / 0.64 / +11.8%
clickbench_q39/duckdb:parquet 56687144 / 89664714 / -36.8% 🟢 66474037 / 109822014 / -39.5% 🟢 0.85 / 0.82 / +4.4%
clickbench_q40/duckdb:parquet 12829788 / 21028388 / -39.0% 🟢 22305112 / 40395304 / -44.8% 🟢 0.58 / 0.52 / +10.5%
clickbench_q41/duckdb:parquet 13441547 / 22196811 / -39.4% 🟢 22936347 / 43787306 / -47.6% 🟢 0.59 / 0.51 / +15.6%
clickbench_q42/duckdb:parquet 14919579 / 23527686 / -36.6% 🟢 24060604 / 49262672 / -51.2% 🟢 0.62 / 0.48 / +29.8%

File Size Changes (83 files changed, -0.0% overall, 41↑ 42↓)
File Scale Format Base HEAD Change %
hits_21.vortex 1.0 vortex-file-compressed 92.25 MB 92.38 MB +123.72 KB +0.1%
hits_74.vortex 1.0 vortex-file-compressed 118.88 MB 118.88 MB +2.90 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 100.95 MB 100.96 MB +976 B +0.0%
hits_8.vortex 1.0 vortex-file-compressed 91.74 MB 91.74 MB +672 B +0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.82 MB 186.82 MB +1.06 KB +0.0%
hits_14.vortex 1.0 vortex-file-compressed 109.62 MB 109.62 MB +344 B +0.0%
hits_95.vortex 1.0 vortex-file-compressed 95.35 MB 95.35 MB +296 B +0.0%
hits_59.vortex 1.0 vortex-file-compressed 100.65 MB 100.65 MB +312 B +0.0%
hits_88.vortex 1.0 vortex-file-compressed 109.95 MB 109.95 MB +256 B +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.18 MB 221.18 MB +256 B +0.0%
hits_94.vortex 1.0 vortex-file-compressed 137.84 MB 137.84 MB +128 B +0.0%
hits_15.vortex 1.0 vortex-file-compressed 88.29 MB 88.29 MB +80 B +0.0%
hits_49.vortex 1.0 vortex-file-compressed 74.57 MB 74.57 MB +64 B +0.0%
hits_75.vortex 1.0 vortex-file-compressed 61.68 MB 61.68 MB +48 B +0.0%
hits_37.vortex 1.0 vortex-file-compressed 84.35 MB 84.35 MB +64 B +0.0%
hits_17.vortex 1.0 vortex-file-compressed 86.30 MB 86.30 MB +64 B +0.0%
hits_56.vortex 1.0 vortex-file-compressed 122.41 MB 122.41 MB +80 B +0.0%
hits_66.vortex 1.0 vortex-file-compressed 89.15 MB 89.15 MB +48 B +0.0%
hits_85.vortex 1.0 vortex-file-compressed 90.94 MB 90.94 MB +48 B +0.0%
hits_32.vortex 1.0 vortex-file-compressed 65.46 MB 65.46 MB +32 B +0.0%
hits_44.vortex 1.0 vortex-file-compressed 187.12 MB 187.12 MB +80 B +0.0%
hits_0.vortex 1.0 vortex-file-compressed 87.76 MB 87.76 MB +32 B +0.0%
hits_5.vortex 1.0 vortex-file-compressed 91.45 MB 91.45 MB +32 B +0.0%
hits_7.vortex 1.0 vortex-file-compressed 92.45 MB 92.45 MB +32 B +0.0%
hits_91.vortex 1.0 vortex-file-compressed 95.92 MB 95.92 MB +32 B +0.0%
hits_34.vortex 1.0 vortex-file-compressed 96.61 MB 96.61 MB +32 B +0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.86 MB 168.86 MB +48 B +0.0%
hits_40.vortex 1.0 vortex-file-compressed 116.81 MB 116.81 MB +32 B +0.0%
hits_36.vortex 1.0 vortex-file-compressed 66.37 MB 66.37 MB +16 B +0.0%
hits_19.vortex 1.0 vortex-file-compressed 72.19 MB 72.19 MB +16 B +0.0%
hits_30.vortex 1.0 vortex-file-compressed 85.22 MB 85.22 MB +16 B +0.0%
hits_70.vortex 1.0 vortex-file-compressed 92.23 MB 92.23 MB +16 B +0.0%
hits_52.vortex 1.0 vortex-file-compressed 102.95 MB 102.95 MB +16 B +0.0%
hits_97.vortex 1.0 vortex-file-compressed 106.36 MB 106.36 MB +16 B +0.0%
hits_26.vortex 1.0 vortex-file-compressed 108.66 MB 108.66 MB +16 B +0.0%
hits_41.vortex 1.0 vortex-file-compressed 223.98 MB 223.98 MB +32 B +0.0%
hits_45.vortex 1.0 vortex-file-compressed 121.13 MB 121.13 MB +16 B +0.0%
hits_1.vortex 1.0 vortex-file-compressed 137.87 MB 137.87 MB +16 B +0.0%
hits_78.vortex 1.0 vortex-file-compressed 163.88 MB 163.88 MB +16 B +0.0%
hits_55.vortex 1.0 vortex-file-compressed 168.11 MB 168.11 MB +16 B +0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.63 MB 227.63 MB +16 B +0.0%
hits_79.vortex 1.0 vortex-file-compressed 143.47 MB 143.47 MB 16 B -0.0%
hits_68.vortex 1.0 vortex-file-compressed 121.95 MB 121.95 MB 16 B -0.0%
hits_18.vortex 1.0 vortex-file-compressed 103.45 MB 103.45 MB 16 B -0.0%
hits_65.vortex 1.0 vortex-file-compressed 184.24 MB 184.24 MB 32 B -0.0%
hits_62.vortex 1.0 vortex-file-compressed 116.56 MB 116.56 MB 32 B -0.0%
hits_81.vortex 1.0 vortex-file-compressed 99.37 MB 99.37 MB 32 B -0.0%
hits_12.vortex 1.0 vortex-file-compressed 99.10 MB 99.10 MB 32 B -0.0%
hits_69.vortex 1.0 vortex-file-compressed 122.65 MB 122.65 MB 48 B -0.0%
hits_76.vortex 1.0 vortex-file-compressed 112.83 MB 112.83 MB 48 B -0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.02 MB 223.02 MB 96 B -0.0%
hits_90.vortex 1.0 vortex-file-compressed 141.48 MB 141.48 MB 64 B -0.0%
hits_86.vortex 1.0 vortex-file-compressed 67.09 MB 67.09 MB 32 B -0.0%
hits_57.vortex 1.0 vortex-file-compressed 127.67 MB 127.67 MB 64 B -0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.33 MB 122.33 MB 64 B -0.0%
hits_48.vortex 1.0 vortex-file-compressed 26.53 MB 26.53 MB 16 B -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.58 MB 146.58 MB 96 B -0.0%
hits_28.vortex 1.0 vortex-file-compressed 118.35 MB 118.35 MB 80 B -0.0%
hits_93.vortex 1.0 vortex-file-compressed 89.67 MB 89.67 MB 64 B -0.0%
hits_73.vortex 1.0 vortex-file-compressed 108.93 MB 108.93 MB 80 B -0.0%
hits_38.vortex 1.0 vortex-file-compressed 97.80 MB 97.80 MB 96 B -0.0%
hits_35.vortex 1.0 vortex-file-compressed 113.91 MB 113.91 MB 112 B -0.0%
hits_23.vortex 1.0 vortex-file-compressed 75.17 MB 75.17 MB 80 B -0.0%
hits_50.vortex 1.0 vortex-file-compressed 178.87 MB 178.87 MB 208 B -0.0%
hits_46.vortex 1.0 vortex-file-compressed 67.63 MB 67.63 MB 80 B -0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.26 MB 104.26 MB 128 B -0.0%
hits_13.vortex 1.0 vortex-file-compressed 96.97 MB 96.97 MB 128 B -0.0%
hits_51.vortex 1.0 vortex-file-compressed 279.37 MB 279.37 MB 400 B -0.0%
hits_82.vortex 1.0 vortex-file-compressed 97.92 MB 97.92 MB 280 B -0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.00 MB 135.00 MB 392 B -0.0%
hits_84.vortex 1.0 vortex-file-compressed 116.44 MB 116.44 MB 352 B -0.0%
hits_27.vortex 1.0 vortex-file-compressed 121.54 MB 121.54 MB 416 B -0.0%
hits_98.vortex 1.0 vortex-file-compressed 117.63 MB 117.63 MB 456 B -0.0%
hits_16.vortex 1.0 vortex-file-compressed 78.75 MB 78.74 MB 336 B -0.0%
hits_6.vortex 1.0 vortex-file-compressed 91.88 MB 91.88 MB 408 B -0.0%
hits_4.vortex 1.0 vortex-file-compressed 107.60 MB 107.60 MB 576 B -0.0%
hits_63.vortex 1.0 vortex-file-compressed 67.27 MB 67.27 MB 408 B -0.0%
hits_11.vortex 1.0 vortex-file-compressed 78.50 MB 78.50 MB 1.02 KB -0.0%
hits_53.vortex 1.0 vortex-file-compressed 84.98 MB 84.98 MB 1.41 KB -0.0%
hits_3.vortex 1.0 vortex-file-compressed 141.50 MB 141.49 MB 2.70 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 55.84 MB 55.84 MB 1.09 KB -0.0%
hits_61.vortex 1.0 vortex-file-compressed 100.54 MB 100.54 MB 2.77 KB -0.0%
hits_22.vortex 1.0 vortex-file-compressed 75.93 MB 75.82 MB 119.05 KB -0.2%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (0.0%)
  • vortex-file-compressed: 10.90 GB → 10.90 GB (-0.0%)

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -15.1%
Engines: DataFusion No clear signal (-8.8%, environment too noisy confidence) · DuckDB No clear signal (-21.0%, environment too noisy confidence)
Vortex (geomean): hot 0.500x ✅ · cold 0.462x ✅
Parquet (geomean): hot 0.589x ✅ · cold 0.568x ✅
Shifts: Parquet (control) -41.1% · Median polish -47.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.505x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92935820 / 322658511 / -71.2% 🟢 174041102 / 471733355 / -63.1% 🟢 0.53 / 0.68 / -21.9%
tpch_q02/datafusion:vortex-file-compressed 63791353 / 96906925 / -34.2% 🟢 93596446 / 175392103 / -46.6% 🟢 0.68 / 0.55 / +23.4%
tpch_q03/datafusion:vortex-file-compressed 66472038 / 137749688 / -51.7% 🟢 113960084 / 275420380 / -58.6% 🟢 0.58 / 0.50 / +16.6%
tpch_q04/datafusion:vortex-file-compressed 34644928 / 58772273 / -41.1% 🟢 74863759 / 129475252 / -42.2% 🟢 0.46 / 0.45 / +1.9%
tpch_q05/datafusion:vortex-file-compressed 116383529 / 264415682 / -56.0% 🟢 182880064 / 457894247 / -60.1% 🟢 0.64 / 0.58 / +10.2%
tpch_q06/datafusion:vortex-file-compressed 14165545 / 22974734 / -38.3% 🟢 67546389 / 130433788 / -48.2% 🟢 0.21 / 0.18 / +19.1%
tpch_q07/datafusion:vortex-file-compressed 138341494 / 344429826 / -59.8% 🟢 196567549 / 505949028 / -61.1% 🟢 0.70 / 0.68 / +3.4%
tpch_q08/datafusion:vortex-file-compressed 142441021 / 265041065 / -46.3% 🟢 251451611 / 442736622 / -43.2% 🟢 0.57 / 0.60 / -5.4%
tpch_q09/datafusion:vortex-file-compressed 186202029 / 446768536 / -58.3% 🟢 262967587 / 628641102 / -58.2% 🟢 0.71 / 0.71 / -0.4%
tpch_q10/datafusion:vortex-file-compressed 73970872 / 161575605 / -54.2% 🟢 129137813 / 303682044 / -57.5% 🟢 0.57 / 0.53 / +7.7%
tpch_q11/datafusion:vortex-file-compressed 42820102 / 68650255 / -37.6% 🟢 64733026 / 135921470 / -52.4% 🟢 0.66 / 0.51 / +31.0%
tpch_q12/datafusion:vortex-file-compressed 45456056 / 77268575 / -41.2% 🟢 89533450 / 182393249 / -50.9% 🟢 0.51 / 0.42 / +19.8%
tpch_q13/datafusion:vortex-file-compressed 46290461 / 115702043 / -60.0% 🟢 79578411 / 193668715 / -58.9% 🟢 0.58 / 0.60 / -2.6%
tpch_q14/datafusion:vortex-file-compressed 24366990 / 37835665 / -35.6% 🟢 100795029 / 172798186 / -41.7% 🟢 0.24 / 0.22 / +10.4%
tpch_q15/datafusion:vortex-file-compressed 35998177 / 68010467 / -47.1% 🟢 99071791 / 195734926 / -49.4% 🟢 0.36 / 0.35 / +4.6%
tpch_q16/datafusion:vortex-file-compressed 37494879 / 60298487 / -37.8% 🟢 65521033 / 138449486 / -52.7% 🟢 0.57 / 0.44 / +31.4%
tpch_q17/datafusion:vortex-file-compressed 180889912 / 410486659 / -55.9% 🟢 225183570 / 565669197 / -60.2% 🟢 0.80 / 0.73 / +10.7%
tpch_q18/datafusion:vortex-file-compressed 200080320 / 603890184 / -66.9% 🟢 252806054 / 775046249 / -67.4% 🟢 0.79 / 0.78 / +1.6%
tpch_q19/datafusion:vortex-file-compressed 39023227 / 54613277 / -28.5% 🟢 94270849 / 172569611 / -45.4% 🟢 0.41 / 0.32 / +30.8%
tpch_q20/datafusion:vortex-file-compressed 62149715 / 123086233 / -49.5% 🟢 122327837 / 262770173 / -53.4% 🟢 0.51 / 0.47 / +8.5%
tpch_q21/datafusion:vortex-file-compressed 181446892 / 420353652 / -56.8% 🟢 238806396 / 542508781 / -56.0% 🟢 0.76 / 0.77 / -1.9%
tpch_q22/datafusion:vortex-file-compressed 25518612 / 37057673 / -31.1% 🟢 56278248 / 101879240 / -44.8% 🟢 0.45 / 0.36 / +24.7%
datafusion / vortex-compact / ns (0.456x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 97156830 / 349705695 / -72.2% 🟢 151597770 / 467358811 / -67.6% 🟢 0.64 / 0.75 / -14.3%
tpch_q02/datafusion:vortex-compact 64555215 / 98827463 / -34.7% 🟢 92580176 / 174632226 / -47.0% 🟢 0.70 / 0.57 / +23.2%
tpch_q03/datafusion:vortex-compact 66099254 / 144574005 / -54.3% 🟢 110660522 / 278568959 / -60.3% 🟢 0.60 / 0.52 / +15.1%
tpch_q04/datafusion:vortex-compact 41208459 / 80757259 / -49.0% 🟢 85642769 / 151116579 / -43.3% 🟢 0.48 / 0.53 / -10.0%
tpch_q05/datafusion:vortex-compact 118738866 / 268236682 / -55.7% 🟢 168581965 / 441889491 / -61.8% 🟢 0.70 / 0.61 / +16.0%
tpch_q06/datafusion:vortex-compact 18066903 / 40461332 / -55.3% 🟢 65029708 / 122857724 / -47.1% 🟢 0.28 / 0.33 / -15.6%
tpch_q07/datafusion:vortex-compact 142834242 / 366089798 / -61.0% 🟢 184367314 / 480205544 / -61.6% 🟢 0.77 / 0.76 / +1.6%
tpch_q08/datafusion:vortex-compact 143795697 / 282775446 / -49.1% 🟢 200132103 / 451803613 / -55.7% 🟢 0.72 / 0.63 / +14.8%
tpch_q09/datafusion:vortex-compact 191471268 / 474619041 / -59.7% 🟢 247729081 / 633700336 / -60.9% 🟢 0.77 / 0.75 / +3.2%
tpch_q10/datafusion:vortex-compact 79530883 / 177356020 / -55.2% 🟢 128535444 / 298188828 / -56.9% 🟢 0.62 / 0.59 / +4.0%
tpch_q11/datafusion:vortex-compact 42973180 / 70420326 / -39.0% 🟢 65936816 / 138711759 / -52.5% 🟢 0.65 / 0.51 / +28.4%
tpch_q12/datafusion:vortex-compact 56724352 / 121927737 / -53.5% 🟢 93336944 / 201757915 / -53.7% 🟢 0.61 / 0.60 / +0.6%
tpch_q13/datafusion:vortex-compact 53890451 / 140273968 / -61.6% 🟢 79521664 / 210130779 / -62.2% 🟢 0.68 / 0.67 / +1.5%
tpch_q14/datafusion:vortex-compact 27842548 / 52093286 / -46.6% 🟢 97193979 / 157050479 / -38.1% 🟢 0.29 / 0.33 / -13.6%
tpch_q15/datafusion:vortex-compact 43967505 / 106992330 / -58.9% 🟢 100036806 / 208983299 / -52.1% 🟢 0.44 / 0.51 / -14.2%
tpch_q16/datafusion:vortex-compact 40582676 / 65742098 / -38.3% 🟢 67272681 / 141472705 / -52.4% 🟢 0.60 / 0.46 / +29.8%
tpch_q17/datafusion:vortex-compact 176500316 / 412309710 / -57.2% 🟢 209549291 / 522290422 / -59.9% 🟢 0.84 / 0.79 / +6.7%
tpch_q18/datafusion:vortex-compact 201316765 / 631563876 / -68.1% 🟢 252088147 / 772562851 / -67.4% 🟢 0.80 / 0.82 / -2.3%
tpch_q19/datafusion:vortex-compact 63467630 / 152575866 / -58.4% 🟢 110346181 / 228668385 / -51.7% 🟢 0.58 / 0.67 / -13.8%
tpch_q20/datafusion:vortex-compact 65168171 / 138863389 / -53.1% 🟢 119134913 / 249619162 / -52.3% 🟢 0.55 / 0.56 / -1.7%
tpch_q21/datafusion:vortex-compact 191600518 / 460646447 / -58.4% 🟢 235183796 / 625576187 / -62.4% 🟢 0.81 / 0.74 / +10.6%
tpch_q22/datafusion:vortex-compact 26791159 / 42093538 / -36.4% 🟢 53911148 / 99719707 / -45.9% 🟢 0.50 / 0.42 / +17.7%
datafusion / parquet / ns (0.526x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83359270 / 326461529 / -74.5% 🟢 131899364 / 414030288 / -68.1% 🟢 0.63 / 0.79 / -19.8%
tpch_q02/datafusion:parquet 134941227 / 183560540 / -26.5% 🟢 167819326 / 258596163 / -35.1% 🟢 0.80 / 0.71 / +13.3%
tpch_q03/datafusion:parquet 124106342 / 211963380 / -41.4% 🟢 200822304 / 359073418 / -44.1% 🟢 0.62 / 0.59 / +4.7%
tpch_q04/datafusion:parquet 54815810 / 88326579 / -37.9% 🟢 106723419 / 187397933 / -43.0% 🟢 0.51 / 0.47 / +9.0%
tpch_q05/datafusion:parquet 165452660 / 341626594 / -51.6% 🟢 244954705 / 532581904 / -54.0% 🟢 0.68 / 0.64 / +5.3%
tpch_q06/datafusion:parquet 32382528 / 67115126 / -51.8% 🟢 81636339 / 167484595 / -51.3% 🟢 0.40 / 0.40 / -1.0%
tpch_q07/datafusion:parquet 212768374 / 478589586 / -55.5% 🟢 292588987 / 665324734 / -56.0% 🟢 0.73 / 0.72 / +1.1%
tpch_q08/datafusion:parquet 210459363 / 376072323 / -44.0% 🟢 291866606 / 551320284 / -47.1% 🟢 0.72 / 0.68 / +5.7%
tpch_q09/datafusion:parquet 280967776 / 650990704 / -56.8% 🟢 368016573 / 830372052 / -55.7% 🟢 0.76 / 0.78 / -2.6%
tpch_q10/datafusion:parquet 305865933 / 511548710 / -40.2% 🟢 387430313 / 680366750 / -43.1% 🟢 0.79 / 0.75 / +5.0%
tpch_q11/datafusion:parquet 95373442 / 125179290 / -23.8% 🟢 120094597 / 206546483 / -41.9% 🟢 0.79 / 0.61 / +31.0%
tpch_q12/datafusion:parquet 78211116 / 138660178 / -43.6% 🟢 136486942 / 256880587 / -46.9% 🟢 0.57 / 0.54 / +6.2%
tpch_q13/datafusion:parquet 195118751 / 335585750 / -41.9% 🟢 232764291 / 415113721 / -43.9% 🟢 0.84 / 0.81 / +3.7%
tpch_q14/datafusion:parquet 74384226 / 114632925 / -35.1% 🟢 185171786 / 251672068 / -26.4% 🟢 0.40 / 0.46 / -11.8%
tpch_q15/datafusion:parquet 77742520 / 183794668 / -57.7% 🟢 146113529 / 288614240 / -49.4% 🟢 0.53 / 0.64 / -16.4%
tpch_q16/datafusion:parquet 85914206 / 123409100 / -30.4% 🟢 116298315 / 205413269 / -43.4% 🟢 0.74 / 0.60 / +23.0%
tpch_q17/datafusion:parquet 204154463 / 454784389 / -55.1% 🟢 271347596 / 573953330 / -52.7% 🟢 0.75 / 0.79 / -5.0%
tpch_q18/datafusion:parquet 260780752 / 693609076 / -62.4% 🟢 319962319 / 843930741 / -62.1% 🟢 0.82 / 0.82 / -0.8%
tpch_q19/datafusion:parquet 96870393 / 178724156 / -45.8% 🟢 176233671 / 309081204 / -43.0% 🟢 0.55 / 0.58 / -4.9%
tpch_q20/datafusion:parquet 151804207 / 273076576 / -44.4% 🟢 219543379 / 395053892 / -44.4% 🟢 0.69 / 0.69 / +0.0%
tpch_q21/datafusion:parquet 226606327 / 557858395 / -59.4% 🟢 305643787 / 789171872 / -61.3% 🟢 0.74 / 0.71 / +4.9%
tpch_q22/datafusion:parquet 161167626 / 223826157 / -28.0% 🟢 187673053 / 283724670 / -33.9% 🟢 0.86 / 0.79 / +8.9%
duckdb / vortex-file-compressed / ns (0.513x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 55247809 / 100550963 / -45.1% 🟢 105296823 / 201242670 / -47.7% 🟢 0.52 / 0.50 / +5.0%
tpch_q02/duckdb:vortex-file-compressed 32889535 / 65258498 / -49.6% 🟢 49445442 / 113432565 / -56.4% 🟢 0.67 / 0.58 / +15.6%
tpch_q03/duckdb:vortex-file-compressed 59187761 / 126916981 / -53.4% 🟢 111307596 / 243981892 / -54.4% 🟢 0.53 / 0.52 / +2.2%
tpch_q04/duckdb:vortex-file-compressed 80089674 / 161575120 / -50.4% 🟢 115359988 / 236583938 / -51.2% 🟢 0.69 / 0.68 / +1.7%
tpch_q05/duckdb:vortex-file-compressed 65792757 / 136828614 / -51.9% 🟢 115577705 / 257808419 / -55.2% 🟢 0.57 / 0.53 / +7.3%
tpch_q06/duckdb:vortex-file-compressed 22711938 / 35886663 / -36.7% 🟢 65940647 / 130783684 / -49.6% 🟢 0.34 / 0.27 / +25.5%
tpch_q07/duckdb:vortex-file-compressed 61695870 / 118894129 / -48.1% 🟢 126505927 / 284238115 / -55.5% 🟢 0.49 / 0.42 / +16.6%
tpch_q08/duckdb:vortex-file-compressed 84737349 / 169100385 / -49.9% 🟢 152670033 / 288765495 / -47.1% 🟢 0.56 / 0.59 / -5.2%
tpch_q09/duckdb:vortex-file-compressed 171429896 / 301484414 / -43.1% 🟢 235281025 / 436522842 / -46.1% 🟢 0.73 / 0.69 / +5.5%
tpch_q10/duckdb:vortex-file-compressed 115856597 / 211248541 / -45.2% 🟢 200542226 / 363150710 / -44.8% 🟢 0.58 / 0.58 / -0.7%
tpch_q11/duckdb:vortex-file-compressed 17596909 / 41835865 / -57.9% 🟢 31710656 / 95641261 / -66.8% 🟢 0.55 / 0.44 / +26.9%
tpch_q12/duckdb:vortex-file-compressed 54572125 / 111720986 / -51.2% 🟢 99999915 / 186959659 / -46.5% 🟢 0.55 / 0.60 / -8.7%
tpch_q13/duckdb:vortex-file-compressed 92914451 / 197956887 / -53.1% 🟢 132229973 / 290024576 / -54.4% 🟢 0.70 / 0.68 / +2.9%
tpch_q14/duckdb:vortex-file-compressed 30600353 / 54171283 / -43.5% 🟢 75461394 / 166763560 / -54.7% 🟢 0.41 / 0.32 / +24.8%
tpch_q15/duckdb:vortex-file-compressed 37880602 / 76733463 / -50.6% 🟢 92100327 / 198412182 / -53.6% 🟢 0.41 / 0.39 / +6.4%
tpch_q16/duckdb:vortex-file-compressed 42902003 / 83822054 / -48.8% 🟢 54667744 / 122035732 / -55.2% 🟢 0.78 / 0.69 / +14.3%
tpch_q17/duckdb:vortex-file-compressed 68505567 / 110304074 / -37.9% 🟢 146150823 / 292494845 / -50.0% 🟢 0.47 / 0.38 / +24.3%
tpch_q18/duckdb:vortex-file-compressed 132825810 / 268882900 / -50.6% 🟢 155099768 / 350007301 / -55.7% 🟢 0.86 / 0.77 / +11.5%
tpch_q19/duckdb:vortex-file-compressed 42101809 / 85584443 / -50.8% 🟢 100932399 / 219281937 / -54.0% 🟢 0.42 / 0.39 / +6.9%
tpch_q20/duckdb:vortex-file-compressed 59833303 / 128985826 / -53.6% 🟢 126885725 / 259462170 / -51.1% 🟢 0.47 / 0.50 / -5.1%
tpch_q21/duckdb:vortex-file-compressed 243404345 / 483170146 / -49.6% 🟢 293478120 / 566624118 / -48.2% 🟢 0.83 / 0.85 / -2.7%
tpch_q22/duckdb:vortex-file-compressed 40950598 / 74848896 / -45.3% 🟢 55121251 / 126794929 / -56.5% 🟢 0.74 / 0.59 / +25.9%
duckdb / vortex-compact / ns (0.529x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 70229902 / 120119409 / -41.5% 🟢 105654085 / 203206324 / -48.0% 🟢 0.66 / 0.59 / +12.5%
tpch_q02/duckdb:vortex-compact 35167916 / 71889454 / -51.1% 🟢 48804860 / 115592276 / -57.8% 🟢 0.72 / 0.62 / +15.9%
tpch_q03/duckdb:vortex-compact 62147557 / 117649699 / -47.2% 🟢 109213259 / 224638507 / -51.4% 🟢 0.57 / 0.52 / +8.7%
tpch_q04/duckdb:vortex-compact 89786196 / 160588342 / -44.1% 🟢 118752087 / 245280198 / -51.6% 🟢 0.76 / 0.65 / +15.5%
tpch_q05/duckdb:vortex-compact 70465219 / 148330838 / -52.5% 🟢 123132008 / 273499250 / -55.0% 🟢 0.57 / 0.54 / +5.5%
tpch_q06/duckdb:vortex-compact 25823724 / 41161741 / -37.3% 🟢 65163501 / 133503089 / -51.2% 🟢 0.40 / 0.31 / +28.5%
tpch_q07/duckdb:vortex-compact 72972043 / 135621260 / -46.2% 🟢 139696101 / 266929131 / -47.7% 🟢 0.52 / 0.51 / +2.8%
tpch_q08/duckdb:vortex-compact 89130650 / 181885785 / -51.0% 🟢 149414999 / 307359372 / -51.4% 🟢 0.60 / 0.59 / +0.8%
tpch_q09/duckdb:vortex-compact 175248027 / 315659193 / -44.5% 🟢 235059000 / 446966702 / -47.4% 🟢 0.75 / 0.71 / +5.6%
tpch_q10/duckdb:vortex-compact 121667086 / 213907314 / -43.1% 🟢 184783799 / 344229765 / -46.3% 🟢 0.66 / 0.62 / +6.0%
tpch_q11/duckdb:vortex-compact 19276145 / 41618886 / -53.7% 🟢 34247140 / 121116409 / -71.7% 🟢 0.56 / 0.34 / +63.8%
tpch_q12/duckdb:vortex-compact 69026579 / 119679647 / -42.3% 🟢 105487788 / 207535161 / -49.2% 🟢 0.65 / 0.58 / +13.5%
tpch_q13/duckdb:vortex-compact 99235181 / 201844006 / -50.8% 🟢 137357542 / 315729281 / -56.5% 🟢 0.72 / 0.64 / +13.0%
tpch_q14/duckdb:vortex-compact 33742463 / 58912327 / -42.7% 🟢 75738321 / 163492185 / -53.7% 🟢 0.45 / 0.36 / +23.6%
tpch_q15/duckdb:vortex-compact 42054220 / 81351463 / -48.3% 🟢 95586408 / 211496062 / -54.8% 🟢 0.44 / 0.38 / +14.4%
tpch_q16/duckdb:vortex-compact 44236288 / 90326972 / -51.0% 🟢 60265032 / 127830307 / -52.9% 🟢 0.73 / 0.71 / +3.9%
tpch_q17/duckdb:vortex-compact 62365676 / 118194567 / -47.2% 🟢 133160067 / 242164236 / -45.0% 🟢 0.47 / 0.49 / -4.0%
tpch_q18/duckdb:vortex-compact 149090798 / 266649639 / -44.1% 🟢 164975425 / 356002937 / -53.7% 🟢 0.90 / 0.75 / +20.7%
tpch_q19/duckdb:vortex-compact 48131768 / 92340526 / -47.9% 🟢 96318875 / 204905717 / -53.0% 🟢 0.50 / 0.45 / +10.9%
tpch_q20/duckdb:vortex-compact 68562801 / 148244569 / -53.8% 🟢 131190266 / 270807646 / -51.6% 🟢 0.52 / 0.55 / -4.5%
tpch_q21/duckdb:vortex-compact 259023172 / 476022445 / -45.6% 🟢 295884025 / 552794608 / -46.5% 🟢 0.88 / 0.86 / +1.7%
tpch_q22/duckdb:vortex-compact 41803433 / 77185178 / -45.8% 🟢 60239509 / 151545832 / -60.2% 🟢 0.69 / 0.51 / +36.3%
duckdb / parquet / ns (0.660x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70398604 / 143778896 / -51.0% 🟢 87078683 / 195289430 / -55.4% 🟢 0.81 / 0.74 / +9.8%
tpch_q02/duckdb:parquet 70785430 / 101652548 / -30.4% 🟢 83340409 / 121018731 / -31.1% 🟢 0.85 / 0.84 / +1.1%
tpch_q03/duckdb:parquet 113578403 / 165614077 / -31.4% 🟢 156548065 / 232842071 / -32.8% 🟢 0.73 / 0.71 / +2.0%
tpch_q04/duckdb:parquet 74638344 / 119235027 / -37.4% 🟢 108539558 / 154661012 / -29.8% 🟢 0.69 / 0.77 / -10.8%
tpch_q05/duckdb:parquet 124480674 / 187330844 / -33.6% 🟢 162936147 / 261569193 / -37.7% 🟢 0.76 / 0.72 / +6.7%
tpch_q06/duckdb:parquet 33784790 / 58230902 / -42.0% 🟢 47691768 / 94424939 / -49.5% 🟢 0.71 / 0.62 / +14.9%
tpch_q07/duckdb:parquet 89495960 / 145762074 / -38.6% 🟢 131314360 / 217714004 / -39.7% 🟢 0.68 / 0.67 / +1.8%
tpch_q08/duckdb:parquet 142856691 / 217411172 / -34.3% 🟢 193449794 / 305353729 / -36.6% 🟢 0.74 / 0.71 / +3.7%
tpch_q09/duckdb:parquet 223724158 / 347280701 / -35.6% 🟢 271449679 / 430041874 / -36.9% 🟢 0.82 / 0.81 / +2.1%
tpch_q10/duckdb:parquet 471594691 / 656398683 / -28.2% 🟢 517154499 / 730228597 / -29.2% 🟢 0.91 / 0.90 / +1.4%
tpch_q11/duckdb:parquet 30610205 / 41792832 / -26.8% 🟢 37872659 / 54042992 / -29.9% 🟢 0.81 / 0.77 / +4.5%
tpch_q12/duckdb:parquet 74112305 / 121855529 / -39.2% 🟢 98255231 / 150043233 / -34.5% 🟢 0.75 / 0.81 / -7.1%
tpch_q13/duckdb:parquet 318344751 / 398462559 / -20.1% 🟢 334285017 / 424360483 / -21.2% 🟢 0.95 / 0.94 / +1.4%
tpch_q14/duckdb:parquet 105612797 / 150336862 / -29.7% 🟢 134661982 / 216882420 / -37.9% 🟢 0.78 / 0.69 / +13.1%
tpch_q15/duckdb:parquet 43769640 / 76213890 / -42.6% 🟢 75613685 / 121749054 / -37.9% 🟢 0.58 / 0.63 / -7.5%
tpch_q16/duckdb:parquet 114485262 / 154867083 / -26.1% 🟢 127145536 / 203059286 / -37.4% 🟢 0.90 / 0.76 / +18.1%
tpch_q17/duckdb:parquet 73688686 / 127341468 / -42.1% 🟢 102465667 / 209657957 / -51.1% 🟢 0.72 / 0.61 / +18.4%
tpch_q18/duckdb:parquet 202549476 / 279470745 / -27.5% 🟢 172779453 / 292165745 / -40.9% 🟢 1.17 / 0.96 / +22.6%
tpch_q19/duckdb:parquet 162477104 / 229328870 / -29.2% 🟢 194955905 / 321329624 / -39.3% 🟢 0.83 / 0.71 / +16.8%
tpch_q20/duckdb:parquet 128754336 / 196604143 / -34.5% 🟢 163842322 / 271578991 / -39.7% 🟢 0.79 / 0.72 / +8.6%
tpch_q21/duckdb:parquet 281040568 / 441743635 / -36.4% 🟢 290019492 / 481539821 / -39.8% 🟢 0.97 / 0.92 / +5.6%
tpch_q22/duckdb:parquet 261133796 / 338324755 / -22.8% 🟢 272701969 / 356224009 / -23.4% 🟢 0.96 / 0.95 / +0.8%

File Size Changes (5 files changed, +0.0% overall, 4↑ 1↓)
File Scale Format Base HEAD Change %
orders.vortex 10.0 vortex-file-compressed 390.32 MB 390.34 MB +25.05 KB +0.0%
supplier.vortex 10.0 vortex-file-compressed 5.40 MB 5.40 MB +80 B +0.0%
lineitem.vortex 10.0 vortex-file-compressed 1.56 GB 1.56 GB +14.02 KB +0.0%
customer.vortex 10.0 vortex-file-compressed 82.86 MB 82.86 MB +408 B +0.0%
part.vortex 10.0 vortex-file-compressed 48.42 MB 48.41 MB 5.84 KB -0.0%

Totals:

  • vortex-compact: 1.92 GB → 1.92 GB (0.0%)
  • vortex-file-compressed: 2.31 GB → 2.31 GB (+0.0%)

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR a42e6d50 vs base 792cef74
Vortex (geomean): hot 0.585x ✅ · cold 0.512x ✅


datafusion / vortex-file-compressed / ns (0.585x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45996964 / 105205168 / -56.3% 🟢 90446924 / 206893739 / -56.3% 🟢 0.51 / 0.51 / +0.0%
polarsignals_q01/datafusion:vortex-file-compressed 50923722 / 156173542 / -67.4% 🟢 112418670 / 270983613 / -58.5% 🟢 0.45 / 0.58 / -21.4%
polarsignals_q02/datafusion:vortex-file-compressed 35110776 / 50728419 / -30.8% 🟢 74562870 / 122729518 / -39.2% 🟢 0.47 / 0.41 / +13.9%
polarsignals_q03/datafusion:vortex-file-compressed 53713590 / 165198648 / -67.5% 🟢 116857278 / 277824786 / -57.9% 🟢 0.46 / 0.59 / -22.7%
polarsignals_q04/datafusion:vortex-file-compressed 9437514 / 10417590 / -9.4% 47968865 / 78387071 / -38.8% 🟢 0.20 / 0.13 / +48.0%
polarsignals_q05/datafusion:vortex-file-compressed 11656032 / 13993408 / -16.7% 🟢 51772533 / 91748910 / -43.6% 🟢 0.23 / 0.15 / +47.6%
polarsignals_q06/datafusion:vortex-file-compressed 21555754 / 30355786 / -29.0% 🟢 60543224 / 102083230 / -40.7% 🟢 0.36 / 0.30 / +19.7%
polarsignals_q07/datafusion:vortex-file-compressed 11269374 / 12076840 / -6.7% 52091982 / 88348875 / -41.0% 🟢 0.22 / 0.14 / +58.3%
polarsignals_q08/datafusion:vortex-file-compressed 100306790 / 287836716 / -65.2% 🟢 163499164 / 403337633 / -59.5% 🟢 0.61 / 0.71 / -14.0%
polarsignals_q09/datafusion:vortex-file-compressed 9960754 / 11810643 / -15.7% 🟢 46772376 / 85284053 / -45.2% 🟢 0.21 / 0.14 / +53.8%

No file size changes detected.

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: Likely improvement (environment too noisy confidence)
Attributed Vortex impact: -16.7%
Engines: DataFusion No clear signal (-3.0%, environment too noisy confidence) · DuckDB Likely improvement (-28.4%, high confidence)
Vortex (geomean): hot 0.631x ✅ · cold 0.486x ✅
Parquet (geomean): hot 0.757x ✅ · cold 0.670x ✅
Shifts: Parquet (control) -24.3% · Median polish -23.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.750x ✅, 19↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16294133 / 42868469 / -62.0% 🟢 44528642 / 97104348 / -54.1% 🟢 0.37 / 0.44 / -17.1%
tpch_q02/datafusion:vortex-file-compressed 17289149 / 23002305 / -24.8% 🟢 38227077 / 66741007 / -42.7% 🟢 0.45 / 0.34 / +31.2%
tpch_q03/datafusion:vortex-file-compressed 19134409 / 27444196 / -30.3% 🟢 48903490 / 97798658 / -50.0% 🟢 0.39 / 0.28 / +39.4%
tpch_q04/datafusion:vortex-file-compressed 10352684 / 15455840 / -33.0% 🟢 35213202 / 64614083 / -45.5% 🟢 0.29 / 0.24 / +22.9%
tpch_q05/datafusion:vortex-file-compressed 36770369 / 47300825 / -22.3% 🟢 63997990 / 117890748 / -45.7% 🟢 0.57 / 0.40 / +43.2%
tpch_q06/datafusion:vortex-file-compressed 6060742 / 8296410 / -26.9% 🟢 31018079 / 52474676 / -40.9% 🟢 0.20 / 0.16 / +23.6%
tpch_q07/datafusion:vortex-file-compressed 51096841 / 55849622 / -8.5% 82539837 / 127818709 / -35.4% 🟢 0.62 / 0.44 / +41.7%
tpch_q08/datafusion:vortex-file-compressed 51786083 / 45790245 / +13.1% 🔴 84904973 / 116708810 / -27.3% 🟢 0.61 / 0.39 / +55.5%
tpch_q09/datafusion:vortex-file-compressed 48744722 / 54253742 / -10.2% 🟢 76078529 / 132675967 / -42.7% 🟢 0.64 / 0.41 / +56.7%
tpch_q10/datafusion:vortex-file-compressed 17233638 / 26691101 / -35.4% 🟢 49265990 / 99334336 / -50.4% 🟢 0.35 / 0.27 / +30.2%
tpch_q11/datafusion:vortex-file-compressed 14472684 / 17764445 / -18.5% 🟢 37208172 / 60856494 / -38.9% 🟢 0.39 / 0.29 / +33.2%
tpch_q12/datafusion:vortex-file-compressed 22847299 / 24335110 / -6.1% 52019100 / 74459139 / -30.1% 🟢 0.44 / 0.33 / +34.4%
tpch_q13/datafusion:vortex-file-compressed 19511381 / 24011084 / -18.7% 🟢 39532616 / 73860252 / -46.5% 🟢 0.49 / 0.33 / +51.8%
tpch_q14/datafusion:vortex-file-compressed 14499377 / 16618472 / -12.8% 🟢 40240381 / 69186907 / -41.8% 🟢 0.36 / 0.24 / +50.0%
tpch_q15/datafusion:vortex-file-compressed 17834055 / 20789244 / -14.2% 🟢 46129208 / 80253545 / -42.5% 🟢 0.39 / 0.26 / +49.2%
tpch_q16/datafusion:vortex-file-compressed 18553398 / 22117863 / -16.1% 🟢 37451743 / 74964492 / -50.0% 🟢 0.50 / 0.30 / +67.9%
tpch_q17/datafusion:vortex-file-compressed 27919275 / 55906461 / -50.1% 🟢 60533690 / 121659043 / -50.2% 🟢 0.46 / 0.46 / +0.4%
tpch_q18/datafusion:vortex-file-compressed 36407368 / 62710053 / -41.9% 🟢 57496217 / 122114328 / -52.9% 🟢 0.63 / 0.51 / +23.3%
tpch_q19/datafusion:vortex-file-compressed 14065123 / 16429937 / -14.4% 🟢 42008843 / 73104365 / -42.5% 🟢 0.33 / 0.22 / +49.0%
tpch_q20/datafusion:vortex-file-compressed 20330672 / 27268591 / -25.4% 🟢 47970535 / 87840618 / -45.4% 🟢 0.42 / 0.31 / +36.5%
tpch_q21/datafusion:vortex-file-compressed 38524404 / 60409732 / -36.2% 🟢 68371544 / 132203653 / -48.3% 🟢 0.56 / 0.46 / +23.3%
tpch_q22/datafusion:vortex-file-compressed 11178275 / 13206072 / -15.4% 🟢 31621051 / 62332374 / -49.3% 🟢 0.35 / 0.21 / +66.9%
datafusion / vortex-compact / ns (0.699x ✅, 21↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18097908 / 47067564 / -61.5% 🟢 48021920 / 101871735 / -52.9% 🟢 0.38 / 0.46 / -18.4%
tpch_q02/datafusion:vortex-compact 19513623 / 27166192 / -28.2% 🟢 38976653 / 70609200 / -44.8% 🟢 0.50 / 0.38 / +30.1%
tpch_q03/datafusion:vortex-compact 20074421 / 28821313 / -30.3% 🟢 50204894 / 91091510 / -44.9% 🟢 0.40 / 0.32 / +26.4%
tpch_q04/datafusion:vortex-compact 11116136 / 18433752 / -39.7% 🟢 32331482 / 68158547 / -52.6% 🟢 0.34 / 0.27 / +27.1%
tpch_q05/datafusion:vortex-compact 37110583 / 48703369 / -23.8% 🟢 64345571 / 124449225 / -48.3% 🟢 0.58 / 0.39 / +47.4%
tpch_q06/datafusion:vortex-compact 6807476 / 10048465 / -32.3% 🟢 29830962 / 58183156 / -48.7% 🟢 0.23 / 0.17 / +32.1%
tpch_q07/datafusion:vortex-compact 51960365 / 58317331 / -10.9% 🟢 79903567 / 127076211 / -37.1% 🟢 0.65 / 0.46 / +41.7%
tpch_q08/datafusion:vortex-compact 52202363 / 49558009 / +5.3% 78358703 / 119415250 / -34.4% 🟢 0.67 / 0.42 / +60.5%
tpch_q09/datafusion:vortex-compact 50046976 / 57351580 / -12.7% 🟢 77252019 / 130277121 / -40.7% 🟢 0.65 / 0.44 / +47.2%
tpch_q10/datafusion:vortex-compact 18865332 / 33841810 / -44.3% 🟢 51196597 / 95179562 / -46.2% 🟢 0.37 / 0.36 / +3.6%
tpch_q11/datafusion:vortex-compact 16267684 / 21135937 / -23.0% 🟢 34612977 / 66648861 / -48.1% 🟢 0.47 / 0.32 / +48.2%
tpch_q12/datafusion:vortex-compact 23863821 / 29967156 / -20.4% 🟢 47603202 / 79745999 / -40.3% 🟢 0.50 / 0.38 / +33.4%
tpch_q13/datafusion:vortex-compact 20624779 / 27034559 / -23.7% 🟢 40416093 / 76595406 / -47.2% 🟢 0.51 / 0.35 / +44.6%
tpch_q14/datafusion:vortex-compact 15726709 / 18377266 / -14.4% 🟢 43299498 / 74594094 / -42.0% 🟢 0.36 / 0.25 / +47.4%
tpch_q15/datafusion:vortex-compact 19465451 / 25772694 / -24.5% 🟢 45384421 / 81944307 / -44.6% 🟢 0.43 / 0.31 / +36.4%
tpch_q16/datafusion:vortex-compact 19162049 / 24968820 / -23.3% 🟢 38035408 / 73919964 / -48.5% 🟢 0.50 / 0.34 / +49.1%
tpch_q17/datafusion:vortex-compact 28994749 / 56908368 / -49.1% 🟢 56220883 / 123014006 / -54.3% 🟢 0.52 / 0.46 / +11.5%
tpch_q18/datafusion:vortex-compact 37943671 / 64413325 / -41.1% 🟢 58518997 / 121000861 / -51.6% 🟢 0.65 / 0.53 / +21.8%
tpch_q19/datafusion:vortex-compact 18458966 / 32838892 / -43.8% 🟢 44284314 / 90361674 / -51.0% 🟢 0.42 / 0.36 / +14.7%
tpch_q20/datafusion:vortex-compact 21535366 / 30296821 / -28.9% 🟢 45859230 / 85407495 / -46.3% 🟢 0.47 / 0.35 / +32.4%
tpch_q21/datafusion:vortex-compact 42141790 / 64896362 / -35.1% 🟢 70689521 / 145167933 / -51.3% 🟢 0.60 / 0.45 / +33.4%
tpch_q22/datafusion:vortex-compact 11314639 / 14817509 / -23.6% 🟢 31228807 / 61560459 / -49.3% 🟢 0.36 / 0.24 / +50.5%
datafusion / parquet / ns (0.746x ✅, 21↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67113915 / 109894603 / -38.9% 🟢 88629189 / 197978050 / -55.2% 🟢 0.76 / 0.56 / +36.4%
tpch_q02/datafusion:parquet 52178185 / 69168999 / -24.6% 🟢 75720140 / 122507974 / -38.2% 🟢 0.69 / 0.56 / +22.0%
tpch_q03/datafusion:parquet 73014481 / 89944626 / -18.8% 🟢 102429200 / 144908358 / -29.3% 🟢 0.71 / 0.62 / +14.8%
tpch_q04/datafusion:parquet 40601984 / 50414323 / -19.5% 🟢 67340457 / 104713438 / -35.7% 🟢 0.60 / 0.48 / +25.2%
tpch_q05/datafusion:parquet 88261005 / 111605701 / -20.9% 🟢 120399115 / 169559163 / -29.0% 🟢 0.73 / 0.66 / +11.4%
tpch_q06/datafusion:parquet 28411888 / 46835259 / -39.3% 🟢 54916846 / 101622566 / -46.0% 🟢 0.52 / 0.46 / +12.3%
tpch_q07/datafusion:parquet 94295169 / 114851419 / -17.9% 🟢 123580542 / 199937656 / -38.2% 🟢 0.76 / 0.57 / +32.8%
tpch_q08/datafusion:parquet 97674638 / 106452089 / -8.2% 129640194 / 180786070 / -28.3% 🟢 0.75 / 0.59 / +28.0%
tpch_q09/datafusion:parquet 112572221 / 134322345 / -16.2% 🟢 151481027 / 222256726 / -31.8% 🟢 0.74 / 0.60 / +23.0%
tpch_q10/datafusion:parquet 80230543 / 113552850 / -29.3% 🟢 117012210 / 199482800 / -41.3% 🟢 0.69 / 0.57 / +20.5%
tpch_q11/datafusion:parquet 38429319 / 51603712 / -25.5% 🟢 64352077 / 107033463 / -39.9% 🟢 0.60 / 0.48 / +23.9%
tpch_q12/datafusion:parquet 62356784 / 98928964 / -37.0% 🟢 92234534 / 153632061 / -40.0% 🟢 0.68 / 0.64 / +5.0%
tpch_q13/datafusion:parquet 159018818 / 213197708 / -25.4% 🟢 185430861 / 267399118 / -30.7% 🟢 0.86 / 0.80 / +7.6%
tpch_q14/datafusion:parquet 39897071 / 48369627 / -17.5% 🟢 68406334 / 108948466 / -37.2% 🟢 0.58 / 0.44 / +31.4%
tpch_q15/datafusion:parquet 48667073 / 67299367 / -27.7% 🟢 70352765 / 123235714 / -42.9% 🟢 0.69 / 0.55 / +26.7%
tpch_q16/datafusion:parquet 39029454 / 51044475 / -23.5% 🟢 61696879 / 103438336 / -40.4% 🟢 0.63 / 0.49 / +28.2%
tpch_q17/datafusion:parquet 116266543 / 149830598 / -22.4% 🟢 144906079 / 211734878 / -31.6% 🟢 0.80 / 0.71 / +13.4%
tpch_q18/datafusion:parquet 113864788 / 161357248 / -29.4% 🟢 142157228 / 229948917 / -38.2% 🟢 0.80 / 0.70 / +14.1%
tpch_q19/datafusion:parquet 49787273 / 72892305 / -31.7% 🟢 80753599 / 127957644 / -36.9% 🟢 0.62 / 0.57 / +8.2%
tpch_q20/datafusion:parquet 58399977 / 78352365 / -25.5% 🟢 87761876 / 136239786 / -35.6% 🟢 0.67 / 0.58 / +15.7%
tpch_q21/datafusion:parquet 97900508 / 128035207 / -23.5% 🟢 124171009 / 205037767 / -39.4% 🟢 0.79 / 0.62 / +26.3%
tpch_q22/datafusion:parquet 40244595 / 55139914 / -27.0% 🟢 60572611 / 103901043 / -41.7% 🟢 0.66 / 0.53 / +25.2%
duckdb / vortex-file-compressed / ns (0.554x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9872347 / 23886767 / -58.7% 🟢 21731234 / 64611979 / -66.4% 🟢 0.45 / 0.37 / +22.9%
tpch_q02/duckdb:vortex-file-compressed 17597923 / 29566545 / -40.5% 🟢 26821621 / 48488399 / -44.7% 🟢 0.66 / 0.61 / +7.6%
tpch_q03/duckdb:vortex-file-compressed 18680281 / 34572127 / -46.0% 🟢 32304326 / 88932249 / -63.7% 🟢 0.58 / 0.39 / +48.7%
tpch_q04/duckdb:vortex-file-compressed 16626370 / 30600052 / -45.7% 🟢 29376504 / 73393944 / -60.0% 🟢 0.57 / 0.42 / +35.7%
tpch_q05/duckdb:vortex-file-compressed 22665279 / 40275938 / -43.7% 🟢 35232165 / 78814484 / -55.3% 🟢 0.64 / 0.51 / +25.9%
tpch_q06/duckdb:vortex-file-compressed 5800259 / 9593391 / -39.5% 🟢 16827754 / 42443325 / -60.4% 🟢 0.34 / 0.23 / +52.5%
tpch_q07/duckdb:vortex-file-compressed 21452749 / 40304505 / -46.8% 🟢 37745289 / 82292817 / -54.1% 🟢 0.57 / 0.49 / +16.0%
tpch_q08/duckdb:vortex-file-compressed 23612362 / 45493026 / -48.1% 🟢 41480588 / 90433081 / -54.1% 🟢 0.57 / 0.50 / +13.2%
tpch_q09/duckdb:vortex-file-compressed 29441261 / 57720124 / -49.0% 🟢 48136278 / 105426171 / -54.3% 🟢 0.61 / 0.55 / +11.7%
tpch_q10/duckdb:vortex-file-compressed 28572410 / 47675945 / -40.1% 🟢 46014268 / 95917890 / -52.0% 🟢 0.62 / 0.50 / +24.9%
tpch_q11/duckdb:vortex-file-compressed 10666778 / 18098749 / -41.1% 🟢 16662029 / 37411144 / -55.5% 🟢 0.64 / 0.48 / +32.3%
tpch_q12/duckdb:vortex-file-compressed 15168210 / 26091159 / -41.9% 🟢 27367253 / 60850466 / -55.0% 🟢 0.55 / 0.43 / +29.3%
tpch_q13/duckdb:vortex-file-compressed 22373137 / 42528081 / -47.4% 🟢 38775429 / 123321064 / -68.6% 🟢 0.58 / 0.34 / +67.3%
tpch_q14/duckdb:vortex-file-compressed 13317991 / 21821321 / -39.0% 🟢 26702024 / 56677043 / -52.9% 🟢 0.50 / 0.39 / +29.5%
tpch_q15/duckdb:vortex-file-compressed 10540755 / 17743672 / -40.6% 🟢 18452952 / 54745584 / -66.3% 🟢 0.57 / 0.32 / +76.2%
tpch_q16/duckdb:vortex-file-compressed 18192110 / 30870593 / -41.1% 🟢 23663006 / 46605097 / -49.2% 🟢 0.77 / 0.66 / +16.1%
tpch_q17/duckdb:vortex-file-compressed 15294824 / 29895372 / -48.8% 🟢 33315339 / 74655882 / -55.4% 🟢 0.46 / 0.40 / +14.6%
tpch_q18/duckdb:vortex-file-compressed 26666781 / 48892175 / -45.5% 🟢 41048873 / 79866774 / -48.6% 🟢 0.65 / 0.61 / +6.1%
tpch_q19/duckdb:vortex-file-compressed 23450850 / 35901675 / -34.7% 🟢 38079467 / 78682732 / -51.6% 🟢 0.62 / 0.46 / +35.0%
tpch_q20/duckdb:vortex-file-compressed 17243241 / 33725324 / -48.9% 🟢 35176326 / 82027545 / -57.1% 🟢 0.49 / 0.41 / +19.2%
tpch_q21/duckdb:vortex-file-compressed 65283280 / 119130752 / -45.2% 🟢 82244551 / 158801724 / -48.2% 🟢 0.79 / 0.75 / +5.8%
tpch_q22/duckdb:vortex-file-compressed 12014569 / 21439806 / -44.0% 🟢 22581146 / 41985166 / -46.2% 🟢 0.53 / 0.51 / +4.2%
duckdb / vortex-compact / ns (0.545x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 14491878 / 27572406 / -47.4% 🟢 23951073 / 68382463 / -65.0% 🟢 0.61 / 0.40 / +50.1%
tpch_q02/duckdb:vortex-compact 20201156 / 34267109 / -41.0% 🟢 32491569 / 54868137 / -40.8% 🟢 0.62 / 0.62 / -0.4%
tpch_q03/duckdb:vortex-compact 18917652 / 38290081 / -50.6% 🟢 33220949 / 81797249 / -59.4% 🟢 0.57 / 0.47 / +21.6%
tpch_q04/duckdb:vortex-compact 18558621 / 33546863 / -44.7% 🟢 29405760 / 68182906 / -56.9% 🟢 0.63 / 0.49 / +28.3%
tpch_q05/duckdb:vortex-compact 22498160 / 43845607 / -48.7% 🟢 37729443 / 82697041 / -54.4% 🟢 0.60 / 0.53 / +12.5%
tpch_q06/duckdb:vortex-compact 6126969 / 10199157 / -39.9% 🟢 16172278 / 43698879 / -63.0% 🟢 0.38 / 0.23 / +62.3%
tpch_q07/duckdb:vortex-compact 21880018 / 39685164 / -44.9% 🟢 44051358 / 83881202 / -47.5% 🟢 0.50 / 0.47 / +5.0%
tpch_q08/duckdb:vortex-compact 25638029 / 49406161 / -48.1% 🟢 41789860 / 97244745 / -57.0% 🟢 0.61 / 0.51 / +20.8%
tpch_q09/duckdb:vortex-compact 30485619 / 60460170 / -49.6% 🟢 52824174 / 109635382 / -51.8% 🟢 0.58 / 0.55 / +4.7%
tpch_q10/duckdb:vortex-compact 31140461 / 52024632 / -40.1% 🟢 47483688 / 95702653 / -50.4% 🟢 0.66 / 0.54 / +20.6%
tpch_q11/duckdb:vortex-compact 9284661 / 19011577 / -51.2% 🟢 16596541 / 40704844 / -59.2% 🟢 0.56 / 0.47 / +19.8%
tpch_q12/duckdb:vortex-compact 18342497 / 29214238 / -37.2% 🟢 27074825 / 72110330 / -62.5% 🟢 0.68 / 0.41 / +67.2%
tpch_q13/duckdb:vortex-compact 22999478 / 42337192 / -45.7% 🟢 40396064 / 139563652 / -71.1% 🟢 0.57 / 0.30 / +87.7%
tpch_q14/duckdb:vortex-compact 14045630 / 24850711 / -43.5% 🟢 32575566 / 67382989 / -51.7% 🟢 0.43 / 0.37 / +16.9%
tpch_q15/duckdb:vortex-compact 9688910 / 18098003 / -46.5% 🟢 21611064 / 76536464 / -71.8% 🟢 0.45 / 0.24 / +89.6%
tpch_q16/duckdb:vortex-compact 20488024 / 32115608 / -36.2% 🟢 26016657 / 48402493 / -46.2% 🟢 0.79 / 0.66 / +18.7%
tpch_q17/duckdb:vortex-compact 16840877 / 35830587 / -53.0% 🟢 35113654 / 92731281 / -62.1% 🟢 0.48 / 0.39 / +24.1%
tpch_q18/duckdb:vortex-compact 26255922 / 57266225 / -54.2% 🟢 35505729 / 94800256 / -62.5% 🟢 0.74 / 0.60 / +22.4%
tpch_q19/duckdb:vortex-compact 25072143 / 42045032 / -40.4% 🟢 37278407 / 76858431 / -51.5% 🟢 0.67 / 0.55 / +22.9%
tpch_q20/duckdb:vortex-compact 19286974 / 37977846 / -49.2% 🟢 35786180 / 92845156 / -61.5% 🟢 0.54 / 0.41 / +31.8%
tpch_q21/duckdb:vortex-compact 68857334 / 123864245 / -44.4% 🟢 85526181 / 165854429 / -48.4% 🟢 0.81 / 0.75 / +7.8%
tpch_q22/duckdb:vortex-compact 13741144 / 22731097 / -39.5% 🟢 24150557 / 41815861 / -42.2% 🟢 0.57 / 0.54 / +4.7%
duckdb / parquet / ns (0.768x ✅, 22↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60135077 / 81972126 / -26.6% 🟢 66639880 / 92775689 / -28.2% 🟢 0.90 / 0.88 / +2.1%
tpch_q02/duckdb:parquet 34686848 / 46131844 / -24.8% 🟢 42496062 / 62906236 / -32.4% 🟢 0.82 / 0.73 / +11.3%
tpch_q03/duckdb:parquet 61875284 / 80997314 / -23.6% 🟢 73113983 / 100834209 / -27.5% 🟢 0.85 / 0.80 / +5.4%
tpch_q04/duckdb:parquet 43207129 / 58701813 / -26.4% 🟢 52734183 / 74575501 / -29.3% 🟢 0.82 / 0.79 / +4.1%
tpch_q05/duckdb:parquet 62376073 / 79166658 / -21.2% 🟢 74154812 / 119048243 / -37.7% 🟢 0.84 / 0.66 / +26.5%
tpch_q06/duckdb:parquet 20046294 / 25047904 / -20.0% 🟢 25156594 / 33789164 / -25.5% 🟢 0.80 / 0.74 / +7.5%
tpch_q07/duckdb:parquet 60395907 / 80449788 / -24.9% 🟢 71725433 / 98645161 / -27.3% 🟢 0.84 / 0.82 / +3.2%
tpch_q08/duckdb:parquet 73081951 / 97397123 / -25.0% 🟢 87818546 / 123349833 / -28.8% 🟢 0.83 / 0.79 / +5.4%
tpch_q09/duckdb:parquet 114066068 / 147329994 / -22.6% 🟢 127172645 / 171199977 / -25.7% 🟢 0.90 / 0.86 / +4.2%
tpch_q10/duckdb:parquet 110190314 / 141735604 / -22.3% 🟢 125598878 / 163965460 / -23.4% 🟢 0.88 / 0.86 / +1.5%
tpch_q11/duckdb:parquet 19906519 / 25310553 / -21.4% 🟢 23577274 / 33710870 / -30.1% 🟢 0.84 / 0.75 / +12.5%
tpch_q12/duckdb:parquet 41130487 / 53378536 / -22.9% 🟢 52141228 / 67990881 / -23.3% 🟢 0.79 / 0.79 / +0.5%
tpch_q13/duckdb:parquet 239373788 / 286320706 / -16.4% 🟢 248379580 / 304372126 / -18.4% 🟢 0.96 / 0.94 / +2.5%
tpch_q14/duckdb:parquet 43629799 / 56173359 / -22.3% 🟢 52768724 / 72483974 / -27.2% 🟢 0.83 / 0.77 / +6.7%
tpch_q15/duckdb:parquet 24735238 / 30715503 / -19.5% 🟢 31389894 / 42790848 / -26.6% 🟢 0.79 / 0.72 / +9.8%
tpch_q16/duckdb:parquet 49716562 / 66617167 / -25.4% 🟢 57107589 / 83511429 / -31.6% 🟢 0.87 / 0.80 / +9.1%
tpch_q17/duckdb:parquet 44382432 / 58070245 / -23.6% 🟢 54782514 / 76698551 / -28.6% 🟢 0.81 / 0.76 / +7.0%
tpch_q18/duckdb:parquet 90205253 / 128435482 / -29.8% 🟢 100382796 / 140221185 / -28.4% 🟢 0.90 / 0.92 / -1.9%
tpch_q19/duckdb:parquet 61014906 / 78063652 / -21.8% 🟢 71408015 / 96267279 / -25.8% 🟢 0.85 / 0.81 / +5.4%
tpch_q20/duckdb:parquet 61378038 / 77807904 / -21.1% 🟢 73873112 / 100979552 / -26.8% 🟢 0.83 / 0.77 / +7.8%
tpch_q21/duckdb:parquet 138835254 / 189638793 / -26.8% 🟢 148249743 / 203600243 / -27.2% 🟢 0.94 / 0.93 / +0.5%
tpch_q22/duckdb:parquet 50501334 / 64110568 / -21.2% 🟢 58314923 / 79878591 / -27.0% 🟢 0.87 / 0.80 / +7.9%

File Size Changes (5 files changed, +0.0% overall, 4↑ 1↓)
File Scale Format Base HEAD Change %
part.vortex 1.0 vortex-file-compressed 4.85 MB 4.87 MB +23.20 KB +0.5%
orders.vortex 1.0 vortex-file-compressed 35.92 MB 35.95 MB +35.85 KB +0.1%
lineitem.vortex 1.0 vortex-file-compressed 155.88 MB 155.89 MB +8.12 KB +0.0%
partsupp.vortex 1.0 vortex-file-compressed 23.60 MB 23.60 MB +16 B +0.0%
customer.vortex 1.0 vortex-file-compressed 8.35 MB 8.35 MB 48 B -0.0%

Totals:

  • vortex-compact: 189.71 MB → 189.71 MB (0.0%)
  • vortex-file-compressed: 229.43 MB → 229.50 MB (+0.0%)

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -12.0%
Engines: DataFusion No clear signal (+3.7%, environment too noisy confidence) · DuckDB No clear signal (-25.4%, environment too noisy confidence)
Vortex (geomean): hot 0.432x ✅ · cold 0.470x ✅
Parquet (geomean): hot 0.491x ✅ · cold 0.542x ✅
Shifts: Parquet (control) -50.9% · Median polish -60.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.469x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6873295 / 8817729 / -22.1% 🟢 20898457 / 36863716 / -43.3% 🟢 0.33 / 0.24 / +37.5%
fineweb_q01/datafusion:vortex-file-compressed 13447368 / 27916070 / -51.8% 🟢 54005690 / 94799603 / -43.0% 🟢 0.25 / 0.29 / -15.4%
fineweb_q02/datafusion:vortex-file-compressed 12590212 / 27056670 / -53.5% 🟢 56783564 / 91044497 / -37.6% 🟢 0.22 / 0.30 / -25.4%
fineweb_q03/datafusion:vortex-file-compressed 20529331 / 44951024 / -54.3% 🟢 107239459 / 172456620 / -37.8% 🟢 0.19 / 0.26 / -26.6%
fineweb_q04/datafusion:vortex-file-compressed 72913688 / 199126303 / -63.4% 🟢 154093542 / 304065350 / -49.3% 🟢 0.47 / 0.65 / -27.7%
fineweb_q05/datafusion:vortex-file-compressed 57822049 / 154663474 / -62.6% 🟢 137726751 / 280201436 / -50.8% 🟢 0.42 / 0.55 / -23.9%
fineweb_q06/datafusion:vortex-file-compressed 19202028 / 40287400 / -52.3% 🟢 110476720 / 190356458 / -42.0% 🟢 0.17 / 0.21 / -17.9%
fineweb_q07/datafusion:vortex-file-compressed 17681270 / 38776777 / -54.4% 🟢 103517261 / 182797109 / -43.4% 🟢 0.17 / 0.21 / -19.5%
fineweb_q08/datafusion:vortex-file-compressed 9495004 / 20535396 / -53.8% 🟢 45919953 / 82329456 / -44.2% 🟢 0.21 / 0.25 / -17.1%
datafusion / vortex-compact / ns (0.401x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6946994 / 8431716 / -17.6% 🟢 19556398 / 36291471 / -46.1% 🟢 0.36 / 0.23 / +52.9%
fineweb_q01/datafusion:vortex-compact 44520168 / 100105330 / -55.5% 🟢 83531914 / 169865933 / -50.8% 🟢 0.53 / 0.59 / -9.6%
fineweb_q02/datafusion:vortex-compact 44350108 / 100805504 / -56.0% 🟢 82605892 / 163744948 / -49.6% 🟢 0.54 / 0.62 / -12.8%
fineweb_q03/datafusion:vortex-compact 157836545 / 531173219 / -70.3% 🟢 258487979 / 608794851 / -57.5% 🟢 0.61 / 0.87 / -30.0%
fineweb_q04/datafusion:vortex-compact 190660210 / 568634988 / -66.5% 🟢 246261375 / 679232313 / -63.7% 🟢 0.77 / 0.84 / -7.5%
fineweb_q05/datafusion:vortex-compact 170582554 / 514276812 / -66.8% 🟢 228739161 / 611832428 / -62.6% 🟢 0.75 / 0.84 / -11.3%
fineweb_q06/datafusion:vortex-compact 85640546 / 289054490 / -70.4% 🟢 166132855 / 418736275 / -60.3% 🟢 0.52 / 0.69 / -25.3%
fineweb_q07/datafusion:vortex-compact 89070736 / 296538121 / -70.0% 🟢 156995322 / 430419993 / -63.5% 🟢 0.57 / 0.69 / -17.7%
fineweb_q08/datafusion:vortex-compact 9257208 / 16245558 / -43.0% 🟢 42562763 / 64447680 / -34.0% 🟢 0.22 / 0.25 / -13.7%
datafusion / parquet / ns (0.418x ✅, 8↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9462754 / 8349684 / +13.3% 🔴 35036399 / 50248070 / -30.3% 🟢 0.27 / 0.17 / +62.5%
fineweb_q01/datafusion:parquet 70431323 / 191208254 / -63.2% 🟢 152006612 / 274920370 / -44.7% 🟢 0.46 / 0.70 / -33.4%
fineweb_q02/datafusion:parquet 68407538 / 186687712 / -63.4% 🟢 158479310 / 282597770 / -43.9% 🟢 0.43 / 0.66 / -34.7%
fineweb_q03/datafusion:parquet 68608138 / 188765412 / -63.7% 🟢 148700047 / 278704144 / -46.6% 🟢 0.46 / 0.68 / -31.9%
fineweb_q04/datafusion:parquet 76725664 / 208286109 / -63.2% 🟢 151445946 / 301703612 / -49.8% 🟢 0.51 / 0.69 / -26.6%
fineweb_q05/datafusion:parquet 74260482 / 204948502 / -63.8% 🟢 162372342 / 298275732 / -45.6% 🟢 0.46 / 0.69 / -33.4%
fineweb_q06/datafusion:parquet 70492332 / 189410080 / -62.8% 🟢 152358814 / 279350392 / -45.5% 🟢 0.46 / 0.68 / -31.8%
fineweb_q07/datafusion:parquet 70832934 / 189266876 / -62.6% 🟢 152179596 / 274647315 / -44.6% 🟢 0.47 / 0.69 / -32.5%
fineweb_q08/datafusion:parquet 71122475 / 187713936 / -62.1% 🟢 157336422 / 278341657 / -43.5% 🟢 0.45 / 0.67 / -33.0%
duckdb / vortex-file-compressed / ns (0.395x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2067888 / 3395134 / -39.1% 🟢 4797224 / 15966548 / -70.0% 🟢 0.43 / 0.21 / +102.7%
fineweb_q01/duckdb:vortex-file-compressed 20419042 / 37812417 / -46.0% 🟢 61161791 / 131429296 / -53.5% 🟢 0.33 / 0.29 / +16.0%
fineweb_q02/duckdb:vortex-file-compressed 16965768 / 43314548 / -60.8% 🟢 48612330 / 124427587 / -60.9% 🟢 0.35 / 0.35 / +0.3%
fineweb_q03/duckdb:vortex-file-compressed 23587960 / 67325544 / -65.0% 🟢 102651212 / 184548680 / -44.4% 🟢 0.23 / 0.36 / -37.0%
fineweb_q04/duckdb:vortex-file-compressed 79436078 / 267333002 / -70.3% 🟢 141144131 / 387970563 / -63.6% 🟢 0.56 / 0.69 / -18.3%
fineweb_q05/duckdb:vortex-file-compressed 64644373 / 220527167 / -70.7% 🟢 124898679 / 331258604 / -62.3% 🟢 0.52 / 0.67 / -22.3%
fineweb_q06/duckdb:vortex-file-compressed 23341806 / 63339442 / -63.1% 🟢 105274930 / 253414617 / -58.5% 🟢 0.22 / 0.25 / -11.3%
fineweb_q07/duckdb:vortex-file-compressed 22771377 / 57206098 / -60.2% 🟢 96265069 / 163205626 / -41.0% 🟢 0.24 / 0.35 / -32.5%
fineweb_q08/duckdb:vortex-file-compressed 11121579 / 27170711 / -59.1% 🟢 51145692 / 89142739 / -42.6% 🟢 0.22 / 0.30 / -28.7%
duckdb / vortex-compact / ns (0.467x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2708663 / 3950838 / -31.4% 🟢 7338253 / 16578835 / -55.7% 🟢 0.37 / 0.24 / +54.9%
fineweb_q01/duckdb:vortex-compact 54800400 / 102913645 / -46.8% 🟢 94322669 / 192011960 / -50.9% 🟢 0.58 / 0.54 / +8.4%
fineweb_q02/duckdb:vortex-compact 51555846 / 108321974 / -52.4% 🟢 89105325 / 171162088 / -47.9% 🟢 0.58 / 0.63 / -8.6%
fineweb_q03/duckdb:vortex-compact 182014938 / 435364263 / -58.2% 🟢 247763810 / 558810299 / -55.7% 🟢 0.73 / 0.78 / -5.7%
fineweb_q04/duckdb:vortex-compact 201133263 / 454838498 / -55.8% 🟢 252522232 / 579599630 / -56.4% 🟢 0.80 / 0.78 / +1.5%
fineweb_q05/duckdb:vortex-compact 190845038 / 401476362 / -52.5% 🟢 217034532 / 515708625 / -57.9% 🟢 0.88 / 0.78 / +13.0%
fineweb_q06/duckdb:vortex-compact 99271844 / 238159000 / -58.3% 🟢 167182550 / 435150139 / -61.6% 🟢 0.59 / 0.55 / +8.5%
fineweb_q07/duckdb:vortex-compact 95041754 / 243979192 / -61.0% 🟢 153750719 / 359406001 / -57.2% 🟢 0.62 / 0.68 / -8.9%
fineweb_q08/duckdb:vortex-compact 10689056 / 24972434 / -57.2% 🟢 42845322 / 104423518 / -59.0% 🟢 0.25 / 0.24 / +4.3%
duckdb / parquet / ns (0.576x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22010298 / 36594066 / -39.9% 🟢 28849975 / 36840273 / -21.7% 🟢 0.76 / 0.99 / -23.2%
fineweb_q01/duckdb:parquet 45461330 / 77872732 / -41.6% 🟢 55666703 / 105805755 / -47.4% 🟢 0.82 / 0.74 / +11.0%
fineweb_q02/duckdb:parquet 43807344 / 76403498 / -42.7% 🟢 57355909 / 104778560 / -45.3% 🟢 0.76 / 0.73 / +4.7%
fineweb_q03/duckdb:parquet 95423772 / 205495207 / -53.6% 🟢 181035083 / 422818207 / -57.2% 🟢 0.53 / 0.49 / +8.5%
fineweb_q04/duckdb:parquet 151348742 / 231643815 / -34.7% 🟢 213094021 / 444505187 / -52.1% 🟢 0.71 / 0.52 / +36.3%
fineweb_q05/duckdb:parquet 144024990 / 203706140 / -29.3% 🟢 200691110 / 425664995 / -52.9% 🟢 0.72 / 0.48 / +50.0%
fineweb_q06/duckdb:parquet 71869277 / 141662990 / -49.3% 🟢 128476153 / 273513801 / -53.0% 🟢 0.56 / 0.52 / +8.0%
fineweb_q07/duckdb:parquet 72018056 / 144213858 / -50.1% 🟢 150515206 / 324132565 / -53.6% 🟢 0.48 / 0.44 / +7.5%
fineweb_q08/duckdb:parquet 24215411 / 37804670 / -35.9% 🟢 24501688 / 38607511 / -36.5% 🟢 0.99 / 0.98 / +0.9%

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.42 GB 1.42 GB +105.45 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.42 GB → 1.42 GB (+0.0%)

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.9%
Engines: DataFusion No clear signal (-9.9%, environment too noisy confidence) · DuckDB No clear signal (+0.5%, environment too noisy confidence)
Vortex (geomean): hot 0.518x ✅ · cold 0.468x ✅
Parquet (geomean): hot 0.544x ✅ · cold 0.509x ✅
Shifts: Parquet (control) -45.6% · Median polish -45.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.560x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52352341 / 95021763 / -44.9% 🟢 68770856 / 157180690 / -56.2% 🟢 0.76 / 0.60 / +25.9%
appian_q02/datafusion:vortex-compact 234522566 / 446903663 / -47.5% 🟢 260840918 / 560415848 / -53.5% 🟢 0.90 / 0.80 / +12.7%
appian_q03/datafusion:vortex-compact 147211552 / 291751214 / -49.5% 🟢 181284283 / 419457700 / -56.8% 🟢 0.81 / 0.70 / +16.8%
appian_q04/datafusion:vortex-compact 9881281364 / 13559864790 / -27.1% 🟢 9814980649 / 13810954464 / -28.9% 🟢 1.01 / 0.98 / +2.5%
appian_q05/datafusion:vortex-compact 134530930 / 205901538 / -34.7% 🟢 159810173 / 287658224 / -44.4% 🟢 0.84 / 0.72 / +17.6%
appian_q06/datafusion:vortex-compact 143070536 / 265243578 / -46.1% 🟢 161311759 / 329944435 / -51.1% 🟢 0.89 / 0.80 / +10.3%
appian_q07/datafusion:vortex-compact 163813805 / 287214451 / -43.0% 🟢 196852444 / 402104935 / -51.0% 🟢 0.83 / 0.71 / +16.5%
appian_q08/datafusion:vortex-compact 567401953 / 1259895489 / -55.0% 🟢 583517098 / 1392960321 / -58.1% 🟢 0.97 / 0.90 / +7.5%
datafusion / parquet / ns (0.621x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 71450191 / 109129160 / -34.5% 🟢 86920899 / 172109832 / -49.5% 🟢 0.82 / 0.63 / +29.6%
appian_q02/datafusion:parquet 297228757 / 494935488 / -39.9% 🟢 321379466 / 596941239 / -46.2% 🟢 0.92 / 0.83 / +11.5%
appian_q03/datafusion:parquet 186588528 / 310686274 / -39.9% 🟢 221626217 / 458328542 / -51.6% 🟢 0.84 / 0.68 / +24.2%
appian_q04/datafusion:parquet 9893195100 / 13732428401 / -28.0% 🟢 9832485320 / 13878362809 / -29.2% 🟢 1.01 / 0.99 / +1.7%
appian_q05/datafusion:parquet 187944700 / 250155688 / -24.9% 🟢 211865306 / 327535255 / -35.3% 🟢 0.89 / 0.76 / +16.1%
appian_q06/datafusion:parquet 166684375 / 297129121 / -43.9% 🟢 188424621 / 382590780 / -50.8% 🟢 0.88 / 0.78 / +13.9%
appian_q07/datafusion:parquet 206166506 / 326595677 / -36.9% 🟢 234766601 / 432578766 / -45.7% 🟢 0.88 / 0.75 / +16.3%
appian_q08/datafusion:parquet 653053466 / 1331505448 / -51.0% 🟢 674822292 / 1447791323 / -53.4% 🟢 0.97 / 0.92 / +5.2%
duckdb / vortex-compact / ns (0.479x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 90922837 / 152275442 / -40.3% 🟢 104110299 / 206444443 / -49.6% 🟢 0.87 / 0.74 / +18.4%
appian_q02/duckdb:vortex-compact 214237485 / 408874458 / -47.6% 🟢 229029055 / 469978927 / -51.3% 🟢 0.94 / 0.87 / +7.5%
appian_q03/duckdb:vortex-compact 121653243 / 252898478 / -51.9% 🟢 137469011 / 330851923 / -58.4% 🟢 0.88 / 0.76 / +15.8%
appian_q04/duckdb:vortex-compact 542630899 / 1578381136 / -65.6% 🟢 565513468 / 1584337025 / -64.3% 🟢 0.96 / 1.00 / -3.7%
appian_q05/duckdb:vortex-compact 134536218 / 238764360 / -43.7% 🟢 155079164 / 282660092 / -45.1% 🟢 0.87 / 0.84 / +2.7%
appian_q06/duckdb:vortex-compact 410501956 / 989183772 / -58.5% 🟢 399356929 / 1168905881 / -65.8% 🟢 1.03 / 0.85 / +21.5%
appian_q07/duckdb:vortex-compact 137895890 / 287853340 / -52.1% 🟢 159842855 / 351884874 / -54.6% 🟢 0.86 / 0.82 / +5.5%
appian_q08/duckdb:vortex-compact 440301539 / 919757488 / -52.1% 🟢 471777235 / 959031756 / -50.8% 🟢 0.93 / 0.96 / -2.7%
duckdb / parquet / ns (0.477x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 98458823 / 156564676 / -37.1% 🟢 115903997 / 188914719 / -38.6% 🟢 0.85 / 0.83 / +2.5%
appian_q02/duckdb:parquet 199696020 / 358296061 / -44.3% 🟢 207483996 / 374541949 / -44.6% 🟢 0.96 / 0.96 / +0.6%
appian_q03/duckdb:parquet 124221818 / 225423409 / -44.9% 🟢 146738526 / 247626961 / -40.7% 🟢 0.85 / 0.91 / -7.0%
appian_q04/duckdb:parquet 441115933 / 1479249768 / -70.2% 🟢 437896220 / 1518486287 / -71.2% 🟢 1.01 / 0.97 / +3.4%
appian_q05/duckdb:parquet 142422055 / 247446991 / -42.4% 🟢 166113876 / 285929395 / -41.9% 🟢 0.86 / 0.87 / -0.9%
appian_q06/duckdb:parquet 281088113 / 985678207 / -71.5% 🟢 270413542 / 1019944856 / -73.5% 🟢 1.04 / 0.97 / +7.6%
appian_q07/duckdb:parquet 155295360 / 264777407 / -41.3% 🟢 173327052 / 281643357 / -38.5% 🟢 0.90 / 0.94 / -4.7%
appian_q08/duckdb:parquet 376153329 / 782063438 / -51.9% 🟢 405023880 / 821261102 / -50.7% 🟢 0.93 / 0.95 / -2.5%

No file size changes detected.

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: Likely regression (environment too noisy confidence)
Attributed Vortex impact: +166.2%
Engines: DataFusion No clear signal (+18.2%, environment too noisy confidence) · DuckDB Likely regression (+499.5%, environment too noisy confidence)
Vortex (geomean): hot 0.872x ➖ · cold 0.848x ➖
Parquet (geomean): hot 0.328x ✅ · cold 0.793x ➖
Shifts: Parquet (control) -67.2% · Median polish -17.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.886x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 46827190 / 33934058 / +38.0% 🔴 199459879 / 129923564 / +53.5% 🔴 0.23 / 0.26 / -10.1%
fineweb_q01/datafusion:vortex-file-compressed 400579496 / 415839582 / -3.7% 713154315 / 808560428 / -11.8% 0.56 / 0.51 / +9.2%
fineweb_q02/datafusion:vortex-file-compressed 370025503 / 403394866 / -8.3% 570682427 / 444038176 / +28.5% 0.65 / 0.91 / -28.6%
fineweb_q03/datafusion:vortex-file-compressed 455064716 / 620356512 / -26.6% 646092001 / 724251726 / -10.8% 0.70 / 0.86 / -17.8%
fineweb_q04/datafusion:vortex-file-compressed 392292116 / 646580926 / -39.3% 🟢 426842589 / 504276608 / -15.4% 0.92 / 1.28 / -28.3%
fineweb_q05/datafusion:vortex-file-compressed 402782062 / 582051767 / -30.8% 🟢 420027842 / 560186176 / -25.0% 0.96 / 1.04 / -7.7%
fineweb_q06/datafusion:vortex-file-compressed 697229193 / 659637183 / +5.7% 689874201 / 692427688 / -0.4% 1.01 / 0.95 / +6.1%
fineweb_q07/datafusion:vortex-file-compressed 471819534 / 511155074 / -7.7% 587748060 / 495198302 / +18.7% 0.80 / 1.03 / -22.2%
fineweb_q08/datafusion:vortex-file-compressed 201520648 / 218453506 / -7.8% 237615738 / 286193712 / -17.0% 0.85 / 0.76 / +11.1%
datafusion / vortex-compact / ns (0.776x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 53826046 / 37244654 / +44.5% 🔴 128474199 / 118255988 / +8.6% 0.42 / 0.31 / +33.0%
fineweb_q01/datafusion:vortex-compact 379019501 / 455936358 / -16.9% 593947601 / 660627835 / -10.1% 0.64 / 0.69 / -7.5%
fineweb_q02/datafusion:vortex-compact 355465622 / 491970042 / -27.7% 481091029 / 558304222 / -13.8% 0.74 / 0.88 / -16.2%
fineweb_q03/datafusion:vortex-compact 537173734 / 928472438 / -42.1% 🟢 1018249083 / 1675463824 / -39.2% 🟢 0.53 / 0.55 / -4.8%
fineweb_q04/datafusion:vortex-compact 446542109 / 996813832 / -55.2% 🟢 463793835 / 799335965 / -42.0% 🟢 0.96 / 1.25 / -22.8%
fineweb_q05/datafusion:vortex-compact 491064310 / 831387397 / -40.9% 🟢 515803425 / 781615802 / -34.0% 🟢 0.95 / 1.06 / -10.5%
fineweb_q06/datafusion:vortex-compact 668739652 / 754163160 / -11.3% 649816486 / 782096511 / -16.9% 1.03 / 0.96 / +6.7%
fineweb_q07/datafusion:vortex-compact 492805826 / 614085138 / -19.7% 423674092 / 537871762 / -21.2% 1.16 / 1.14 / +1.9%
fineweb_q08/datafusion:vortex-compact 198611959 / 183470302 / +8.3% 195962850 / 223323851 / -12.3% 1.01 / 0.82 / +23.4%
datafusion / parquet / ns (0.702x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 559432395 / 693755275 / -19.4% 823027249 / 1132309050 / -27.3% 0.68 / 0.61 / +10.9%
fineweb_q01/datafusion:parquet 781280867 / 1211335513 / -35.5% 🟢 970822548 / 1013795694 / -4.2% 0.80 / 1.19 / -32.6%
fineweb_q02/datafusion:parquet 706019764 / 1315500536 / -46.3% 🟢 630349726 / 1471278474 / -57.2% 🟢 1.12 / 0.89 / +25.3%
fineweb_q03/datafusion:parquet 657948950 / 1059150416 / -37.9% 🟢 607027059 / 883248586 / -31.3% 🟢 1.08 / 1.20 / -9.6%
fineweb_q04/datafusion:parquet 813399998 / 1020456081 / -20.3% 1049827996 / 1088755474 / -3.6% 0.77 / 0.94 / -17.3%
fineweb_q05/datafusion:parquet 689025762 / 990891421 / -30.5% 🟢 681433921 / 1153698779 / -40.9% 🟢 1.01 / 0.86 / +17.7%
fineweb_q06/datafusion:parquet 671035458 / 922590704 / -27.3% 649100962 / 1352734992 / -52.0% 🟢 1.03 / 0.68 / +51.6%
fineweb_q07/datafusion:parquet 737264684 / 974564193 / -24.3% 700180803 / 1356288447 / -48.4% 🟢 1.05 / 0.72 / +46.5%
fineweb_q08/datafusion:parquet 762497750 / 974290372 / -21.7% 650388839 / 1106100674 / -41.2% 🟢 1.17 / 0.88 / +33.1%
duckdb / vortex-file-compressed / ns (0.958x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 60221507 / 75133720 / -19.8% 66302840 / 117800435 / -43.7% 🟢 0.91 / 0.64 / +42.4%
fineweb_q01/duckdb:vortex-file-compressed 519224334 / 544560636 / -4.7% 563665807 / 801309229 / -29.7% 0.92 / 0.68 / +35.5%
fineweb_q02/duckdb:vortex-file-compressed 672889626 / 684831795 / -1.7% 667457874 / 683498879 / -2.3% 1.01 / 1.00 / +0.6%
fineweb_q03/duckdb:vortex-file-compressed 1408789418 / 1450214828 / -2.9% 1432756038 / 1625824985 / -11.9% 0.98 / 0.89 / +10.2%
fineweb_q04/duckdb:vortex-file-compressed 1594117598 / 1605175312 / -0.7% 1566897616 / 1639535632 / -4.4% 1.02 / 0.98 / +3.9%
fineweb_q05/duckdb:vortex-file-compressed 1469062523 / 1516116553 / -3.1% 1452129044 / 1463887236 / -0.8% 1.01 / 1.04 / -2.3%
fineweb_q06/duckdb:vortex-file-compressed 1623987168 / 1686168637 / -3.7% 1550547740 / 1778988574 / -12.8% 1.05 / 0.95 / +10.5%
fineweb_q07/duckdb:vortex-file-compressed 1400360080 / 1431474336 / -2.2% 1390709082 / 1537717933 / -9.6% 1.01 / 0.93 / +8.2%
fineweb_q08/duckdb:vortex-file-compressed 613479434 / 597383380 / +2.7% 664103439 / 689060725 / -3.6% 0.92 / 0.87 / +6.6%
duckdb / vortex-compact / ns (0.878x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 65483362 / 71449682 / -8.4% 69563013 / 143375670 / -51.5% 🟢 0.94 / 0.50 / +88.9%
fineweb_q01/duckdb:vortex-compact 428826412 / 516152037 / -16.9% 498352163 / 1164250212 / -57.2% 🟢 0.86 / 0.44 / +94.1%
fineweb_q02/duckdb:vortex-compact 626470680 / 686325937 / -8.7% 638033092 / 718287887 / -11.2% 0.98 / 0.96 / +2.8%
fineweb_q03/duckdb:vortex-compact 1650263552 / 1955235654 / -15.6% 1778671294 / 2055412168 / -13.5% 0.93 / 0.95 / -2.5%
fineweb_q04/duckdb:vortex-compact 1598602168 / 1808954422 / -11.6% 1601833961 / 1726324394 / -7.2% 1.00 / 1.05 / -4.8%
fineweb_q05/duckdb:vortex-compact 1377399408 / 1667175928 / -17.4% 1553299995 / 1602762853 / -3.1% 0.89 / 1.04 / -14.8%
fineweb_q06/duckdb:vortex-compact 1557499525 / 1694231276 / -8.1% 1491248238 / 1669769043 / -10.7% 1.04 / 1.01 / +2.9%
fineweb_q07/duckdb:vortex-compact 1300096538 / 1543183380 / -15.8% 1294835856 / 1423873488 / -9.1% 1.00 / 1.08 / -7.4%
fineweb_q08/duckdb:vortex-compact 510997294 / 546532566 / -6.5% 527514025 / 622302975 / -15.2% 0.97 / 0.88 / +10.3%
duckdb / parquet / ns (0.153x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 472957154 / 5277657002 / -91.0% 🟢 512153269 / 660981602 / -22.5% 0.92 / 7.98 / -88.4%
fineweb_q01/duckdb:parquet 632165476 / 5320437194 / -88.1% 🟢 556782653 / 668263904 / -16.7% 1.14 / 7.96 / -85.7%
fineweb_q02/duckdb:parquet 535073762 / 5301419810 / -89.9% 🟢 555185367 / 622003383 / -10.7% 0.96 / 8.52 / -88.7%
fineweb_q03/duckdb:parquet 1279676971 / 5345532504 / -76.1% 🟢 1333917239 / 1185093310 / +12.6% 0.96 / 4.51 / -78.7%
fineweb_q04/duckdb:parquet 778675813 / 5287844374 / -85.3% 🟢 857642151 / 948145724 / -9.5% 0.91 / 5.58 / -83.7%
fineweb_q05/duckdb:parquet 817664884 / 3030363718 / -73.0% 🟢 819695044 / 981367706 / -16.5% 1.00 / 3.09 / -67.7%
fineweb_q06/duckdb:parquet 1506760187 / 5394625164 / -72.1% 🟢 1518739140 / 1372361154 / +10.7% 0.99 / 3.93 / -74.8%
fineweb_q07/duckdb:parquet 957014874 / 5367184224 / -82.2% 🟢 1001805605 / 980449011 / +2.2% 0.96 / 5.47 / -82.5%
fineweb_q08/duckdb:parquet 473579726 / 5255816708 / -91.0% 🟢 1085981755 / 657958542 / +65.1% 🔴 0.44 / 7.99 / -94.5%

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.7%
Engines: DataFusion No clear signal (+12.0%, environment too noisy confidence) · DuckDB No clear signal (+7.4%, environment too noisy confidence)
Vortex (geomean): hot 0.981x ➖ · cold 0.913x ➖
Parquet (geomean): hot 0.894x ➖ · cold 0.882x ➖
Shifts: Parquet (control) -10.6% · Median polish -2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 260750446 / 236815662 / +10.1% 2393825555 / 701098189 / +241.4% 🔴 0.11 / 0.34 / -67.8%
tpch_q02/datafusion:vortex-file-compressed 323018417 / 351687306 / -8.2% 626834430 / 620850751 / +1.0% 0.52 / 0.57 / -9.0%
tpch_q03/datafusion:vortex-file-compressed 322277190 / 339536717 / -5.1% 1021383298 / 921036546 / +10.9% 0.32 / 0.37 / -14.4%
tpch_q04/datafusion:vortex-file-compressed 192745161 / 160551520 / +20.1% 462873195 / 363020333 / +27.5% 0.42 / 0.44 / -5.8%
tpch_q05/datafusion:vortex-file-compressed 350395922 / 346561475 / +1.1% 573593446 / 594920046 / -3.6% 0.61 / 0.58 / +4.9%
tpch_q06/datafusion:vortex-file-compressed 241324767 / 239946512 / +0.6% 383531167 / 431551774 / -11.1% 0.63 / 0.56 / +13.2%
tpch_q07/datafusion:vortex-file-compressed 502112278 / 336990129 / +49.0% 🔴 546356949 / 511417848 / +6.8% 0.92 / 0.66 / +39.5%
tpch_q08/datafusion:vortex-file-compressed 430150527 / 551069781 / -21.9% 578034214 / 815609334 / -29.1% 0.74 / 0.68 / +10.1%
tpch_q09/datafusion:vortex-file-compressed 463152315 / 286263798 / +61.8% 🔴 532684265 / 913670459 / -41.7% 🟢 0.87 / 0.31 / +177.5%
tpch_q10/datafusion:vortex-file-compressed 308598749 / 306724015 / +0.6% 436329587 / 540860313 / -19.3% 0.71 / 0.57 / +24.7%
tpch_q11/datafusion:vortex-file-compressed 293349054 / 289190458 / +1.4% 443518641 / 434383797 / +2.1% 0.66 / 0.67 / -0.7%
tpch_q12/datafusion:vortex-file-compressed 444943478 / 482797963 / -7.8% 462590494 / 634466936 / -27.1% 0.96 / 0.76 / +26.4%
tpch_q13/datafusion:vortex-file-compressed 102739694 / 122445662 / -16.1% 318648889 / 539338984 / -40.9% 🟢 0.32 / 0.23 / +42.0%
tpch_q14/datafusion:vortex-file-compressed 167111961 / 187240514 / -10.8% 295745745 / 346699503 / -14.7% 0.57 / 0.54 / +4.6%
tpch_q15/datafusion:vortex-file-compressed 342213200 / 321423436 / +6.5% 523178966 / 603729759 / -13.3% 0.65 / 0.53 / +22.9%
tpch_q16/datafusion:vortex-file-compressed 175807052 / 168224151 / +4.5% 325383797 / 332650949 / -2.2% 0.54 / 0.51 / +6.8%
tpch_q17/datafusion:vortex-file-compressed 259862204 / 279906572 / -7.2% 394269640 / 503500730 / -21.7% 0.66 / 0.56 / +18.6%
tpch_q18/datafusion:vortex-file-compressed 227859606 / 236897431 / -3.8% 401325221 / 457711324 / -12.3% 0.57 / 0.52 / +9.7%
tpch_q19/datafusion:vortex-file-compressed 328439648 / 369641830 / -11.1% 453726952 / 611784183 / -25.8% 0.72 / 0.60 / +19.8%
tpch_q20/datafusion:vortex-file-compressed 290984693 / 288518580 / +0.9% 401579334 / 432070180 / -7.1% 0.72 / 0.67 / +8.5%
tpch_q21/datafusion:vortex-file-compressed 398021275 / 420188971 / -5.3% 572438840 / 629783951 / -9.1% 0.70 / 0.67 / +4.2%
tpch_q22/datafusion:vortex-file-compressed 160178325 / 265727320 / -39.7% 🟢 345529964 / 521482225 / -33.7% 🟢 0.46 / 0.51 / -9.0%
datafusion / vortex-compact / ns (0.982x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 211476239 / 246362515 / -14.2% 658358167 / 589816110 / +11.6% 0.32 / 0.42 / -23.1%
tpch_q02/datafusion:vortex-compact 300608706 / 303511322 / -1.0% 794062148 / 624897956 / +27.1% 0.38 / 0.49 / -22.1%
tpch_q03/datafusion:vortex-compact 333879071 / 332826528 / +0.3% 638942926 / 848076720 / -24.7% 0.52 / 0.39 / +33.2%
tpch_q04/datafusion:vortex-compact 144197360 / 170817741 / -15.6% 318192325 / 326909470 / -2.7% 0.45 / 0.52 / -13.3%
tpch_q05/datafusion:vortex-compact 330972561 / 305906628 / +8.2% 468032903 / 559721376 / -16.4% 0.71 / 0.55 / +29.4%
tpch_q06/datafusion:vortex-compact 240721807 / 252749196 / -4.8% 365340121 / 418729220 / -12.8% 0.66 / 0.60 / +9.2%
tpch_q07/datafusion:vortex-compact 338416296 / 427419044 / -20.8% 454006139 / 564695144 / -19.6% 0.75 / 0.76 / -1.5%
tpch_q08/datafusion:vortex-compact 369771817 / 364310094 / +1.5% 552472618 / 547136425 / +1.0% 0.67 / 0.67 / +0.5%
tpch_q09/datafusion:vortex-compact 431708621 / 266798177 / +61.8% 🔴 515649497 / 486478027 / +6.0% 0.84 / 0.55 / +52.7%
tpch_q10/datafusion:vortex-compact 323630466 / 320883327 / +0.9% 487364172 / 580140197 / -16.0% 0.66 / 0.55 / +20.1%
tpch_q11/datafusion:vortex-compact 288748985 / 283362994 / +1.9% 457277260 / 457493884 / -0.0% 0.63 / 0.62 / +1.9%
tpch_q12/datafusion:vortex-compact 283483947 / 322747169 / -12.2% 407543887 / 512511555 / -20.5% 0.70 / 0.63 / +10.5%
tpch_q13/datafusion:vortex-compact 99282340 / 116228602 / -14.6% 331390076 / 527694844 / -37.2% 🟢 0.30 / 0.22 / +36.0%
tpch_q14/datafusion:vortex-compact 161251875 / 189464178 / -14.9% 267022075 / 335999324 / -20.5% 0.60 / 0.56 / +7.1%
tpch_q15/datafusion:vortex-compact 297903202 / 296270903 / +0.6% 880718938 / 507506462 / +73.5% 🔴 0.34 / 0.58 / -42.1%
tpch_q16/datafusion:vortex-compact 155262586 / 151773734 / +2.3% 493693076 / 319134333 / +54.7% 🔴 0.31 / 0.48 / -33.9%
tpch_q17/datafusion:vortex-compact 368387252 / 278975472 / +32.1% 🔴 879955384 / 471619370 / +86.6% 🔴 0.42 / 0.59 / -29.2%
tpch_q18/datafusion:vortex-compact 228369451 / 247099681 / -7.6% 416439437 / 437552868 / -4.8% 0.55 / 0.56 / -2.9%
tpch_q19/datafusion:vortex-compact 428599935 / 427485655 / +0.3% 476019191 / 710970296 / -33.0% 🟢 0.90 / 0.60 / +49.7%
tpch_q20/datafusion:vortex-compact 328408702 / 273474845 / +20.1% 518181473 / 459919464 / +12.7% 0.63 / 0.59 / +6.6%
tpch_q21/datafusion:vortex-compact 365865595 / 452806309 / -19.2% 519167991 / 615759209 / -15.7% 0.70 / 0.74 / -4.2%
tpch_q22/datafusion:vortex-compact 146598221 / 169295677 / -13.4% 303262531 / 356064817 / -14.8% 0.48 / 0.48 / +1.7%
datafusion / parquet / ns (0.880x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 170482311 / 222418594 / -23.4% 519581923 / 675564213 / -23.1% 0.33 / 0.33 / -0.3%
tpch_q02/datafusion:parquet 281624856 / 289433254 / -2.7% 523101115 / 541425488 / -3.4% 0.54 / 0.53 / +0.7%
tpch_q03/datafusion:parquet 297911217 / 276921846 / +7.6% 713539816 / 838137856 / -14.9% 0.42 / 0.33 / +26.4%
tpch_q04/datafusion:parquet 135016308 / 304030351 / -55.6% 🟢 389874853 / 459450488 / -15.1% 0.35 / 0.66 / -47.7%
tpch_q05/datafusion:parquet 335494894 / 369371606 / -9.2% 451779240 / 532255825 / -15.1% 0.74 / 0.69 / +7.0%
tpch_q06/datafusion:parquet 126062260 / 134916591 / -6.6% 229620087 / 330576907 / -30.5% 🟢 0.55 / 0.41 / +34.5%
tpch_q07/datafusion:parquet 328491758 / 359248419 / -8.6% 487208892 / 533792698 / -8.7% 0.67 / 0.67 / +0.2%
tpch_q08/datafusion:parquet 427690363 / 559203327 / -23.5% 563242902 / 600777947 / -6.2% 0.76 / 0.93 / -18.4%
tpch_q09/datafusion:parquet 432034387 / 458575061 / -5.8% 618669543 / 701991057 / -11.9% 0.70 / 0.65 / +6.9%
tpch_q10/datafusion:parquet 381765615 / 408384180 / -6.5% 502852232 / 551368707 / -8.8% 0.76 / 0.74 / +2.5%
tpch_q11/datafusion:parquet 255472751 / 286114067 / -10.7% 425257383 / 550687454 / -22.8% 0.60 / 0.52 / +15.6%
tpch_q12/datafusion:parquet 189745308 / 191721860 / -1.0% 371584242 / 469106476 / -20.8% 0.51 / 0.41 / +24.9%
tpch_q13/datafusion:parquet 392665373 / 451678915 / -13.1% 495799705 / 697504005 / -28.9% 0.79 / 0.65 / +22.3%
tpch_q14/datafusion:parquet 165854850 / 176556793 / -6.1% 539333744 / 328597229 / +64.1% 🔴 0.31 / 0.54 / -42.8%
tpch_q15/datafusion:parquet 261733124 / 274299214 / -4.6% 414715180 / 469601259 / -11.7% 0.63 / 0.58 / +8.0%
tpch_q16/datafusion:parquet 118799741 / 121320015 / -2.1% 270065357 / 349137025 / -22.6% 0.44 / 0.35 / +26.6%
tpch_q17/datafusion:parquet 297552875 / 296043367 / +0.5% 410196537 / 435794532 / -5.9% 0.73 / 0.68 / +6.8%
tpch_q18/datafusion:parquet 394017175 / 471211812 / -16.4% 492040475 / 612918823 / -19.7% 0.80 / 0.77 / +4.2%
tpch_q19/datafusion:parquet 165178587 / 198500821 / -16.8% 290331535 / 425331862 / -31.7% 🟢 0.57 / 0.47 / +21.9%
tpch_q20/datafusion:parquet 255273817 / 296160722 / -13.8% 387747738 / 470106740 / -17.5% 0.66 / 0.63 / +4.5%
tpch_q21/datafusion:parquet 329233109 / 363902843 / -9.5% 438494551 / 528406128 / -17.0% 0.75 / 0.69 / +9.0%
tpch_q22/datafusion:parquet 184616083 / 212284331 / -13.0% 340775329 / 417563917 / -18.4% 0.54 / 0.51 / +6.6%
duckdb / vortex-file-compressed / ns (0.970x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 240052482 / 230949865 / +3.9% 284482775 / 260227389 / +9.3% 0.84 / 0.89 / -4.9%
tpch_q02/duckdb:vortex-file-compressed 384434174 / 410902608 / -6.4% 375473632 / 447383054 / -16.1% 1.02 / 0.92 / +11.5%
tpch_q03/duckdb:vortex-file-compressed 431114775 / 430462010 / +0.2% 404616776 / 542172879 / -25.4% 1.07 / 0.79 / +34.2%
tpch_q04/duckdb:vortex-file-compressed 323194573 / 252070930 / +28.2% 395212338 / 301845230 / +30.9% 🔴 0.82 / 0.84 / -2.1%
tpch_q05/duckdb:vortex-file-compressed 423954283 / 357868050 / +18.5% 594822222 / 434131307 / +37.0% 🔴 0.71 / 0.82 / -13.5%
tpch_q06/duckdb:vortex-file-compressed 262616456 / 245346966 / +7.0% 284416330 / 322807333 / -11.9% 0.92 / 0.76 / +21.5%
tpch_q07/duckdb:vortex-file-compressed 411108868 / 605229088 / -32.1% 🟢 482895923 / 629833417 / -23.3% 0.85 / 0.96 / -11.4%
tpch_q08/duckdb:vortex-file-compressed 531864909 / 547520962 / -2.9% 552541654 / 634138049 / -12.9% 0.96 / 0.86 / +11.5%
tpch_q09/duckdb:vortex-file-compressed 444264358 / 463597562 / -4.2% 525521412 / 548012350 / -4.1% 0.85 / 0.85 / -0.1%
tpch_q10/duckdb:vortex-file-compressed 484334844 / 426461209 / +13.6% 550809766 / 512397347 / +7.5% 0.88 / 0.83 / +5.7%
tpch_q11/duckdb:vortex-file-compressed 138069703 / 140328054 / -1.6% 162487933 / 191635904 / -15.2% 0.85 / 0.73 / +16.0%
tpch_q12/duckdb:vortex-file-compressed 509517587 / 687041822 / -25.8% 537043630 / 691715582 / -22.4% 0.95 / 0.99 / -4.5%
tpch_q13/duckdb:vortex-file-compressed 304735651 / 349522324 / -12.8% 339808008 / 368032234 / -7.7% 0.90 / 0.95 / -5.6%
tpch_q14/duckdb:vortex-file-compressed 226304223 / 225297671 / +0.4% 275043735 / 313264107 / -12.2% 0.82 / 0.72 / +14.4%
tpch_q15/duckdb:vortex-file-compressed 179236190 / 152753074 / +17.3% 257635283 / 232454993 / +10.8% 0.70 / 0.66 / +5.9%
tpch_q16/duckdb:vortex-file-compressed 182315158 / 201803940 / -9.7% 254681126 / 242594738 / +5.0% 0.72 / 0.83 / -13.9%
tpch_q17/duckdb:vortex-file-compressed 371109317 / 402706187 / -7.8% 407775970 / 453567624 / -10.1% 0.91 / 0.89 / +2.5%
tpch_q18/duckdb:vortex-file-compressed 281097568 / 314290871 / -10.6% 310358729 / 355552149 / -12.7% 0.91 / 0.88 / +2.5%
tpch_q19/duckdb:vortex-file-compressed 332737960 / 320435115 / +3.8% 377867891 / 847610129 / -55.4% 🟢 0.88 / 0.38 / +132.9%
tpch_q20/duckdb:vortex-file-compressed 369736485 / 377669758 / -2.1% 399787498 / 511539948 / -21.8% 0.92 / 0.74 / +25.3%
tpch_q21/duckdb:vortex-file-compressed 542413712 / 670788369 / -19.1% 593221580 / 723269185 / -18.0% 0.91 / 0.93 / -1.4%
tpch_q22/duckdb:vortex-file-compressed 114297025 / 116604399 / -2.0% 134566660 / 207674229 / -35.2% 🟢 0.85 / 0.56 / +51.3%
duckdb / vortex-compact / ns (0.983x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 210659460 / 227999849 / -7.6% 223495233 / 252912949 / -11.6% 0.94 / 0.90 / +4.6%
tpch_q02/duckdb:vortex-compact 356250705 / 367707785 / -3.1% 353415817 / 381614855 / -7.4% 1.01 / 0.96 / +4.6%
tpch_q03/duckdb:vortex-compact 383258529 / 403361996 / -5.0% 417588353 / 453502764 / -7.9% 0.92 / 0.89 / +3.2%
tpch_q04/duckdb:vortex-compact 217429709 / 250220334 / -13.1% 253089522 / 303670110 / -16.7% 0.86 / 0.82 / +4.3%
tpch_q05/duckdb:vortex-compact 379562241 / 385484929 / -1.5% 437570015 / 414559308 / +5.6% 0.87 / 0.93 / -6.7%
tpch_q06/duckdb:vortex-compact 279818082 / 254916765 / +9.8% 513774365 / 310450059 / +65.5% 🔴 0.54 / 0.82 / -33.7%
tpch_q07/duckdb:vortex-compact 414696149 / 437701369 / -5.3% 404563147 / 542647503 / -25.4% 1.03 / 0.81 / +27.1%
tpch_q08/duckdb:vortex-compact 497903712 / 530465656 / -6.1% 564425527 / 636166198 / -11.3% 0.88 / 0.83 / +5.8%
tpch_q09/duckdb:vortex-compact 434984108 / 479103094 / -9.2% 447115419 / 509193400 / -12.2% 0.97 / 0.94 / +3.4%
tpch_q10/duckdb:vortex-compact 432150847 / 405948121 / +6.5% 396620705 / 457475399 / -13.3% 1.09 / 0.89 / +22.8%
tpch_q11/duckdb:vortex-compact 132962151 / 137394145 / -3.2% 157944482 / 173022105 / -8.7% 0.84 / 0.79 / +6.0%
tpch_q12/duckdb:vortex-compact 416014055 / 356469006 / +16.7% 450396946 / 459891712 / -2.1% 0.92 / 0.78 / +19.2%
tpch_q13/duckdb:vortex-compact 219981602 / 226848245 / -3.0% 351430887 / 307322442 / +14.4% 0.63 / 0.74 / -15.2%
tpch_q14/duckdb:vortex-compact 239484716 / 235931792 / +1.5% 226660915 / 476350891 / -52.4% 🟢 1.06 / 0.50 / +113.3%
tpch_q15/duckdb:vortex-compact 156370113 / 162826993 / -4.0% 212555716 / 277614589 / -23.4% 0.74 / 0.59 / +25.4%
tpch_q16/duckdb:vortex-compact 197549334 / 184142772 / +7.3% 215110178 / 242594647 / -11.3% 0.92 / 0.76 / +21.0%
tpch_q17/duckdb:vortex-compact 381098388 / 388892138 / -2.0% 398249391 / 432168174 / -7.8% 0.96 / 0.90 / +6.3%
tpch_q18/duckdb:vortex-compact 292830793 / 288416345 / +1.5% 297986976 / 380031430 / -21.6% 0.98 / 0.76 / +29.5%
tpch_q19/duckdb:vortex-compact 360101743 / 358898789 / +0.3% 384460119 / 383552969 / +0.2% 0.94 / 0.94 / +0.1%
tpch_q20/duckdb:vortex-compact 373073430 / 367204091 / +1.6% 416371569 / 424664319 / -2.0% 0.90 / 0.86 / +3.6%
tpch_q21/duckdb:vortex-compact 864754720 / 930657058 / -7.1% 656554308 / 972964528 / -32.5% 🟢 1.32 / 0.96 / +37.7%
tpch_q22/duckdb:vortex-compact 105816960 / 115428160 / -8.3% 116706173 / 159090936 / -26.6% 0.91 / 0.73 / +25.0%
duckdb / parquet / ns (0.909x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 289985551 / 303396926 / -4.4% 274856826 / 348738501 / -21.2% 1.06 / 0.87 / +21.3%
tpch_q02/duckdb:parquet 607557950 / 710757944 / -14.5% 642288275 / 697211014 / -7.9% 0.95 / 1.02 / -7.2%
tpch_q03/duckdb:parquet 741821174 / 806839785 / -8.1% 838140416 / 848453194 / -1.2% 0.89 / 0.95 / -6.9%
tpch_q04/duckdb:parquet 431255680 / 498292752 / -13.5% 553260824 / 555924013 / -0.5% 0.78 / 0.90 / -13.0%
tpch_q05/duckdb:parquet 890755258 / 968750787 / -8.1% 867211625 / 991351326 / -12.5% 1.03 / 0.98 / +5.1%
tpch_q06/duckdb:parquet 265252312 / 295333473 / -10.2% 294356193 / 327036412 / -10.0% 0.90 / 0.90 / -0.2%
tpch_q07/duckdb:parquet 796499228 / 873866916 / -8.9% 841054862 / 844058555 / -0.4% 0.95 / 1.04 / -8.5%
tpch_q08/duckdb:parquet 980207137 / 1130691036 / -13.3% 1309663834 / 1162649792 / +12.6% 0.75 / 0.97 / -23.0%
tpch_q09/duckdb:parquet 943842641 / 1052326966 / -10.3% 945441795 / 975341688 / -3.1% 1.00 / 1.08 / -7.5%
tpch_q10/duckdb:parquet 905724296 / 1008275203 / -10.2% 972942389 / 1023372905 / -4.9% 0.93 / 0.99 / -5.5%
tpch_q11/duckdb:parquet 423489758 / 444076071 / -4.6% 420852432 / 463355381 / -9.2% 1.01 / 0.96 / +5.0%
tpch_q12/duckdb:parquet 563561293 / 523242683 / +7.7% 583057492 / 584589875 / -0.3% 0.97 / 0.90 / +8.0%
tpch_q13/duckdb:parquet 752523976 / 842578700 / -10.7% 899214366 / 899766875 / -0.1% 0.84 / 0.94 / -10.6%
tpch_q14/duckdb:parquet 449937425 / 498216258 / -9.7% 468372394 / 518098441 / -9.6% 0.96 / 0.96 / -0.1%
tpch_q15/duckdb:parquet 340882489 / 407593927 / -16.4% 364203166 / 497857740 / -26.8% 0.94 / 0.82 / +14.3%
tpch_q16/duckdb:parquet 468897749 / 521950652 / -10.2% 455612303 / 624102211 / -27.0% 1.03 / 0.84 / +23.1%
tpch_q17/duckdb:parquet 438754312 / 493074466 / -11.0% 435397688 / 544167119 / -20.0% 1.01 / 0.91 / +11.2%
tpch_q18/duckdb:parquet 575854211 / 686673132 / -16.1% 578552290 / 698762514 / -17.2% 1.00 / 0.98 / +1.3%
tpch_q19/duckdb:parquet 559514812 / 554771290 / +0.9% 692182607 / 641430800 / +7.9% 0.81 / 0.86 / -6.5%
tpch_q20/duckdb:parquet 766493330 / 863994013 / -11.3% 805741070 / 839655912 / -4.0% 0.95 / 1.03 / -7.6%
tpch_q21/duckdb:parquet 706497526 / 757393962 / -6.7% 635209054 / 1003671331 / -36.7% 🟢 1.11 / 0.75 / +47.4%
tpch_q22/duckdb:parquet 394994679 / 425567994 / -7.2% 496565929 / 416578046 / +19.2% 0.80 / 1.02 / -22.1%

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.2%
Engines: DataFusion No clear signal (-4.3%, environment too noisy confidence) · DuckDB No clear signal (+20.2%, environment too noisy confidence)
Vortex (geomean): hot 1.014x ➖ · cold 0.941x ➖
Parquet (geomean): hot 0.946x ➖ · cold 0.915x ➖
Shifts: Parquet (control) -5.4% · Median polish -6.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.882x ➖, 5↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 364714915 / 590685818 / -38.3% 🟢 954731881 / 1022583756 / -6.6% 0.38 / 0.58 / -33.9%
tpch_q02/datafusion:vortex-compact 452782748 / 467683043 / -3.2% 1057965544 / 1105735975 / -4.3% 0.43 / 0.42 / +1.2%
tpch_q03/datafusion:vortex-compact 382391784 / 455367927 / -16.0% 1257201246 / 1307754497 / -3.9% 0.30 / 0.35 / -12.6%
tpch_q04/datafusion:vortex-compact 352784646 / 265822765 / +32.7% 🔴 535988926 / 626381643 / -14.4% 0.66 / 0.42 / +55.1%
tpch_q05/datafusion:vortex-compact 583459414 / 1339903820 / -56.5% 🟢 733122837 / 1648764407 / -55.5% 🟢 0.80 / 0.81 / -2.1%
tpch_q06/datafusion:vortex-compact 276297129 / 287007973 / -3.7% 391974674 / 516228370 / -24.1% 0.70 / 0.56 / +26.8%
tpch_q07/datafusion:vortex-compact 512244731 / 804322729 / -36.3% 🟢 775693337 / 1000919345 / -22.5% 0.66 / 0.80 / -17.8%
tpch_q08/datafusion:vortex-compact 761178583 / 825369641 / -7.8% 952924485 / 1054816016 / -9.7% 0.80 / 0.78 / +2.1%
tpch_q09/datafusion:vortex-compact 658139945 / 900504225 / -26.9% 1000543634 / 1492872447 / -33.0% 🟢 0.66 / 0.60 / +9.0%
tpch_q10/datafusion:vortex-compact 649459112 / 656901207 / -1.1% 998214821 / 816987042 / +22.2% 0.65 / 0.80 / -19.1%
tpch_q11/datafusion:vortex-compact 314951417 / 337936427 / -6.8% 563902303 / 582836362 / -3.2% 0.56 / 0.58 / -3.7%
tpch_q12/datafusion:vortex-compact 575216446 / 539452883 / +6.6% 878680267 / 1445489379 / -39.2% 🟢 0.65 / 0.37 / +75.4%
tpch_q13/datafusion:vortex-compact 263700022 / 282690638 / -6.7% 668827013 / 713398765 / -6.2% 0.39 / 0.40 / -0.5%
tpch_q14/datafusion:vortex-compact 394517414 / 351352568 / +12.3% 479586268 / 452568262 / +6.0% 0.82 / 0.78 / +6.0%
tpch_q15/datafusion:vortex-compact 705783808 / 533309528 / +32.3% 🔴 763548490 / 1067851388 / -28.5% 0.92 / 0.50 / +85.1%
tpch_q16/datafusion:vortex-compact 271279560 / 269951100 / +0.5% 494214085 / 491722436 / +0.5% 0.55 / 0.55 / -0.0%
tpch_q17/datafusion:vortex-compact 750036000 / 736247079 / +1.9% 909262498 / 870697634 / +4.4% 0.82 / 0.85 / -2.4%
tpch_q18/datafusion:vortex-compact 533806011 / 813101187 / -34.3% 🟢 572336160 / 1121715695 / -49.0% 🟢 0.93 / 0.72 / +28.7%
tpch_q19/datafusion:vortex-compact 493359562 / 720535547 / -31.5% 🟢 732197135 / 913373386 / -19.8% 0.67 / 0.79 / -14.6%
tpch_q20/datafusion:vortex-compact 615968752 / 855668340 / -28.0% 698394471 / 931138120 / -25.0% 0.88 / 0.92 / -4.0%
tpch_q21/datafusion:vortex-compact 943644800 / 924408478 / +2.1% 969354444 / 1017216495 / -4.7% 0.97 / 0.91 / +7.1%
tpch_q22/datafusion:vortex-compact 339583999 / 296986177 / +14.3% 608218599 / 962336641 / -36.8% 🟢 0.56 / 0.31 / +80.9%
datafusion / parquet / ns (0.922x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 269866000 / 418549709 / -35.5% 🟢 654211437 / 819735536 / -20.2% 0.41 / 0.51 / -19.2%
tpch_q02/datafusion:parquet 475728388 / 570484092 / -16.6% 1056282137 / 1049092837 / +0.7% 0.45 / 0.54 / -17.2%
tpch_q03/datafusion:parquet 644782481 / 634673139 / +1.6% 1185818763 / 1410942791 / -16.0% 0.54 / 0.45 / +20.9%
tpch_q04/datafusion:parquet 399963030 / 401654266 / -0.4% 531160240 / 570043978 / -6.8% 0.75 / 0.70 / +6.9%
tpch_q05/datafusion:parquet 684215529 / 702936307 / -2.7% 949439583 / 976563821 / -2.8% 0.72 / 0.72 / +0.1%
tpch_q06/datafusion:parquet 280683712 / 193078124 / +45.4% 🔴 400031425 / 372144113 / +7.5% 0.70 / 0.52 / +35.2%
tpch_q07/datafusion:parquet 767387770 / 845529245 / -9.2% 822001386 / 1007709393 / -18.4% 0.93 / 0.84 / +11.3%
tpch_q08/datafusion:parquet 803872646 / 888332674 / -9.5% 1068090223 / 1150545804 / -7.2% 0.75 / 0.77 / -2.5%
tpch_q09/datafusion:parquet 893594862 / 1489441626 / -40.0% 🟢 1098861333 / 1524833557 / -27.9% 0.81 / 0.98 / -16.7%
tpch_q10/datafusion:parquet 1596223331 / 1691184231 / -5.6% 2151547062 / 2413074721 / -10.8% 0.74 / 0.70 / +5.9%
tpch_q11/datafusion:parquet 375269672 / 408329337 / -8.1% 552227832 / 601365796 / -8.2% 0.68 / 0.68 / +0.1%
tpch_q12/datafusion:parquet 432809203 / 433264305 / -0.1% 599838609 / 589199893 / +1.8% 0.72 / 0.74 / -1.9%
tpch_q13/datafusion:parquet 458135473 / 620140413 / -26.1% 972679690 / 1012323155 / -3.9% 0.47 / 0.61 / -23.1%
tpch_q14/datafusion:parquet 444237107 / 421448089 / +5.4% 624498705 / 598671828 / +4.3% 0.71 / 0.70 / +1.0%
tpch_q15/datafusion:parquet 748736874 / 685417329 / +9.2% 823974896 / 954897839 / -13.7% 0.91 / 0.72 / +26.6%
tpch_q16/datafusion:parquet 247645428 / 279918605 / -11.5% 433051251 / 526791845 / -17.8% 0.57 / 0.53 / +7.6%
tpch_q17/datafusion:parquet 816445289 / 781135163 / +4.5% 939883909 / 862188156 / +9.0% 0.87 / 0.91 / -4.1%
tpch_q18/datafusion:parquet 1015666305 / 1135253700 / -10.5% 1119026887 / 1459739012 / -23.3% 0.91 / 0.78 / +16.7%
tpch_q19/datafusion:parquet 446508214 / 468379085 / -4.7% 534803102 / 601341002 / -11.1% 0.83 / 0.78 / +7.2%
tpch_q20/datafusion:parquet 819709500 / 762207816 / +7.5% 932107606 / 1027610651 / -9.3% 0.88 / 0.74 / +18.6%
tpch_q21/datafusion:parquet 912530987 / 1152568048 / -20.8% 1071517252 / 1375265033 / -22.1% 0.85 / 0.84 / +1.6%
tpch_q22/datafusion:parquet 589762814 / 665063927 / -11.3% 907982058 / 970857015 / -6.5% 0.65 / 0.69 / -5.2%
duckdb / vortex-compact / ns (1.167x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 886278287 / 777101994 / +14.0% 1201506758 / 1864533774 / -35.6% 🟢 0.74 / 0.42 / +77.0%
tpch_q02/duckdb:vortex-compact 476729147 / 546499118 / -12.8% 747807533 / 877204537 / -14.8% 0.64 / 0.62 / +2.3%
tpch_q03/duckdb:vortex-compact 1054304149 / 933674916 / +12.9% 1271257452 / 1670575218 / -23.9% 0.83 / 0.56 / +48.4%
tpch_q04/duckdb:vortex-compact 715307329 / 694655956 / +3.0% 926086396 / 889511633 / +4.1% 0.77 / 0.78 / -1.1%
tpch_q05/duckdb:vortex-compact 1459351472 / 863234208 / +69.1% 🔴 1527326976 / 1143790234 / +33.5% 🔴 0.96 / 0.75 / +26.6%
tpch_q06/duckdb:vortex-compact 1073098225 / 861800585 / +24.5% 1051971266 / 885114937 / +18.9% 1.02 / 0.97 / +4.8%
tpch_q07/duckdb:vortex-compact 1403628388 / 1170769209 / +19.9% 1721118029 / 1562939301 / +10.1% 0.82 / 0.75 / +8.9%
tpch_q08/duckdb:vortex-compact 1367071457 / 1209232645 / +13.1% 1566105316 / 1470409517 / +6.5% 0.87 / 0.82 / +6.1%
tpch_q09/duckdb:vortex-compact 1809332262 / 1607206797 / +12.6% 2247042537 / 1712668900 / +31.2% 🔴 0.81 / 0.94 / -14.2%
tpch_q10/duckdb:vortex-compact 1308465514 / 1181446569 / +10.8% 1642947530 / 1868819866 / -12.1% 0.80 / 0.63 / +26.0%
tpch_q11/duckdb:vortex-compact 446467113 / 461992713 / -3.4% 677228139 / 663118165 / +2.1% 0.66 / 0.70 / -5.4%
tpch_q12/duckdb:vortex-compact 2072882330 / 1423355768 / +45.6% 🔴 2636009884 / 1736976214 / +51.8% 🔴 0.79 / 0.82 / -4.0%
tpch_q13/duckdb:vortex-compact 1106134790 / 858690495 / +28.8% 1477166765 / 1288319582 / +14.7% 0.75 / 0.67 / +12.3%
tpch_q14/duckdb:vortex-compact 810419308 / 671345069 / +20.7% 855551210 / 751529179 / +13.8% 0.95 / 0.89 / +6.0%
tpch_q15/duckdb:vortex-compact 985120095 / 666682145 / +47.8% 🔴 1055693238 / 748263601 / +41.1% 🔴 0.93 / 0.89 / +4.7%
tpch_q16/duckdb:vortex-compact 227046751 / 263849420 / -13.9% 370849372 / 337185122 / +10.0% 0.61 / 0.78 / -21.8%
tpch_q17/duckdb:vortex-compact 1295843602 / 1102147990 / +17.6% 1304693357 / 1163208678 / +12.2% 0.99 / 0.95 / +4.8%
tpch_q18/duckdb:vortex-compact 1262790738 / 1045740067 / +20.8% 1139203927 / 1074142301 / +6.1% 1.11 / 0.97 / +13.9%
tpch_q19/duckdb:vortex-compact 1144274821 / 1144216560 / +0.0% 1743188397 / 1282251588 / +35.9% 🔴 0.66 / 0.89 / -26.4%
tpch_q20/duckdb:vortex-compact 1778700971 / 1218497839 / +46.0% 🔴 1786267287 / 1479072603 / +20.8% 1.00 / 0.82 / +20.9%
tpch_q21/duckdb:vortex-compact 2183662800 / 1988902924 / +9.8% 2473403525 / 1981687518 / +24.8% 0.88 / 1.00 / -12.0%
tpch_q22/duckdb:vortex-compact 302206413 / 265084496 / +14.0% 394660006 / 481190319 / -18.0% 0.77 / 0.55 / +39.0%
duckdb / parquet / ns (0.971x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 378951403 / 383760332 / -1.3% 567920549 / 466626202 / +21.7% 0.67 / 0.82 / -18.9%
tpch_q02/duckdb:parquet 749972684 / 793592942 / -5.5% 961560221 / 1336302124 / -28.0% 0.78 / 0.59 / +31.3%
tpch_q03/duckdb:parquet 914381425 / 947395100 / -3.5% 1104632549 / 1419382710 / -22.2% 0.83 / 0.67 / +24.0%
tpch_q04/duckdb:parquet 572705743 / 653020818 / -12.3% 725771163 / 834201894 / -13.0% 0.79 / 0.78 / +0.8%
tpch_q05/duckdb:parquet 1172738527 / 1169252609 / +0.3% 1002441001 / 1165416496 / -14.0% 1.17 / 1.00 / +16.6%
tpch_q06/duckdb:parquet 434386998 / 434721346 / -0.1% 541919472 / 533280520 / +1.6% 0.80 / 0.82 / -1.7%
tpch_q07/duckdb:parquet 1223590945 / 995091306 / +23.0% 1097208899 / 959983616 / +14.3% 1.12 / 1.04 / +7.6%
tpch_q08/duckdb:parquet 1451331658 / 1403178664 / +3.4% 1313525792 / 1556755653 / -15.6% 1.10 / 0.90 / +22.6%
tpch_q09/duckdb:parquet 1328510414 / 1269393962 / +4.7% 1394827016 / 1545574875 / -9.8% 0.95 / 0.82 / +16.0%
tpch_q10/duckdb:parquet 2249618587 / 2447638163 / -8.1% 2720987170 / 2865087443 / -5.0% 0.83 / 0.85 / -3.2%
tpch_q11/duckdb:parquet 495556701 / 496830194 / -0.3% 621798074 / 717811691 / -13.4% 0.80 / 0.69 / +15.1%
tpch_q12/duckdb:parquet 590729364 / 691450253 / -14.6% 683627416 / 1102287573 / -38.0% 🟢 0.86 / 0.63 / +37.8%
tpch_q13/duckdb:parquet 927416653 / 962342282 / -3.6% 1157916444 / 1191195583 / -2.8% 0.80 / 0.81 / -0.9%
tpch_q14/duckdb:parquet 801167601 / 735950972 / +8.9% 688164963 / 700489267 / -1.8% 1.16 / 1.05 / +10.8%
tpch_q15/duckdb:parquet 521018322 / 449503389 / +15.9% 611541291 / 561150634 / +9.0% 0.85 / 0.80 / +6.4%
tpch_q16/duckdb:parquet 614953999 / 691173837 / -11.0% 575171395 / 704202204 / -18.3% 1.07 / 0.98 / +8.9%
tpch_q17/duckdb:parquet 544988833 / 624067427 / -12.7% 726049671 / 812849461 / -10.7% 0.75 / 0.77 / -2.2%
tpch_q18/duckdb:parquet 795136719 / 890866091 / -10.7% 949438017 / 1040833080 / -8.8% 0.84 / 0.86 / -2.2%
tpch_q19/duckdb:parquet 839513097 / 925086538 / -9.3% 976122218 / 1048876607 / -6.9% 0.86 / 0.88 / -2.5%
tpch_q20/duckdb:parquet 1179893888 / 1217836942 / -3.1% 1684613392 / 1395650366 / +20.7% 0.70 / 0.87 / -19.7%
tpch_q21/duckdb:parquet 968678122 / 1040853139 / -6.9% 931787473 / 1044067949 / -10.8% 1.04 / 1.00 / +4.3%
tpch_q22/duckdb:parquet 820103776 / 896452853 / -8.5% 1159689876 / 987858760 / +17.4% 0.71 / 0.91 / -22.1%

@github-actions

ghost commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR a42e6d50 vs base 792cef74
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +53.4%
Engines: random-access No clear signal (+53.4%, environment too noisy confidence)
Vortex (geomean): hot 0.718x ✅
Parquet (geomean): hot 0.468x ✅
Shifts: Parquet (control) -53.2% · Median polish -43.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.765x ✅, 13↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 66413 / 71276 / -6.8%
random-access/arrow-tokio-local-disk-footer 158151 / 204277 / -22.6% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk 1317493 / 3033097 / -56.6% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 2074944 / 3058949 / -32.2% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk 34102071 / 68555695 / -50.3% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 33420014 / 68001933 / -50.9% 🟢
random-access/nested-lists/correlated/arrow-tokio-local-disk 56178 / 67185 / -16.4% 🟢
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 96675 / 121230 / -20.3% 🟢
random-access/nested-lists/uniform/arrow-tokio-local-disk 1075902 / 1293333 / -16.8% 🟢
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1130418 / 1380083 / -18.1% 🟢
random-access/nested-structs/correlated/arrow-tokio-local-disk 50407 / 54788 / -8.0%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 85014 / 102652 / -17.2% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk 808159 / 997279 / -19.0% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 864849 / 1026285 / -15.7% 🟢
random-access/taxi/correlated/arrow-tokio-local-disk 115830 / 124553 / -7.0%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 215136 / 270817 / -20.6% 🟢
random-access/taxi/uniform/arrow-tokio-local-disk 2576687 / 2830300 / -9.0%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2839641 / 2930271 / -3.1%
random-access / vortex-file-compressed / ns (0.718x ✅, 17↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 245814 / 324858 / -24.3% 🟢
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1223892 / 1658713 / -26.2% 🟢
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1466368 / 2583025 / -43.2% 🟢
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2761045 / 4423800 / -37.6% 🟢
random-access/nested-lists/correlated/vortex-tokio-local-disk 201702 / 299144 / -32.6% 🟢
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 363791 / 461012 / -21.1% 🟢
random-access/nested-lists/uniform/vortex-tokio-local-disk 851607 / 1644340 / -48.2% 🟢
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 1065790 / 1918670 / -44.5% 🟢
random-access/nested-structs/correlated/vortex-tokio-local-disk 266861 / 337263 / -20.9% 🟢
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 514120 / 570588 / -9.9%
random-access/nested-structs/uniform/vortex-tokio-local-disk 618415 / 977668 / -36.7% 🟢
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 969101 / 1383977 / -30.0% 🟢
random-access/taxi/correlated/vortex-tokio-local-disk 722568 / 922488 / -21.7% 🟢
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1475697 / 1727996 / -14.6% 🟢
random-access/taxi/uniform/vortex-tokio-local-disk 2719667 / 3870509 / -29.7% 🟢
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3931904 / 5293963 / -25.7% 🟢
random-access/vortex-tokio-local-disk 521822 / 605317 / -13.8% 🟢
random-access/vortex-tokio-local-disk-footer 1121736 / 1257614 / -10.8% 🟢
random-access / parquet / ns (0.468x ✅, 18↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 103627262158 / 359714381816 / -71.2% 🟢
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 103711342997 / 357249728423 / -71.0% 🟢
random-access/feature-vectors/uniform/parquet-tokio-local-disk 103607655852 / 351990005586 / -70.6% 🟢
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 104124811639 / 352116756500 / -70.4% 🟢
random-access/nested-lists/correlated/parquet-tokio-local-disk 132329015 / 242121980 / -45.3% 🟢
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131000425 / 243067361 / -46.1% 🟢
random-access/nested-lists/uniform/parquet-tokio-local-disk 130772024 / 238151078 / -45.1% 🟢
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130734920 / 247501424 / -47.2% 🟢
random-access/nested-structs/correlated/parquet-tokio-local-disk 7312116 / 19535864 / -62.6% 🟢
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 7445060 / 19373960 / -61.6% 🟢
random-access/nested-structs/uniform/parquet-tokio-local-disk 7282664 / 19017682 / -61.7% 🟢
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 7420341 / 19081862 / -61.1% 🟢
random-access/parquet-tokio-local-disk 117660306 / 177787099 / -33.8% 🟢
random-access/parquet-tokio-local-disk-footer 117951256 / 178571881 / -33.9% 🟢
random-access/taxi/correlated/parquet-tokio-local-disk 176473682 / 265363702 / -33.5% 🟢
random-access/taxi/correlated/parquet-tokio-local-disk-footer 176912430 / 266125257 / -33.5% 🟢
random-access/taxi/uniform/parquet-tokio-local-disk 187183469 / 277597393 / -32.6% 🟢
random-access/taxi/uniform/parquet-tokio-local-disk-footer 186629316 / 280104705 / -33.4% 🟢
random-access / lance / ns (0.851x ✅, 15↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 284989 / 359770 / -20.8% 🟢
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1236316 / 1512182 / -18.2% 🟢
random-access/feature-vectors/uniform/lance-tokio-local-disk 1015405 / 1098615 / -7.6%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1999907 / 2182059 / -8.3%
random-access/lance-tokio-local-disk 513121 / 614814 / -16.5% 🟢
random-access/lance-tokio-local-disk-footer 1389118 / 1680791 / -17.4% 🟢
random-access/nested-lists/correlated/lance-tokio-local-disk 151530 / 190769 / -20.6% 🟢
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 691550 / 824815 / -16.2% 🟢
random-access/nested-lists/uniform/lance-tokio-local-disk 830086 / 923059 / -10.1% 🟢
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1380091 / 1584725 / -12.9% 🟢
random-access/nested-structs/correlated/lance-tokio-local-disk 264292 / 309033 / -14.5% 🟢
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 617354 / 700837 / -11.9% 🟢
random-access/nested-structs/uniform/lance-tokio-local-disk 2209358 / 2461820 / -10.3% 🟢
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2674048 / 2835181 / -5.7%
random-access/taxi/correlated/lance-tokio-local-disk 722631 / 951602 / -24.1% 🟢
random-access/taxi/correlated/lance-tokio-local-disk-footer 1926954 / 2185155 / -11.8% 🟢
random-access/taxi/uniform/lance-tokio-local-disk 8009161 / 10082745 / -20.6% 🟢
random-access/taxi/uniform/lance-tokio-local-disk-footer 8875149 / 10956455 / -19.0% 🟢

@robert3005 robert3005 added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 3, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 3, 2026
@robert3005
robert3005 merged commit 265b705 into develop Sep 3, 2026
@robert3005
robert3005 deleted the rk/benchboxes branch September 3, 2026 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants