Skip to content

Build once, benchmark many#7289

Draft
AdamGS wants to merge 1 commit intodevelopfrom
adamg/unify-benchmark-build
Draft

Build once, benchmark many#7289
AdamGS wants to merge 1 commit intodevelopfrom
adamg/unify-benchmark-build

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Apr 4, 2026

No description provided.

@AdamGS AdamGS added action/benchmark Trigger full benchmarks to run on this PR changelog/chore A trivial change labels Apr 4, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 4, 2026
@AdamGS AdamGS force-pushed the adamg/unify-benchmark-build branch from 8eacbb6 to f4a755d Compare April 4, 2026 17:54
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9f41fc3 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 8eacbb6 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.979x ➖


datafusion / vortex-file-compressed (0.979x ➖, 1↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 130775936 130289579 1.00
polarsignals_q01/datafusion:vortex-file-compressed 391140618 398791994 0.98
polarsignals_q02/datafusion:vortex-file-compressed 25447065 25910534 0.98
polarsignals_q03/datafusion:vortex-file-compressed 394151564 403596464 0.98
polarsignals_q04/datafusion:vortex-file-compressed 11608210 11535992 1.01
polarsignals_q05/datafusion:vortex-file-compressed 17223106 15885107 1.08
polarsignals_q06/datafusion:vortex-file-compressed 19509582 20850085 0.94
polarsignals_q07/datafusion:vortex-file-compressed 🚀 13319085 15900692 0.84
polarsignals_q08/datafusion:vortex-file-compressed 470894360 517307681 0.91
polarsignals_q09/datafusion:vortex-file-compressed 11284835 10283777 1.10

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.9%
Vortex (geomean): 1.071x ➖
Parquet (geomean): 1.026x ➖
Shifts: Parquet (control) +2.6% · Median polish +5.3%


datafusion / vortex-file-compressed (1.061x ➖, 0↑ 2↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 55775901 48089435 1.16
tpch_q02/datafusion:vortex-file-compressed 36074245 33639228 1.07
tpch_q03/datafusion:vortex-file-compressed 29084223 27707108 1.05
tpch_q04/datafusion:vortex-file-compressed 19367347 18545267 1.04
tpch_q05/datafusion:vortex-file-compressed 60076032 56666577 1.06
tpch_q06/datafusion:vortex-file-compressed 10793343 10556852 1.02
tpch_q07/datafusion:vortex-file-compressed 70984860 66521859 1.07
tpch_q08/datafusion:vortex-file-compressed 51048776 48323664 1.06
tpch_q09/datafusion:vortex-file-compressed 60507725 58031498 1.04
tpch_q10/datafusion:vortex-file-compressed 47698074 46161348 1.03
tpch_q11/datafusion:vortex-file-compressed 19717316 18104294 1.09
tpch_q12/datafusion:vortex-file-compressed 25212513 23090428 1.09
tpch_q13/datafusion:vortex-file-compressed 28584263 28374331 1.01
tpch_q14/datafusion:vortex-file-compressed 17797768 16496243 1.08
tpch_q15/datafusion:vortex-file-compressed 25981837 25495531 1.02
tpch_q16/datafusion:vortex-file-compressed 26796225 25793407 1.04
tpch_q17/datafusion:vortex-file-compressed 73101474 67752462 1.08
tpch_q18/datafusion:vortex-file-compressed 87869087 82166211 1.07
tpch_q19/datafusion:vortex-file-compressed 23683698 23274432 1.02
tpch_q20/datafusion:vortex-file-compressed 🚨 35657020 32259651 1.11
tpch_q21/datafusion:vortex-file-compressed 80381192 75982831 1.06
tpch_q22/datafusion:vortex-file-compressed 17261866 15882664 1.09
datafusion / vortex-compact (1.076x ➖, 0↑ 5↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 63315807 55068604 1.15
tpch_q02/datafusion:vortex-compact 39971290 37803643 1.06
tpch_q03/datafusion:vortex-compact 🚨 36027293 31827055 1.13
tpch_q04/datafusion:vortex-compact 🚨 26467094 23449030 1.13
tpch_q05/datafusion:vortex-compact 🚨 64988068 56370229 1.15
tpch_q06/datafusion:vortex-compact 14005617 13705077 1.02
tpch_q07/datafusion:vortex-compact 77241858 70954957 1.09
tpch_q08/datafusion:vortex-compact 54531921 50015279 1.09
tpch_q09/datafusion:vortex-compact 66180317 62927543 1.05
tpch_q10/datafusion:vortex-compact 56863790 54855796 1.04
tpch_q11/datafusion:vortex-compact 21441619 20801208 1.03
tpch_q12/datafusion:vortex-compact 35581414 34843249 1.02
tpch_q13/datafusion:vortex-compact 37959560 36248335 1.05
tpch_q14/datafusion:vortex-compact 22534934 21694026 1.04
tpch_q15/datafusion:vortex-compact 🚨 39237861 34128916 1.15
tpch_q16/datafusion:vortex-compact 32644073 30339823 1.08
tpch_q17/datafusion:vortex-compact 76999224 71511042 1.08
tpch_q18/datafusion:vortex-compact 91729884 86093288 1.07
tpch_q19/datafusion:vortex-compact 35290321 32935283 1.07
tpch_q20/datafusion:vortex-compact 42295499 40038976 1.06
tpch_q21/datafusion:vortex-compact 96801234 88613345 1.09
tpch_q22/datafusion:vortex-compact 18384996 17283144 1.06
datafusion / parquet (1.028x ➖, 1↑ 4↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 123926423 136351260 0.91
tpch_q02/datafusion:parquet 71979355 72991438 0.99
tpch_q03/datafusion:parquet 82833052 84880085 0.98
tpch_q04/datafusion:parquet 51156910 48666823 1.05
tpch_q05/datafusion:parquet 108939580 107417663 1.01
tpch_q06/datafusion:parquet 🚀 36094066 44882875 0.80
tpch_q07/datafusion:parquet 121261343 116975064 1.04
tpch_q08/datafusion:parquet 109736820 107113901 1.02
tpch_q09/datafusion:parquet 149703520 138675224 1.08
tpch_q10/datafusion:parquet 🚨 131652681 119354119 1.10
tpch_q11/datafusion:parquet 50668943 49869621 1.02
tpch_q12/datafusion:parquet 98180295 96824803 1.01
tpch_q13/datafusion:parquet 230217732 211675807 1.09
tpch_q14/datafusion:parquet 48120893 51044166 0.94
tpch_q15/datafusion:parquet 77049206 71285008 1.08
tpch_q16/datafusion:parquet 55294471 52879612 1.05
tpch_q17/datafusion:parquet 🚨 174314617 135283759 1.29
tpch_q18/datafusion:parquet 🚨 188202145 169744646 1.11
tpch_q19/datafusion:parquet 86131216 92120164 0.93
tpch_q20/datafusion:parquet 83494926 81256526 1.03
tpch_q21/datafusion:parquet 🚨 162144489 147190241 1.10
tpch_q22/datafusion:parquet 38687972 36176420 1.07
datafusion / arrow (1.050x ➖, 1↑ 4↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 65211093 62036354 1.05
tpch_q02/datafusion:arrow 23495641 23142413 1.02
tpch_q03/datafusion:arrow 40393203 37901002 1.07
tpch_q04/datafusion:arrow 🚀 30909502 39330197 0.79
tpch_q05/datafusion:arrow 84600011 86338382 0.98
tpch_q06/datafusion:arrow 22588776 21961281 1.03
tpch_q07/datafusion:arrow 125244302 117713564 1.06
tpch_q08/datafusion:arrow 50655693 46104113 1.10
tpch_q09/datafusion:arrow 🚨 87470791 72849572 1.20
tpch_q10/datafusion:arrow 🚨 59717856 52410459 1.14
tpch_q11/datafusion:arrow 12062755 11857820 1.02
tpch_q12/datafusion:arrow 59122811 55395885 1.07
tpch_q13/datafusion:arrow 52059442 49838789 1.04
tpch_q14/datafusion:arrow 🚨 27498252 24097861 1.14
tpch_q15/datafusion:arrow 🚨 52252349 46656834 1.12
tpch_q16/datafusion:arrow 22345626 21271651 1.05
tpch_q17/datafusion:arrow 78260962 71888717 1.09
tpch_q18/datafusion:arrow 159849142 147324965 1.09
tpch_q19/datafusion:arrow 45608175 45457728 1.00
tpch_q20/datafusion:arrow 42362171 40355992 1.05
tpch_q21/datafusion:arrow 165333919 159333112 1.04
tpch_q22/datafusion:arrow 21417506 20522621 1.04
duckdb / vortex-file-compressed (1.097x ➖, 0↑ 10↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 34824729 33544780 1.04
tpch_q02/duckdb:vortex-file-compressed 30166765 29261504 1.03
tpch_q03/duckdb:vortex-file-compressed 🚨 32285781 27758024 1.16
tpch_q04/duckdb:vortex-file-compressed 31576320 30135446 1.05
tpch_q05/duckdb:vortex-file-compressed 36269118 33045990 1.10
tpch_q06/duckdb:vortex-file-compressed 🚨 11942964 10348278 1.15
tpch_q07/duckdb:vortex-file-compressed 🚨 42580929 36858123 1.16
tpch_q08/duckdb:vortex-file-compressed 🚨 45160374 40172321 1.12
tpch_q09/duckdb:vortex-file-compressed 87601015 80535242 1.09
tpch_q10/duckdb:vortex-file-compressed 🚨 40009595 35490791 1.13
tpch_q11/duckdb:vortex-file-compressed 17325414 16722123 1.04
tpch_q12/duckdb:vortex-file-compressed 🚨 25170301 22737587 1.11
tpch_q13/duckdb:vortex-file-compressed 41607679 38054811 1.09
tpch_q14/duckdb:vortex-file-compressed 🚨 24808222 21689272 1.14
tpch_q15/duckdb:vortex-file-compressed 17448976 16316799 1.07
tpch_q16/duckdb:vortex-file-compressed 33021565 30375746 1.09
tpch_q17/duckdb:vortex-file-compressed 27342897 25194641 1.09
tpch_q18/duckdb:vortex-file-compressed 51677871 50169404 1.03
tpch_q19/duckdb:vortex-file-compressed 🚨 37006581 31886988 1.16
tpch_q20/duckdb:vortex-file-compressed 36453134 34795195 1.05
tpch_q21/duckdb:vortex-file-compressed 🚨 119525958 103599873 1.15
tpch_q22/duckdb:vortex-file-compressed 🚨 20900995 18872079 1.11
duckdb / vortex-compact (1.052x ➖, 0↑ 3↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 41424279 40320453 1.03
tpch_q02/duckdb:vortex-compact 41061141 39192420 1.05
tpch_q03/duckdb:vortex-compact 🚨 36550191 33010833 1.11
tpch_q04/duckdb:vortex-compact 35594841 34172302 1.04
tpch_q05/duckdb:vortex-compact 40283964 38264796 1.05
tpch_q06/duckdb:vortex-compact 🚨 16454888 14246926 1.15
tpch_q07/duckdb:vortex-compact 45880648 44703219 1.03
tpch_q08/duckdb:vortex-compact 48521055 47116989 1.03
tpch_q09/duckdb:vortex-compact 🚨 102756724 91645649 1.12
tpch_q10/duckdb:vortex-compact 43513541 41093812 1.06
tpch_q11/duckdb:vortex-compact 21652847 20984012 1.03
tpch_q12/duckdb:vortex-compact 38744572 38018365 1.02
tpch_q13/duckdb:vortex-compact 48904338 47544990 1.03
tpch_q14/duckdb:vortex-compact 33719335 30995414 1.09
tpch_q15/duckdb:vortex-compact 20565173 19663430 1.05
tpch_q16/duckdb:vortex-compact 38744389 36840941 1.05
tpch_q17/duckdb:vortex-compact 33237038 31743726 1.05
tpch_q18/duckdb:vortex-compact 52178790 51757992 1.01
tpch_q19/duckdb:vortex-compact 40118824 37649436 1.07
tpch_q20/duckdb:vortex-compact 44326625 44955884 0.99
tpch_q21/duckdb:vortex-compact 122193585 113835660 1.07
tpch_q22/duckdb:vortex-compact 22131376 21235664 1.04
duckdb / parquet (1.023x ➖, 1↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79211837 86600098 0.91
tpch_q02/duckdb:parquet 41945001 39544287 1.06
tpch_q03/duckdb:parquet 72510535 69763426 1.04
tpch_q04/duckdb:parquet 55459882 56749205 0.98
tpch_q05/duckdb:parquet 67591232 66617111 1.01
tpch_q06/duckdb:parquet 20935292 20592911 1.02
tpch_q07/duckdb:parquet 83070910 76253831 1.09
tpch_q08/duckdb:parquet 85929451 84203226 1.02
tpch_q09/duckdb:parquet 🚀 145984364 162258859 0.90
tpch_q10/duckdb:parquet 129998536 134187200 0.97
tpch_q11/duckdb:parquet 23375947 23100758 1.01
tpch_q12/duckdb:parquet 47242431 44700347 1.06
tpch_q13/duckdb:parquet 287491112 270037058 1.06
tpch_q14/duckdb:parquet 51004319 47846368 1.07
tpch_q15/duckdb:parquet 24992580 24442171 1.02
tpch_q16/duckdb:parquet 56391649 56454721 1.00
tpch_q17/duckdb:parquet 55930763 57915173 0.97
tpch_q18/duckdb:parquet 128765990 121310333 1.06
tpch_q19/duckdb:parquet 🚨 86099259 69464838 1.24
tpch_q20/duckdb:parquet 64230506 64118448 1.00
tpch_q21/duckdb:parquet 193814475 186322855 1.04
tpch_q22/duckdb:parquet 53963979 52604070 1.03
duckdb / duckdb (1.055x ➖, 0↑ 6↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16787162 15923670 1.05
tpch_q02/duckdb:duckdb 🚨 14194258 12190325 1.16
tpch_q03/duckdb:duckdb 19537471 18858003 1.04
tpch_q04/duckdb:duckdb 19395550 19723789 0.98
tpch_q05/duckdb:duckdb 21248632 20111549 1.06
tpch_q06/duckdb:duckdb 5800139 5311869 1.09
tpch_q07/duckdb:duckdb 23023100 23765566 0.97
tpch_q08/duckdb:duckdb 21289161 21943687 0.97
tpch_q09/duckdb:duckdb 🚨 62419008 54112225 1.15
tpch_q10/duckdb:duckdb 🚨 49964973 44713554 1.12
tpch_q11/duckdb:duckdb 🚨 6513324 5885520 1.11
tpch_q12/duckdb:duckdb 14307687 13690188 1.05
tpch_q13/duckdb:duckdb 🚨 40378624 36519846 1.11
tpch_q14/duckdb:duckdb 18784750 17976137 1.04
tpch_q15/duckdb:duckdb 12079435 11914845 1.01
tpch_q16/duckdb:duckdb 🚨 26297686 23652393 1.11
tpch_q17/duckdb:duckdb 14607508 13678941 1.07
tpch_q18/duckdb:duckdb 39868689 38998658 1.02
tpch_q19/duckdb:duckdb 29390418 27931479 1.05
tpch_q20/duckdb:duckdb 23163303 22810510 1.02
tpch_q21/duckdb:duckdb 59101700 55926653 1.06
tpch_q22/duckdb:duckdb 25574984 25357054 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +5.1% -8.8% +15.3% +31.2% ➖ noise
1 datafusion:vortex-compact +15.0% -8.8% +26.1% +27.0% ➖ noise
1 datafusion:vortex-file-compressed +16.0% -8.8% +27.2% +29.1% ➖ noise
1 duckdb:duckdb +5.4% -8.8% +15.6% +31.7% ➖ noise
1 duckdb:vortex-compact +2.7% -8.8% +12.7% +27.1% ➖ noise
1 duckdb:vortex-file-compressed +3.8% -8.8% +13.9% +27.1% ➖ noise
2 datafusion:arrow +1.5% +2.3% -0.7% +13.7% ➖ noise
2 datafusion:vortex-compact +5.7% +2.3% +3.4% +13.7% ➖ noise
2 datafusion:vortex-file-compressed +7.2% +2.3% +4.9% +13.7% ➖ noise
2 duckdb:duckdb +16.4% +2.3% +13.8% +13.7% 🚨 regression
2 duckdb:vortex-compact +4.8% +2.3% +2.4% +13.7% ➖ noise
2 duckdb:vortex-file-compressed +3.1% +2.3% +0.8% +13.7% ➖ noise
3 datafusion:arrow +6.6% +0.7% +5.8% +23.0% ➖ noise
3 datafusion:vortex-compact +13.2% +0.7% +12.4% +13.7% ➖ noise
3 datafusion:vortex-file-compressed +5.0% +0.7% +4.2% +13.7% ➖ noise
3 duckdb:duckdb +3.6% +0.7% +2.9% +17.7% ➖ noise
3 duckdb:vortex-compact +10.7% +0.7% +9.9% +13.7% ➖ noise
3 duckdb:vortex-file-compressed +16.3% +0.7% +15.5% +15.6% ➖ noise
4 datafusion:arrow -21.4% +1.4% -22.5% +24.1% ✅ faster
4 datafusion:vortex-compact +12.9% +1.4% +11.4% +13.7% ➖ noise
4 datafusion:vortex-file-compressed +4.4% +1.4% +3.0% +13.7% ➖ noise
4 duckdb:duckdb -1.7% +1.4% -3.0% +13.7% ➖ noise
4 duckdb:vortex-compact +4.2% +1.4% +2.8% +13.7% ➖ noise
4 duckdb:vortex-file-compressed +4.8% +1.4% +3.4% +13.7% ➖ noise
5 datafusion:arrow -2.0% +1.4% -3.4% +14.3% ➖ noise
5 datafusion:vortex-compact +15.3% +1.4% +13.7% +13.7% ➖ noise
5 datafusion:vortex-file-compressed +6.0% +1.4% +4.5% +13.7% ➖ noise
5 duckdb:duckdb +5.7% +1.4% +4.2% +13.7% ➖ noise
5 duckdb:vortex-compact +5.3% +1.4% +3.8% +13.7% ➖ noise
5 duckdb:vortex-file-compressed +9.8% +1.4% +8.2% +13.7% ➖ noise
6 datafusion:arrow +2.9% -9.6% +13.8% +21.9% ➖ noise
6 datafusion:vortex-compact +2.2% -9.6% +13.0% +24.1% ➖ noise
6 datafusion:vortex-file-compressed +2.2% -9.6% +13.1% +23.6% ➖ noise
6 duckdb:duckdb +9.2% -9.6% +20.8% +27.3% ➖ noise
6 duckdb:vortex-compact +15.5% -9.6% +27.7% +24.8% 🚨 regression
6 duckdb:vortex-file-compressed +15.4% -9.6% +27.6% +25.1% 🚨 regression
7 datafusion:arrow +6.4% +6.3% +0.1% +13.7% ➖ noise
7 datafusion:vortex-compact +8.9% +6.3% +2.4% +13.7% ➖ noise
7 datafusion:vortex-file-compressed +6.7% +6.3% +0.4% +13.7% ➖ noise
7 duckdb:duckdb -3.1% +6.3% -8.8% +14.8% ➖ noise
7 duckdb:vortex-compact +2.6% +6.3% -3.4% +13.7% ➖ noise
7 duckdb:vortex-file-compressed +15.5% +6.3% +8.7% +13.7% ➖ noise
8 datafusion:arrow +9.9% +2.2% +7.5% +23.9% ➖ noise
8 datafusion:vortex-compact +9.0% +2.2% +6.6% +13.7% ➖ noise
8 datafusion:vortex-file-compressed +5.6% +2.2% +3.3% +13.7% ➖ noise
8 duckdb:duckdb -3.0% +2.2% -5.1% +17.0% ➖ noise
8 duckdb:vortex-compact +3.0% +2.2% +0.7% +13.7% ➖ noise
8 duckdb:vortex-file-compressed +12.4% +2.2% +9.9% +13.8% ➖ noise
9 datafusion:arrow +20.1% -1.4% +21.8% +16.6% 🚨 regression
9 datafusion:vortex-compact +5.2% -1.4% +6.7% +13.7% ➖ noise
9 datafusion:vortex-file-compressed +4.3% -1.4% +5.8% +13.7% ➖ noise
9 duckdb:duckdb +15.4% -1.4% +17.0% +13.7% 🚨 regression
9 duckdb:vortex-compact +12.1% -1.4% +13.8% +13.7% 🚨 regression
9 duckdb:vortex-file-compressed +8.8% -1.4% +10.4% +13.7% ➖ noise
10 datafusion:arrow +13.9% +3.4% +10.2% +13.7% ➖ noise
10 datafusion:vortex-compact +3.7% +3.4% +0.3% +13.7% ➖ noise
10 datafusion:vortex-file-compressed +3.3% +3.4% -0.0% +13.7% ➖ noise
10 duckdb:duckdb +11.7% +3.4% +8.1% +13.9% ➖ noise
10 duckdb:vortex-compact +5.9% +3.4% +2.4% +13.7% ➖ noise
10 duckdb:vortex-file-compressed +12.7% +3.4% +9.1% +13.7% ➖ noise
11 datafusion:arrow +1.7% +1.4% +0.3% +13.7% ➖ noise
11 datafusion:vortex-compact +3.1% +1.4% +1.7% +13.7% ➖ noise
11 datafusion:vortex-file-compressed +8.9% +1.4% +7.4% +13.7% ➖ noise
11 duckdb:duckdb +10.7% +1.4% +9.1% +16.0% ➖ noise
11 duckdb:vortex-compact +3.2% +1.4% +1.8% +13.7% ➖ noise
11 duckdb:vortex-file-compressed +3.6% +1.4% +2.2% +16.3% ➖ noise
12 datafusion:arrow +6.7% +3.5% +3.1% +13.7% ➖ noise
12 datafusion:vortex-compact +2.1% +3.5% -1.4% +13.7% ➖ noise
12 datafusion:vortex-file-compressed +9.2% +3.5% +5.5% +13.7% ➖ noise
12 duckdb:duckdb +4.5% +3.5% +1.0% +13.7% ➖ noise
12 duckdb:vortex-compact +1.9% +3.5% -1.6% +13.7% ➖ noise
12 duckdb:vortex-file-compressed +10.7% +3.5% +6.9% +13.7% ➖ noise
13 datafusion:arrow +4.5% +7.6% -2.9% +13.7% ➖ noise
13 datafusion:vortex-compact +4.7% +7.6% -2.7% +13.7% ➖ noise
13 datafusion:vortex-file-compressed +0.7% +7.6% -6.4% +13.7% ➖ noise
13 duckdb:duckdb +10.6% +7.6% +2.8% +21.9% ➖ noise
13 duckdb:vortex-compact +2.9% +7.6% -4.4% +13.7% ➖ noise
13 duckdb:vortex-file-compressed +9.3% +7.6% +1.6% +13.7% ➖ noise
14 datafusion:arrow +14.1% +0.2% +13.8% +13.7% 🚨 regression
14 datafusion:vortex-compact +3.9% +0.2% +3.6% +13.7% ➖ noise
14 datafusion:vortex-file-compressed +7.9% +0.2% +7.6% +13.7% ➖ noise
14 duckdb:duckdb +4.5% +0.2% +4.2% +17.8% ➖ noise
14 duckdb:vortex-compact +8.8% +0.2% +8.5% +13.7% ➖ noise
14 duckdb:vortex-file-compressed +14.4% +0.2% +14.1% +14.5% ➖ noise
15 datafusion:arrow +12.0% +5.1% +6.5% +17.6% ➖ noise
15 datafusion:vortex-compact +15.0% +5.1% +9.4% +18.6% ➖ noise
15 datafusion:vortex-file-compressed +1.9% +5.1% -3.1% +20.3% ➖ noise
15 duckdb:duckdb +1.4% +5.1% -3.6% +20.1% ➖ noise
15 duckdb:vortex-compact +4.6% +5.1% -0.5% +17.1% ➖ noise
15 duckdb:vortex-file-compressed +6.9% +5.1% +1.7% +20.0% ➖ noise
16 datafusion:arrow +5.0% +2.2% +2.8% +13.7% ➖ noise
16 datafusion:vortex-compact +7.6% +2.2% +5.3% +13.7% ➖ noise
16 datafusion:vortex-file-compressed +3.9% +2.2% +1.7% +13.7% ➖ noise
16 duckdb:duckdb +11.2% +2.2% +8.8% +13.7% ➖ noise
16 duckdb:vortex-compact +5.2% +2.2% +2.9% +13.7% ➖ noise
16 duckdb:vortex-file-compressed +8.7% +2.2% +6.4% +13.7% ➖ noise
17 datafusion:arrow +8.9% +11.6% -2.4% +14.1% ➖ noise
17 datafusion:vortex-compact +7.7% +11.6% -3.5% +19.7% ➖ noise
17 datafusion:vortex-file-compressed +7.9% +11.6% -3.3% +19.0% ➖ noise
17 duckdb:duckdb +6.8% +11.6% -4.3% +15.9% ➖ noise
17 duckdb:vortex-compact +4.7% +11.6% -6.1% +17.8% ➖ noise
17 duckdb:vortex-file-compressed +8.5% +11.6% -2.7% +20.0% ➖ noise
18 datafusion:arrow +8.5% +8.5% +0.0% +13.7% ➖ noise
18 datafusion:vortex-compact +6.5% +8.5% -1.8% +13.7% ➖ noise
18 datafusion:vortex-file-compressed +6.9% +8.5% -1.4% +13.7% ➖ noise
18 duckdb:duckdb +2.2% +8.5% -5.8% +13.7% ➖ noise
18 duckdb:vortex-compact +0.8% +8.5% -7.1% +13.7% ➖ noise
18 duckdb:vortex-file-compressed +3.0% +8.5% -5.0% +13.7% ➖ noise
19 datafusion:arrow +0.3% +7.7% -6.8% +15.7% ➖ noise
19 datafusion:vortex-compact +7.2% +7.7% -0.5% +15.8% ➖ noise
19 datafusion:vortex-file-compressed +1.8% +7.7% -5.5% +17.2% ➖ noise
19 duckdb:duckdb +5.2% +7.7% -2.3% +20.7% ➖ noise
19 duckdb:vortex-compact +6.6% +7.7% -1.0% +16.1% ➖ noise
19 duckdb:vortex-file-compressed +16.1% +7.7% +7.8% +16.5% ➖ noise
20 datafusion:arrow +5.0% +1.5% +3.5% +13.7% ➖ noise
20 datafusion:vortex-compact +5.6% +1.5% +4.1% +13.7% ➖ noise
20 datafusion:vortex-file-compressed +10.5% +1.5% +8.9% +13.7% ➖ noise
20 duckdb:duckdb +1.5% +1.5% +0.1% +13.7% ➖ noise
20 duckdb:vortex-compact -1.4% +1.5% -2.8% +15.2% ➖ noise
20 duckdb:vortex-file-compressed +4.8% +1.5% +3.3% +18.2% ➖ noise
21 datafusion:arrow +3.8% +7.0% -3.1% +13.7% ➖ noise
21 datafusion:vortex-compact +9.2% +7.0% +2.0% +13.7% ➖ noise
21 datafusion:vortex-file-compressed +5.8% +7.0% -1.2% +13.7% ➖ noise
21 duckdb:duckdb +5.7% +7.0% -1.3% +13.7% ➖ noise
21 duckdb:vortex-compact +7.3% +7.0% +0.3% +13.7% ➖ noise
21 duckdb:vortex-file-compressed +15.4% +7.0% +7.8% +13.7% ➖ noise
22 datafusion:arrow +4.4% +4.7% -0.4% +13.7% ➖ noise
22 datafusion:vortex-compact +6.4% +4.7% +1.6% +13.7% ➖ noise
22 datafusion:vortex-file-compressed +8.7% +4.7% +3.8% +13.7% ➖ noise
22 duckdb:duckdb +0.9% +4.7% -3.7% +16.1% ➖ noise
22 duckdb:vortex-compact +4.2% +4.7% -0.5% +13.7% ➖ noise
22 duckdb:vortex-file-compressed +10.8% +4.7% +5.7% +13.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.4%
Vortex (geomean): 0.913x ➖
Parquet (geomean): 0.955x ➖
Shifts: Parquet (control) -4.5% · Median polish -6.9%


datafusion / vortex-file-compressed (0.967x ➖, 1↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4448405 5513012 0.81
fineweb_q01/datafusion:vortex-file-compressed 27723834 27082394 1.02
fineweb_q02/datafusion:vortex-file-compressed 25240743 26496343 0.95
fineweb_q03/datafusion:vortex-file-compressed 74003270 77812830 0.95
fineweb_q04/datafusion:vortex-file-compressed 257842889 251763585 1.02
fineweb_q05/datafusion:vortex-file-compressed 228305099 229781346 0.99
fineweb_q06/datafusion:vortex-file-compressed 65495340 67060612 0.98
fineweb_q07/datafusion:vortex-file-compressed 67295267 71307468 0.94
fineweb_q08/datafusion:vortex-file-compressed 27209948 25932133 1.05
datafusion / vortex-compact (0.973x ➖, 1↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4889029 5127830 0.95
fineweb_q01/datafusion:vortex-compact 162868550 162700190 1.00
fineweb_q02/datafusion:vortex-compact 162540822 165003576 0.99
fineweb_q03/datafusion:vortex-compact 1465492489 1447287166 1.01
fineweb_q04/datafusion:vortex-compact 1623973340 1571190558 1.03
fineweb_q05/datafusion:vortex-compact 1264404568 1240521646 1.02
fineweb_q06/datafusion:vortex-compact 712099521 716412557 0.99
fineweb_q07/datafusion:vortex-compact 755402158 762519641 0.99
fineweb_q08/datafusion:vortex-compact 🚀 24427043 30944479 0.79
datafusion / parquet (0.999x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6271656 6296873 1.00
fineweb_q01/datafusion:parquet 270637968 272973824 0.99
fineweb_q02/datafusion:parquet 267124001 276060747 0.97
fineweb_q03/datafusion:parquet 272465684 268221888 1.02
fineweb_q04/datafusion:parquet 284567713 280432768 1.01
fineweb_q05/datafusion:parquet 284077276 278250826 1.02
fineweb_q06/datafusion:parquet 275395804 279396204 0.99
fineweb_q07/datafusion:parquet 269531967 266798743 1.01
fineweb_q08/datafusion:parquet 263653434 266843659 0.99
duckdb / vortex-file-compressed (0.856x ✅, 7↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3346638 4546282 0.74
fineweb_q01/duckdb:vortex-file-compressed 🚀 29055926 33194250 0.88
fineweb_q02/duckdb:vortex-file-compressed 🚀 28018817 33421441 0.84
fineweb_q03/duckdb:vortex-file-compressed 🚀 163108151 192262580 0.85
fineweb_q04/duckdb:vortex-file-compressed 🚀 234135232 260209071 0.90
fineweb_q05/duckdb:vortex-file-compressed 224123445 244052925 0.92
fineweb_q06/duckdb:vortex-file-compressed 🚀 70984970 82209372 0.86
fineweb_q07/duckdb:vortex-file-compressed 71770858 77627207 0.92
fineweb_q08/duckdb:vortex-file-compressed 🚀 24091945 29564763 0.81
duckdb / vortex-compact (0.864x ✅, 7↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4574633 4904535 0.93
fineweb_q01/duckdb:vortex-compact 🚀 112162758 126635006 0.89
fineweb_q02/duckdb:vortex-compact 🚀 115058567 142462342 0.81
fineweb_q03/duckdb:vortex-compact 🚀 886812612 1075927339 0.82
fineweb_q04/duckdb:vortex-compact 🚀 938637646 1114496031 0.84
fineweb_q05/duckdb:vortex-compact 🚀 851133380 995115019 0.86
fineweb_q06/duckdb:vortex-compact 🚀 483020577 565703053 0.85
fineweb_q07/duckdb:vortex-compact 🚀 491593830 598176872 0.82
fineweb_q08/duckdb:vortex-compact 24991726 25810784 0.97
duckdb / parquet (0.914x ➖, 5↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37654513 37806312 1.00
fineweb_q01/duckdb:parquet 97492913 99840579 0.98
fineweb_q02/duckdb:parquet 103393122 105580887 0.98
fineweb_q03/duckdb:parquet 319356449 323059131 0.99
fineweb_q04/duckdb:parquet 🚀 447528874 508405660 0.88
fineweb_q05/duckdb:parquet 🚀 419054180 472879811 0.89
fineweb_q06/duckdb:parquet 🚀 206217709 234287255 0.88
fineweb_q07/duckdb:parquet 🚀 217310277 245589552 0.88
fineweb_q08/duckdb:parquet 🚀 57249939 73889827 0.77
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.7% -0.4% -4.3% +38.7% ➖ noise
0 datafusion:vortex-file-compressed -19.3% -0.4% -19.0% +54.4% ➖ noise
0 duckdb:vortex-compact -6.7% -0.4% -6.4% +34.7% ➖ noise
0 duckdb:vortex-file-compressed -26.4% -0.4% -26.1% +49.2% ➖ noise
1 datafusion:vortex-compact +0.1% -1.6% +1.7% +11.3% ➖ noise
1 datafusion:vortex-file-compressed +2.4% -1.6% +4.0% +13.2% ➖ noise
1 duckdb:vortex-compact -11.4% -1.6% -10.0% +18.6% ➖ noise
1 duckdb:vortex-file-compressed -12.5% -1.6% -11.0% +37.9% ➖ noise
2 datafusion:vortex-compact -1.5% -2.7% +1.2% +11.3% ➖ noise
2 datafusion:vortex-file-compressed -4.7% -2.7% -2.1% +17.2% ➖ noise
2 duckdb:vortex-compact -19.2% -2.7% -17.0% +18.5% ✅ faster
2 duckdb:vortex-file-compressed -16.2% -2.7% -13.9% +17.4% ➖ noise
3 datafusion:vortex-compact +1.3% +0.2% +1.0% +11.3% ➖ noise
3 datafusion:vortex-file-compressed -4.9% +0.2% -5.1% +16.0% ➖ noise
3 duckdb:vortex-compact -17.6% +0.2% -17.7% +11.3% ✅ faster
3 duckdb:vortex-file-compressed -15.2% +0.2% -15.3% +28.4% ➖ noise
4 datafusion:vortex-compact +3.4% -5.5% +9.4% +11.3% ➖ noise
4 datafusion:vortex-file-compressed +2.4% -5.5% +8.4% +11.3% ➖ noise
4 duckdb:vortex-compact -15.8% -5.5% -10.9% +11.3% ✅ faster
4 duckdb:vortex-file-compressed -10.0% -5.5% -4.8% +11.3% ➖ noise
5 datafusion:vortex-compact +1.9% -4.9% +7.2% +11.3% ➖ noise
5 datafusion:vortex-file-compressed -0.6% -4.9% +4.5% +11.3% ➖ noise
5 duckdb:vortex-compact -14.5% -4.9% -10.1% +11.3% ➖ noise
5 duckdb:vortex-file-compressed -8.2% -4.9% -3.5% +11.3% ➖ noise
6 datafusion:vortex-compact -0.6% -6.9% +6.7% +11.3% ➖ noise
6 datafusion:vortex-file-compressed -2.3% -6.9% +4.9% +25.1% ➖ noise
6 duckdb:vortex-compact -14.6% -6.9% -8.3% +11.3% ➖ noise
6 duckdb:vortex-file-compressed -13.7% -6.9% -7.3% +13.5% ➖ noise
7 datafusion:vortex-compact -0.9% -5.5% +4.8% +11.3% ➖ noise
7 datafusion:vortex-file-compressed -5.6% -5.5% -0.2% +11.3% ➖ noise
7 duckdb:vortex-compact -17.8% -5.5% -13.1% +11.3% ✅ faster
7 duckdb:vortex-file-compressed -7.5% -5.5% -2.2% +11.4% ➖ noise
8 datafusion:vortex-compact -21.1% -12.5% -9.8% +26.7% ➖ noise
8 datafusion:vortex-file-compressed +4.9% -12.5% +19.9% +25.0% ➖ noise
8 duckdb:vortex-compact -3.2% -12.5% +10.7% +16.7% ➖ noise
8 duckdb:vortex-file-compressed -18.5% -12.5% -6.9% +20.3% ➖ noise

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/unify-benchmark-build branch from f4a755d to 9f41fc3 Compare April 4, 2026 18:02
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Apr 4, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 4, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 4, 2026

Merging this PR will degrade performance by 29.42%

❌ 3 regressed benchmarks
✅ 1119 untouched benchmarks
⏩ 1530 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation take_map[(0.1, 0.5)] 978.8 µs 1,209.5 µs -19.08%
Simulation take_map[(0.1, 1.0)] 1.6 ms 2.3 ms -29.42%
Simulation take_map[(0.1, 0.05)] 381.4 µs 424.2 µs -10.08%

Comparing adamg/unify-benchmark-build (9f41fc3) with develop (b2a5a70)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Vortex (geomean): 1.014x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish +1.1%


datafusion / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27617774 27628788 1.00
tpcds_q02/datafusion:vortex-file-compressed 52043928 53953422 0.96
tpcds_q03/datafusion:vortex-file-compressed 21216109 20909606 1.01
tpcds_q04/datafusion:vortex-file-compressed 293753033 290904066 1.01
tpcds_q05/datafusion:vortex-file-compressed 56590841 54606008 1.04
tpcds_q06/datafusion:vortex-file-compressed 53116526 50491908 1.05
tpcds_q07/datafusion:vortex-file-compressed 51249830 50608540 1.01
tpcds_q08/datafusion:vortex-file-compressed 37657449 37325934 1.01
tpcds_q09/datafusion:vortex-file-compressed 56541702 54675342 1.03
tpcds_q10/datafusion:vortex-file-compressed 47385310 47335078 1.00
tpcds_q11/datafusion:vortex-file-compressed 168589624 167535858 1.01
tpcds_q12/datafusion:vortex-file-compressed 22618672 23687017 0.95
tpcds_q13/datafusion:vortex-file-compressed 61194539 62262470 0.98
tpcds_q14/datafusion:vortex-file-compressed 203143288 201464874 1.01
tpcds_q15/datafusion:vortex-file-compressed 34707894 34174865 1.02
tpcds_q16/datafusion:vortex-file-compressed 29420997 29816161 0.99
tpcds_q17/datafusion:vortex-file-compressed 68248584 66726567 1.02
tpcds_q18/datafusion:vortex-file-compressed 79162786 77616054 1.02
tpcds_q19/datafusion:vortex-file-compressed 32297248 31695817 1.02
tpcds_q20/datafusion:vortex-file-compressed 25354864 25209873 1.01
tpcds_q21/datafusion:vortex-file-compressed 135029207 139747475 0.97
tpcds_q22/datafusion:vortex-file-compressed 57448525 57971208 0.99
tpcds_q23/datafusion:vortex-file-compressed 150498524 150270267 1.00
tpcds_q24/datafusion:vortex-file-compressed 115112214 112231944 1.03
tpcds_q25/datafusion:vortex-file-compressed 67936102 69209645 0.98
tpcds_q26/datafusion:vortex-file-compressed 37164083 36663991 1.01
tpcds_q27/datafusion:vortex-file-compressed 121777753 120849145 1.01
tpcds_q28/datafusion:vortex-file-compressed 48964796 49814446 0.98
tpcds_q29/datafusion:vortex-file-compressed 68271251 66910691 1.02
tpcds_q30/datafusion:vortex-file-compressed 31890577 31379126 1.02
tpcds_q31/datafusion:vortex-file-compressed 99972082 100066556 1.00
tpcds_q32/datafusion:vortex-file-compressed 22018796 21113426 1.04
tpcds_q33/datafusion:vortex-file-compressed 39567641 39132442 1.01
tpcds_q34/datafusion:vortex-file-compressed 34287964 33437117 1.03
tpcds_q35/datafusion:vortex-file-compressed 57536307 58923436 0.98
tpcds_q36/datafusion:vortex-file-compressed 75391408 75916165 0.99
tpcds_q37/datafusion:vortex-file-compressed 35537006 33946292 1.05
tpcds_q38/datafusion:vortex-file-compressed 54792376 53419059 1.03
tpcds_q39/datafusion:vortex-file-compressed 150053106 148141990 1.01
tpcds_q40/datafusion:vortex-file-compressed 53504169 52079552 1.03
tpcds_q41/datafusion:vortex-file-compressed 18669167 18028067 1.04
tpcds_q42/datafusion:vortex-file-compressed 19792161 18625101 1.06
tpcds_q43/datafusion:vortex-file-compressed 33407996 31036354 1.08
tpcds_q44/datafusion:vortex-file-compressed 47687530 45799373 1.04
tpcds_q45/datafusion:vortex-file-compressed 33657104 33627684 1.00
tpcds_q46/datafusion:vortex-file-compressed 50481282 49876742 1.01
tpcds_q47/datafusion:vortex-file-compressed 205015459 203017835 1.01
tpcds_q48/datafusion:vortex-file-compressed 48887221 48929131 1.00
tpcds_q49/datafusion:vortex-file-compressed 68822378 71263596 0.97
tpcds_q50/datafusion:vortex-file-compressed 46868768 46219912 1.01
tpcds_q51/datafusion:vortex-file-compressed 91842316 91477498 1.00
tpcds_q52/datafusion:vortex-file-compressed 19360481 20071260 0.96
tpcds_q53/datafusion:vortex-file-compressed 26567319 27574082 0.96
tpcds_q54/datafusion:vortex-file-compressed 46834996 46539730 1.01
tpcds_q55/datafusion:vortex-file-compressed 18770369 19128493 0.98
tpcds_q56/datafusion:vortex-file-compressed 41008687 40709527 1.01
tpcds_q57/datafusion:vortex-file-compressed 127793860 125598561 1.02
tpcds_q58/datafusion:vortex-file-compressed 70780846 70650630 1.00
tpcds_q59/datafusion:vortex-file-compressed 74479805 73902303 1.01
tpcds_q60/datafusion:vortex-file-compressed 43052233 42158234 1.02
tpcds_q61/datafusion:vortex-file-compressed 52309756 52368113 1.00
tpcds_q62/datafusion:vortex-file-compressed 31885387 31614631 1.01
tpcds_q63/datafusion:vortex-file-compressed 27063741 26929013 1.01
tpcds_q64/datafusion:vortex-file-compressed 475342128 468807530 1.01
tpcds_q65/datafusion:vortex-file-compressed 50618556 49023051 1.03
tpcds_q66/datafusion:vortex-file-compressed 93404151 91503604 1.02
tpcds_q67/datafusion:vortex-file-compressed 116409333 122328171 0.95
tpcds_q68/datafusion:vortex-file-compressed 49068101 48462786 1.01
tpcds_q69/datafusion:vortex-file-compressed 46435793 45427753 1.02
tpcds_q70/datafusion:vortex-file-compressed 111905557 110232027 1.02
tpcds_q71/datafusion:vortex-file-compressed 33379064 32215425 1.04
tpcds_q72/datafusion:vortex-file-compressed 2598281921 2557317446 1.02
tpcds_q73/datafusion:vortex-file-compressed 36498102 35616043 1.02
tpcds_q74/datafusion:vortex-file-compressed 117651813 115194339 1.02
tpcds_q75/datafusion:vortex-file-compressed 123013351 117250151 1.05
tpcds_q76/datafusion:vortex-file-compressed 36166462 34815141 1.04
tpcds_q77/datafusion:vortex-file-compressed 52160455 51188075 1.02
tpcds_q78/datafusion:vortex-file-compressed 126097933 123724012 1.02
tpcds_q79/datafusion:vortex-file-compressed 39732713 40179978 0.99
tpcds_q80/datafusion:vortex-file-compressed 113567810 116011279 0.98
tpcds_q81/datafusion:vortex-file-compressed 36935139 35663158 1.04
tpcds_q82/datafusion:vortex-file-compressed 35758970 35803364 1.00
tpcds_q83/datafusion:vortex-file-compressed 50712824 49102451 1.03
tpcds_q84/datafusion:vortex-file-compressed 15670658 15182012 1.03
tpcds_q85/datafusion:vortex-file-compressed 102598736 100581236 1.02
tpcds_q86/datafusion:vortex-file-compressed 19878589 18438204 1.08
tpcds_q87/datafusion:vortex-file-compressed 55157321 54597769 1.01
tpcds_q88/datafusion:vortex-file-compressed 83770715 83165213 1.01
tpcds_q89/datafusion:vortex-file-compressed 36599745 36902721 0.99
tpcds_q90/datafusion:vortex-file-compressed 18595711 18256483 1.02
tpcds_q91/datafusion:vortex-file-compressed 26346687 24715371 1.07
tpcds_q92/datafusion:vortex-file-compressed 18924627 18984718 1.00
tpcds_q93/datafusion:vortex-file-compressed 34278675 34613839 0.99
tpcds_q94/datafusion:vortex-file-compressed 24782945 26142551 0.95
tpcds_q95/datafusion:vortex-file-compressed 63283761 60826555 1.04
tpcds_q96/datafusion:vortex-file-compressed 18739049 18981720 0.99
tpcds_q97/datafusion:vortex-file-compressed 32966385 32215856 1.02
tpcds_q98/datafusion:vortex-file-compressed 33367059 32511073 1.03
tpcds_q99/datafusion:vortex-file-compressed 44529805 45393273 0.98
datafusion / vortex-compact (1.009x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 37402055 37396752 1.00
tpcds_q02/datafusion:vortex-compact 58283344 57425383 1.01
tpcds_q03/datafusion:vortex-compact 25754058 25836090 1.00
tpcds_q04/datafusion:vortex-compact 329848220 326371472 1.01
tpcds_q05/datafusion:vortex-compact 64995519 63585328 1.02
tpcds_q06/datafusion:vortex-compact 55496817 56586016 0.98
tpcds_q07/datafusion:vortex-compact 66235684 67344170 0.98
tpcds_q08/datafusion:vortex-compact 45724064 45285444 1.01
tpcds_q09/datafusion:vortex-compact 101397018 101952251 0.99
tpcds_q10/datafusion:vortex-compact 62946589 62649389 1.00
tpcds_q11/datafusion:vortex-compact 187971131 184988772 1.02
tpcds_q12/datafusion:vortex-compact 25412904 25139814 1.01
tpcds_q13/datafusion:vortex-compact 128540370 128563153 1.00
tpcds_q14/datafusion:vortex-compact 254320534 246843864 1.03
tpcds_q15/datafusion:vortex-compact 39603882 38678778 1.02
tpcds_q16/datafusion:vortex-compact 40138106 38554946 1.04
tpcds_q17/datafusion:vortex-compact 95798524 92397819 1.04
tpcds_q18/datafusion:vortex-compact 95195431 93739623 1.02
tpcds_q19/datafusion:vortex-compact 42611532 42194217 1.01
tpcds_q20/datafusion:vortex-compact 29958394 29158214 1.03
tpcds_q21/datafusion:vortex-compact 141765023 144409761 0.98
tpcds_q22/datafusion:vortex-compact 64459097 64163993 1.00
tpcds_q23/datafusion:vortex-compact 181507712 182923213 0.99
tpcds_q24/datafusion:vortex-compact 140289445 135532738 1.04
tpcds_q25/datafusion:vortex-compact 94210558 92960085 1.01
tpcds_q26/datafusion:vortex-compact 46257077 49406390 0.94
tpcds_q27/datafusion:vortex-compact 158476620 165075037 0.96
tpcds_q28/datafusion:vortex-compact 99456433 98315007 1.01
tpcds_q29/datafusion:vortex-compact 94415579 98218459 0.96
tpcds_q30/datafusion:vortex-compact 36883345 38225605 0.96
tpcds_q31/datafusion:vortex-compact 124862052 123286376 1.01
tpcds_q32/datafusion:vortex-compact 27206172 26605637 1.02
tpcds_q33/datafusion:vortex-compact 52631826 51638401 1.02
tpcds_q34/datafusion:vortex-compact 49705568 47732101 1.04
tpcds_q35/datafusion:vortex-compact 68496370 67326465 1.02
tpcds_q36/datafusion:vortex-compact 97583981 95457622 1.02
tpcds_q37/datafusion:vortex-compact 47368825 46616514 1.02
tpcds_q38/datafusion:vortex-compact 64903188 65152996 1.00
tpcds_q39/datafusion:vortex-compact 156398228 156812691 1.00
tpcds_q40/datafusion:vortex-compact 57735792 59672312 0.97
tpcds_q41/datafusion:vortex-compact 21309848 20086546 1.06
tpcds_q42/datafusion:vortex-compact 25256978 25115923 1.01
tpcds_q43/datafusion:vortex-compact 38930394 38446122 1.01
tpcds_q44/datafusion:vortex-compact 77242028 75799092 1.02
tpcds_q45/datafusion:vortex-compact 37522321 36417510 1.03
tpcds_q46/datafusion:vortex-compact 69042094 69608744 0.99
tpcds_q47/datafusion:vortex-compact 226895904 221329511 1.03
tpcds_q48/datafusion:vortex-compact 97771831 98192024 1.00
tpcds_q49/datafusion:vortex-compact 97279921 95605888 1.02
tpcds_q50/datafusion:vortex-compact 62022789 61087113 1.02
tpcds_q51/datafusion:vortex-compact 97532607 96138248 1.01
tpcds_q52/datafusion:vortex-compact 24332675 25733549 0.95
tpcds_q53/datafusion:vortex-compact 34832947 34356764 1.01
tpcds_q54/datafusion:vortex-compact 58210820 56443192 1.03
tpcds_q55/datafusion:vortex-compact 25393336 23802319 1.07
tpcds_q56/datafusion:vortex-compact 53518798 53126261 1.01
tpcds_q57/datafusion:vortex-compact 145805989 135602358 1.08
tpcds_q58/datafusion:vortex-compact 77856554 76189581 1.02
tpcds_q59/datafusion:vortex-compact 85943302 85366754 1.01
tpcds_q60/datafusion:vortex-compact 54457236 53250080 1.02
tpcds_q61/datafusion:vortex-compact 70886065 71531272 0.99
tpcds_q62/datafusion:vortex-compact 32342053 32274869 1.00
tpcds_q63/datafusion:vortex-compact 34983270 35585342 0.98
tpcds_q64/datafusion:vortex-compact 539552085 531310676 1.02
tpcds_q65/datafusion:vortex-compact 65436222 64033890 1.02
tpcds_q66/datafusion:vortex-compact 95640705 97823929 0.98
tpcds_q67/datafusion:vortex-compact 127879069 125196286 1.02
tpcds_q68/datafusion:vortex-compact 69162087 68497915 1.01
tpcds_q69/datafusion:vortex-compact 58997689 59094820 1.00
tpcds_q70/datafusion:vortex-compact 127253146 120687472 1.05
tpcds_q71/datafusion:vortex-compact 44370909 45089864 0.98
tpcds_q72/datafusion:vortex-compact 2619375074 2574920478 1.02
tpcds_q73/datafusion:vortex-compact 48115419 47513228 1.01
tpcds_q74/datafusion:vortex-compact 132537349 135562355 0.98
tpcds_q75/datafusion:vortex-compact 163995747 163266365 1.00
tpcds_q76/datafusion:vortex-compact 51976245 50929622 1.02
tpcds_q77/datafusion:vortex-compact 67328388 65892398 1.02
tpcds_q78/datafusion:vortex-compact 147691118 146058037 1.01
tpcds_q79/datafusion:vortex-compact 57523885 58524266 0.98
tpcds_q80/datafusion:vortex-compact 131390140 129306101 1.02
tpcds_q81/datafusion:vortex-compact 42534361 42412942 1.00
tpcds_q82/datafusion:vortex-compact 48874590 47727599 1.02
tpcds_q83/datafusion:vortex-compact 59471964 58887561 1.01
tpcds_q84/datafusion:vortex-compact 18634205 18472924 1.01
tpcds_q85/datafusion:vortex-compact 126838064 124037577 1.02
tpcds_q86/datafusion:vortex-compact 20470562 20071108 1.02
tpcds_q87/datafusion:vortex-compact 65706610 65080162 1.01
tpcds_q88/datafusion:vortex-compact 133792016 131539054 1.02
tpcds_q89/datafusion:vortex-compact 44420222 44282731 1.00
tpcds_q90/datafusion:vortex-compact 24357491 24331148 1.00
tpcds_q91/datafusion:vortex-compact 40941483 40474525 1.01
tpcds_q92/datafusion:vortex-compact 20610352 20386676 1.01
tpcds_q93/datafusion:vortex-compact 46867754 47141755 0.99
tpcds_q94/datafusion:vortex-compact 31954944 31338764 1.02
tpcds_q95/datafusion:vortex-compact 73943694 71195845 1.04
tpcds_q96/datafusion:vortex-compact 26086253 26415813 0.99
tpcds_q97/datafusion:vortex-compact 41714083 40777892 1.02
tpcds_q98/datafusion:vortex-compact 37656582 37857710 0.99
tpcds_q99/datafusion:vortex-compact 50479696 51373227 0.98
datafusion / parquet (0.979x ➖, 7↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37319333 36145891 1.03
tpcds_q02/datafusion:parquet 45844128 46552284 0.98
tpcds_q03/datafusion:parquet 14868594 16237484 0.92
tpcds_q04/datafusion:parquet 🚀 310338344 352062813 0.88
tpcds_q05/datafusion:parquet 56578178 53813014 1.05
tpcds_q06/datafusion:parquet 64919455 65682086 0.99
tpcds_q07/datafusion:parquet 87644175 87348956 1.00
tpcds_q08/datafusion:parquet 33937684 33491148 1.01
tpcds_q09/datafusion:parquet 57185615 57209543 1.00
tpcds_q10/datafusion:parquet 82455811 84034893 0.98
tpcds_q11/datafusion:parquet 177454765 185628963 0.96
tpcds_q12/datafusion:parquet 23958401 23831251 1.01
tpcds_q13/datafusion:parquet 87633857 88391939 0.99
tpcds_q14/datafusion:parquet 197702389 203321103 0.97
tpcds_q15/datafusion:parquet 25073397 26797444 0.94
tpcds_q16/datafusion:parquet 28449524 30323177 0.94
tpcds_q17/datafusion:parquet 68962603 73406747 0.94
tpcds_q18/datafusion:parquet 132008991 135784679 0.97
tpcds_q19/datafusion:parquet 27205036 29115485 0.93
tpcds_q20/datafusion:parquet 21398862 22299016 0.96
tpcds_q21/datafusion:parquet 22487193 23351399 0.96
tpcds_q22/datafusion:parquet 🚨 161293330 135059314 1.19
tpcds_q23/datafusion:parquet 168027941 168808097 1.00
tpcds_q24/datafusion:parquet 104791043 105730770 0.99
tpcds_q25/datafusion:parquet 72100434 71798597 1.00
tpcds_q26/datafusion:parquet 76896867 75976425 1.01
tpcds_q27/datafusion:parquet 168426474 171195983 0.98
tpcds_q28/datafusion:parquet 48785837 49800515 0.98
tpcds_q29/datafusion:parquet 72304715 73829636 0.98
tpcds_q30/datafusion:parquet 45229026 46209773 0.98
tpcds_q31/datafusion:parquet 77420504 79299275 0.98
tpcds_q32/datafusion:parquet 22562095 22716869 0.99
tpcds_q33/datafusion:parquet 35727156 37301917 0.96
tpcds_q34/datafusion:parquet 26806092 28253191 0.95
tpcds_q35/datafusion:parquet 87068536 87974684 0.99
tpcds_q36/datafusion:parquet 67729635 64813348 1.04
tpcds_q37/datafusion:parquet 24712754 24021518 1.03
tpcds_q38/datafusion:parquet 49992926 53134254 0.94
tpcds_q39/datafusion:parquet 83464910 87011345 0.96
tpcds_q40/datafusion:parquet 27169210 30092474 0.90
tpcds_q41/datafusion:parquet 16177521 17099125 0.95
tpcds_q42/datafusion:parquet 13851421 14148497 0.98
tpcds_q43/datafusion:parquet 19001513 19849844 0.96
tpcds_q44/datafusion:parquet 41900933 43395565 0.97
tpcds_q45/datafusion:parquet 32197128 34018812 0.95
tpcds_q46/datafusion:parquet 39288884 39764938 0.99
tpcds_q47/datafusion:parquet 136793612 141832653 0.96
tpcds_q48/datafusion:parquet 81056457 79360085 1.02
tpcds_q49/datafusion:parquet 65275120 69209396 0.94
tpcds_q50/datafusion:parquet 48537517 50263107 0.97
tpcds_q51/datafusion:parquet 89718460 90245137 0.99
tpcds_q52/datafusion:parquet 14346589 14904527 0.96
tpcds_q53/datafusion:parquet 22646574 21515896 1.05
tpcds_q54/datafusion:parquet 42601990 42336731 1.01
tpcds_q55/datafusion:parquet 14298537 13909464 1.03
tpcds_q56/datafusion:parquet 35344269 35297332 1.00
tpcds_q57/datafusion:parquet 🚀 106891477 119842426 0.89
tpcds_q58/datafusion:parquet 57823948 63015219 0.92
tpcds_q59/datafusion:parquet 58442202 64888786 0.90
tpcds_q60/datafusion:parquet 🚀 35414083 39565761 0.90
tpcds_q61/datafusion:parquet 51801236 55040339 0.94
tpcds_q62/datafusion:parquet 27158157 26538173 1.02
tpcds_q63/datafusion:parquet 21874746 24131277 0.91
tpcds_q64/datafusion:parquet 555943080 604851324 0.92
tpcds_q65/datafusion:parquet 🚀 43107260 49470639 0.87
tpcds_q66/datafusion:parquet 🚀 75670397 85146214 0.89
tpcds_q67/datafusion:parquet 🚀 155100669 178575056 0.87
tpcds_q68/datafusion:parquet 39676411 43796787 0.91
tpcds_q69/datafusion:parquet 81029119 88395827 0.92
tpcds_q70/datafusion:parquet 🚀 96290675 107252382 0.90
tpcds_q71/datafusion:parquet 26960736 26782365 1.01
tpcds_q72/datafusion:parquet 645246073 643693031 1.00
tpcds_q73/datafusion:parquet 26800007 28211451 0.95
tpcds_q74/datafusion:parquet 106523474 110284181 0.97
tpcds_q75/datafusion:parquet 116482423 117215370 0.99
tpcds_q76/datafusion:parquet 36494503 34701474 1.05
tpcds_q77/datafusion:parquet 49854456 49630044 1.00
tpcds_q78/datafusion:parquet 124404222 122032194 1.02
tpcds_q79/datafusion:parquet 32403593 31201018 1.04
tpcds_q80/datafusion:parquet 95004606 93309307 1.02
tpcds_q81/datafusion:parquet 42398469 40264329 1.05
tpcds_q82/datafusion:parquet 23147233 22929376 1.01
tpcds_q83/datafusion:parquet 48684814 47899342 1.02
tpcds_q84/datafusion:parquet 47158108 47133418 1.00
tpcds_q85/datafusion:parquet 172145398 169134985 1.02
tpcds_q86/datafusion:parquet 17578630 18090984 0.97
tpcds_q87/datafusion:parquet 53456621 50622482 1.06
tpcds_q88/datafusion:parquet 70757783 69069324 1.02
tpcds_q89/datafusion:parquet 25753848 25453396 1.01
tpcds_q90/datafusion:parquet 18781777 18535563 1.01
tpcds_q91/datafusion:parquet 68647295 71985577 0.95
tpcds_q92/datafusion:parquet 22413509 21843995 1.03
tpcds_q93/datafusion:parquet 35820667 33702305 1.06
tpcds_q94/datafusion:parquet 24653820 25542204 0.97
tpcds_q95/datafusion:parquet 68252280 67179177 1.02
tpcds_q96/datafusion:parquet 15091383 14706077 1.03
tpcds_q97/datafusion:parquet 34283400 33408492 1.03
tpcds_q98/datafusion:parquet 25408971 25436713 1.00
tpcds_q99/datafusion:parquet 29064840 28087048 1.03
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26547464 26636692 1.00
tpcds_q02/duckdb:vortex-file-compressed 83867113 79167070 1.06
tpcds_q03/duckdb:vortex-file-compressed 22403045 22938856 0.98
tpcds_q04/duckdb:vortex-file-compressed 111683004 102930919 1.09
tpcds_q05/duckdb:vortex-file-compressed 104438368 97609642 1.07
tpcds_q06/duckdb:vortex-file-compressed 36549612 36080658 1.01
tpcds_q07/duckdb:vortex-file-compressed 25041332 24858872 1.01
tpcds_q08/duckdb:vortex-file-compressed 23084770 23659070 0.98
tpcds_q09/duckdb:vortex-file-compressed 39408413 38334569 1.03
tpcds_q10/duckdb:vortex-file-compressed 36962331 37898604 0.98
tpcds_q11/duckdb:vortex-file-compressed 60780480 62968158 0.97
tpcds_q12/duckdb:vortex-file-compressed 14315199 14298238 1.00
tpcds_q13/duckdb:vortex-file-compressed 34363484 34975051 0.98
tpcds_q14/duckdb:vortex-file-compressed 202848157 200457959 1.01
tpcds_q15/duckdb:vortex-file-compressed 41689301 41028631 1.02
tpcds_q16/duckdb:vortex-file-compressed 31669596 31097429 1.02
tpcds_q17/duckdb:vortex-file-compressed 40121050 39738809 1.01
tpcds_q18/duckdb:vortex-file-compressed 46247403 46808135 0.99
tpcds_q19/duckdb:vortex-file-compressed 33935600 33159315 1.02
tpcds_q20/duckdb:vortex-file-compressed 14821810 15565379 0.95
tpcds_q21/duckdb:vortex-file-compressed 22130743 21506207 1.03
tpcds_q22/duckdb:vortex-file-compressed 109444724 107246523 1.02
tpcds_q23/duckdb:vortex-file-compressed 125428491 124411274 1.01
tpcds_q24/duckdb:vortex-file-compressed 55819178 55032364 1.01
tpcds_q25/duckdb:vortex-file-compressed 38000840 36994255 1.03
tpcds_q26/duckdb:vortex-file-compressed 41569725 39119482 1.06
tpcds_q27/duckdb:vortex-file-compressed 90165243 87562944 1.03
tpcds_q28/duckdb:vortex-file-compressed 36000399 35921247 1.00
tpcds_q29/duckdb:vortex-file-compressed 39716041 37949421 1.05
tpcds_q30/duckdb:vortex-file-compressed 28217944 28479001 0.99
tpcds_q31/duckdb:vortex-file-compressed 27221016 26624983 1.02
tpcds_q32/duckdb:vortex-file-compressed 17349123 16233282 1.07
tpcds_q33/duckdb:vortex-file-compressed 69927870 65822365 1.06
tpcds_q34/duckdb:vortex-file-compressed 18881145 19915931 0.95
tpcds_q35/duckdb:vortex-file-compressed 60014825 60248155 1.00
tpcds_q36/duckdb:vortex-file-compressed 29292617 27407688 1.07
tpcds_q37/duckdb:vortex-file-compressed 21666411 21812637 0.99
tpcds_q38/duckdb:vortex-file-compressed 37631470 38576294 0.98
tpcds_q39/duckdb:vortex-file-compressed 45361976 45363454 1.00
tpcds_q40/duckdb:vortex-file-compressed 23622823 23511085 1.00
tpcds_q41/duckdb:vortex-file-compressed 12611692 13084003 0.96
tpcds_q42/duckdb:vortex-file-compressed 11448032 11301545 1.01
tpcds_q43/duckdb:vortex-file-compressed 20772255 19515518 1.06
tpcds_q44/duckdb:vortex-file-compressed 22576913 21478300 1.05
tpcds_q45/duckdb:vortex-file-compressed 27240374 26482722 1.03
tpcds_q46/duckdb:vortex-file-compressed 49815485 47880056 1.04
tpcds_q47/duckdb:vortex-file-compressed 50034610 51115041 0.98
tpcds_q48/duckdb:vortex-file-compressed 32858063 31316512 1.05
tpcds_q49/duckdb:vortex-file-compressed 30433675 30072343 1.01
tpcds_q50/duckdb:vortex-file-compressed 35951719 36848727 0.98
tpcds_q51/duckdb:vortex-file-compressed 99402109 98868675 1.01
tpcds_q52/duckdb:vortex-file-compressed 11977034 12353720 0.97
tpcds_q53/duckdb:vortex-file-compressed 16788573 17370100 0.97
tpcds_q54/duckdb:vortex-file-compressed 52557028 47789867 1.10
tpcds_q55/duckdb:vortex-file-compressed 11698981 11330827 1.03
tpcds_q56/duckdb:vortex-file-compressed 70853638 67755896 1.05
tpcds_q57/duckdb:vortex-file-compressed 44434621 47189789 0.94
tpcds_q58/duckdb:vortex-file-compressed 31377377 32291256 0.97
tpcds_q59/duckdb:vortex-file-compressed 63564953 60627598 1.05
tpcds_q60/duckdb:vortex-file-compressed 71024530 67135096 1.06
tpcds_q61/duckdb:vortex-file-compressed 39255630 38896366 1.01
tpcds_q62/duckdb:vortex-file-compressed 18270036 18340979 1.00
tpcds_q63/duckdb:vortex-file-compressed 18174555 16986264 1.07
tpcds_q64/duckdb:vortex-file-compressed 83237446 78840555 1.06
tpcds_q65/duckdb:vortex-file-compressed 23332377 22497280 1.04
tpcds_q66/duckdb:vortex-file-compressed 59027424 55481619 1.06
tpcds_q67/duckdb:vortex-file-compressed 146772984 143659814 1.02
tpcds_q68/duckdb:vortex-file-compressed 41864775 41041989 1.02
tpcds_q69/duckdb:vortex-file-compressed 39071534 38794298 1.01
tpcds_q70/duckdb:vortex-file-compressed 26420754 24465905 1.08
tpcds_q71/duckdb:vortex-file-compressed 21584449 21199999 1.02
tpcds_q72/duckdb:vortex-file-compressed 180863299 177483527 1.02
tpcds_q73/duckdb:vortex-file-compressed 19998892 19604864 1.02
tpcds_q74/duckdb:vortex-file-compressed 51641531 50579954 1.02
tpcds_q75/duckdb:vortex-file-compressed 62828517 60112213 1.05
tpcds_q76/duckdb:vortex-file-compressed 🚨 78513131 65186945 1.20
tpcds_q77/duckdb:vortex-file-compressed 64902800 63022841 1.03
tpcds_q78/duckdb:vortex-file-compressed 76277587 78302214 0.97
tpcds_q79/duckdb:vortex-file-compressed 43368596 41306892 1.05
tpcds_q80/duckdb:vortex-file-compressed 94877218 89467281 1.06
tpcds_q81/duckdb:vortex-file-compressed 34884901 32778265 1.06
tpcds_q82/duckdb:vortex-file-compressed 22463401 22575255 1.00
tpcds_q83/duckdb:vortex-file-compressed 27841117 28540157 0.98
tpcds_q84/duckdb:vortex-file-compressed 17258794 16485615 1.05
tpcds_q85/duckdb:vortex-file-compressed 47326275 44984644 1.05
tpcds_q86/duckdb:vortex-file-compressed 16581016 16883416 0.98
tpcds_q87/duckdb:vortex-file-compressed 39767129 39145385 1.02
tpcds_q88/duckdb:vortex-file-compressed 35550325 34775283 1.02
tpcds_q89/duckdb:vortex-file-compressed 19136030 17750936 1.08
tpcds_q90/duckdb:vortex-file-compressed 15401486 15695088 0.98
tpcds_q91/duckdb:vortex-file-compressed 27866577 26868047 1.04
tpcds_q92/duckdb:vortex-file-compressed 14231616 13745288 1.04
tpcds_q93/duckdb:vortex-file-compressed 31379765 29686936 1.06
tpcds_q94/duckdb:vortex-file-compressed 21517935 22119093 0.97
tpcds_q95/duckdb:vortex-file-compressed 155164333 152040797 1.02
tpcds_q96/duckdb:vortex-file-compressed 11687954 11885550 0.98
tpcds_q97/duckdb:vortex-file-compressed 41462896 40680919 1.02
tpcds_q98/duckdb:vortex-file-compressed 17282611 18555631 0.93
tpcds_q99/duckdb:vortex-file-compressed 33621460 32893967 1.02
duckdb / vortex-compact (1.020x ➖, 0↑ 3↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 36797460 35765695 1.03
tpcds_q02/duckdb:vortex-compact 126461104 122023922 1.04
tpcds_q03/duckdb:vortex-compact 51742985 51252754 1.01
tpcds_q04/duckdb:vortex-compact 125742637 123321981 1.02
tpcds_q05/duckdb:vortex-compact 170041368 164981472 1.03
tpcds_q06/duckdb:vortex-compact 37556866 37232767 1.01
tpcds_q07/duckdb:vortex-compact 36659707 37111829 0.99
tpcds_q08/duckdb:vortex-compact 27863428 26884823 1.04
tpcds_q09/duckdb:vortex-compact 109738441 109640400 1.00
tpcds_q10/duckdb:vortex-compact 46437487 45329796 1.02
tpcds_q11/duckdb:vortex-compact 76695876 75180251 1.02
tpcds_q12/duckdb:vortex-compact 18955520 18088516 1.05
tpcds_q13/duckdb:vortex-compact 47289569 48448738 0.98
tpcds_q14/duckdb:vortex-compact 274410615 270620506 1.01
tpcds_q15/duckdb:vortex-compact 45333650 45601916 0.99
tpcds_q16/duckdb:vortex-compact 38375815 37129376 1.03
tpcds_q17/duckdb:vortex-compact 49984106 46994093 1.06
tpcds_q18/duckdb:vortex-compact 66955097 67124858 1.00
tpcds_q19/duckdb:vortex-compact 37030130 38552404 0.96
tpcds_q20/duckdb:vortex-compact 21314875 19717506 1.08
tpcds_q21/duckdb:vortex-compact 26814274 26709230 1.00
tpcds_q22/duckdb:vortex-compact 115309450 114780434 1.00
tpcds_q23/duckdb:vortex-compact 165222863 168411486 0.98
tpcds_q24/duckdb:vortex-compact 73579721 73286536 1.00
tpcds_q25/duckdb:vortex-compact 48019268 47033183 1.02
tpcds_q26/duckdb:vortex-compact 48896037 48934192 1.00
tpcds_q27/duckdb:vortex-compact 130485804 126197028 1.03
tpcds_q28/duckdb:vortex-compact 106885065 107226576 1.00
tpcds_q29/duckdb:vortex-compact 44993467 46145164 0.98
tpcds_q30/duckdb:vortex-compact 35288072 34373030 1.03
tpcds_q31/duckdb:vortex-compact 29817584 30195022 0.99
tpcds_q32/duckdb:vortex-compact 22902971 22826869 1.00
tpcds_q33/duckdb:vortex-compact 126819532 131588462 0.96
tpcds_q34/duckdb:vortex-compact 22643971 22203329 1.02
tpcds_q35/duckdb:vortex-compact 68308646 65616750 1.04
tpcds_q36/duckdb:vortex-compact 32566433 33209027 0.98
tpcds_q37/duckdb:vortex-compact 32472251 30309390 1.07
tpcds_q38/duckdb:vortex-compact 38222669 39880263 0.96
tpcds_q39/duckdb:vortex-compact 53632770 51882316 1.03
tpcds_q40/duckdb:vortex-compact 32429447 31197209 1.04
tpcds_q41/duckdb:vortex-compact 16297562 16295963 1.00
tpcds_q42/duckdb:vortex-compact 14660994 14580101 1.01
tpcds_q43/duckdb:vortex-compact 22639903 22440724 1.01
tpcds_q44/duckdb:vortex-compact 28433695 28769758 0.99
tpcds_q45/duckdb:vortex-compact 31446565 33648304 0.93
tpcds_q46/duckdb:vortex-compact 57059979 54657441 1.04
tpcds_q47/duckdb:vortex-compact 53762070 52545531 1.02
tpcds_q48/duckdb:vortex-compact 39416039 40494891 0.97
tpcds_q49/duckdb:vortex-compact 46382634 45410630 1.02
tpcds_q50/duckdb:vortex-compact 36669589 36525659 1.00
tpcds_q51/duckdb:vortex-compact 103137184 103658671 0.99
tpcds_q52/duckdb:vortex-compact 15104871 14921335 1.01
tpcds_q53/duckdb:vortex-compact 21731267 21276755 1.02
tpcds_q54/duckdb:vortex-compact 86179962 83837657 1.03
tpcds_q55/duckdb:vortex-compact 15252833 14203144 1.07
tpcds_q56/duckdb:vortex-compact 130316092 127747800 1.02
tpcds_q57/duckdb:vortex-compact 50762997 47402208 1.07
tpcds_q58/duckdb:vortex-compact 41560419 42492534 0.98
tpcds_q59/duckdb:vortex-compact 78319371 74864747 1.05
tpcds_q60/duckdb:vortex-compact 137933289 134580317 1.02
tpcds_q61/duckdb:vortex-compact 45106778 45482109 0.99
tpcds_q62/duckdb:vortex-compact 🚨 25585370 21204738 1.21
tpcds_q63/duckdb:vortex-compact 22614155 21955162 1.03
tpcds_q64/duckdb:vortex-compact 98803920 98051100 1.01
tpcds_q65/duckdb:vortex-compact 27835766 26436318 1.05
tpcds_q66/duckdb:vortex-compact 102780222 97364238 1.06
tpcds_q67/duckdb:vortex-compact 149860257 152125575 0.99
tpcds_q68/duckdb:vortex-compact 51288794 49337161 1.04
tpcds_q69/duckdb:vortex-compact 46204931 44856374 1.03
tpcds_q70/duckdb:vortex-compact 27749447 27079993 1.02
tpcds_q71/duckdb:vortex-compact 24848287 25331464 0.98
tpcds_q72/duckdb:vortex-compact 196408787 196013198 1.00
tpcds_q73/duckdb:vortex-compact 21885161 20428282 1.07
tpcds_q74/duckdb:vortex-compact 55446682 54278154 1.02
tpcds_q75/duckdb:vortex-compact 73433178 69724147 1.05
tpcds_q76/duckdb:vortex-compact 130466795 118720561 1.10
tpcds_q77/duckdb:vortex-compact 129811970 121375029 1.07
tpcds_q78/duckdb:vortex-compact 86456801 86122742 1.00
tpcds_q79/duckdb:vortex-compact 72050756 72653441 0.99
tpcds_q80/duckdb:vortex-compact 162100680 164822476 0.98
tpcds_q81/duckdb:vortex-compact 40433503 39230533 1.03
tpcds_q82/duckdb:vortex-compact 31465815 33135545 0.95
tpcds_q83/duckdb:vortex-compact 47111073 44895897 1.05
tpcds_q84/duckdb:vortex-compact 21857300 20780816 1.05
tpcds_q85/duckdb:vortex-compact 62626586 61969143 1.01
tpcds_q86/duckdb:vortex-compact 19343070 19073183 1.01
tpcds_q87/duckdb:vortex-compact 🚨 45542769 41321869 1.10
tpcds_q88/duckdb:vortex-compact 35424056 33619779 1.05
tpcds_q89/duckdb:vortex-compact 21692353 21540297 1.01
tpcds_q90/duckdb:vortex-compact 16607504 15507855 1.07
tpcds_q91/duckdb:vortex-compact 44431894 45447981 0.98
tpcds_q92/duckdb:vortex-compact 21106838 22587837 0.93
tpcds_q93/duckdb:vortex-compact 37588967 35844212 1.05
tpcds_q94/duckdb:vortex-compact 28404215 26927245 1.05
tpcds_q95/duckdb:vortex-compact 156346826 162126177 0.96
tpcds_q96/duckdb:vortex-compact 12063540 11176449 1.08
tpcds_q97/duckdb:vortex-compact 40890333 40281807 1.02
tpcds_q98/duckdb:vortex-compact 🚨 26056967 22758863 1.14
tpcds_q99/duckdb:vortex-compact 37988921 38101167 1.00
duckdb / parquet (1.006x ➖, 1↑ 2↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 42923639 44821942 0.96
tpcds_q02/duckdb:parquet 62554869 60729977 1.03
tpcds_q03/duckdb:parquet 12335802 12042850 1.02
tpcds_q04/duckdb:parquet 125278943 121813593 1.03
tpcds_q05/duckdb:parquet 70079951 72311833 0.97
tpcds_q06/duckdb:parquet 29035868 28740372 1.01
tpcds_q07/duckdb:parquet 23324034 23180935 1.01
tpcds_q08/duckdb:parquet 28772510 28142469 1.02
tpcds_q09/duckdb:parquet 40049569 39714409 1.01
tpcds_q10/duckdb:parquet 35507541 34395513 1.03
tpcds_q11/duckdb:parquet 86338878 88155235 0.98
tpcds_q12/duckdb:parquet 14688689 15102080 0.97
tpcds_q13/duckdb:parquet 34902714 34540072 1.01
tpcds_q14/duckdb:parquet 161606659 158748100 1.02
tpcds_q15/duckdb:parquet 29550809 29857275 0.99
tpcds_q16/duckdb:parquet 22979772 22693236 1.01
tpcds_q17/duckdb:parquet 38692054 40486434 0.96
tpcds_q18/duckdb:parquet 45639801 46778909 0.98
tpcds_q19/duckdb:parquet 28519324 28572416 1.00
tpcds_q20/duckdb:parquet 15639249 16085797 0.97
tpcds_q21/duckdb:parquet 11330212 12341550 0.92
tpcds_q22/duckdb:parquet 68906841 65869577 1.05
tpcds_q23/duckdb:parquet 111036436 116209861 0.96
tpcds_q24/duckdb:parquet 46325475 44609330 1.04
tpcds_q25/duckdb:parquet 32768347 32354500 1.01
tpcds_q26/duckdb:parquet 35232813 36085726 0.98
tpcds_q27/duckdb:parquet 88217056 87835949 1.00
tpcds_q28/duckdb:parquet 36975165 37236859 0.99
tpcds_q29/duckdb:parquet 36040118 35358913 1.02
tpcds_q30/duckdb:parquet 41068505 39759787 1.03
tpcds_q31/duckdb:parquet 22973826 23866229 0.96
tpcds_q32/duckdb:parquet 11673139 10728036 1.09
tpcds_q33/duckdb:parquet 71879077 68444594 1.05
tpcds_q34/duckdb:parquet 21223149 20400452 1.04
tpcds_q35/duckdb:parquet 58142551 54874749 1.06
tpcds_q36/duckdb:parquet 20452619 20207641 1.01
tpcds_q37/duckdb:parquet 12831175 13358331 0.96
tpcds_q38/duckdb:parquet 32135301 32698807 0.98
tpcds_q39/duckdb:parquet 32285682 30803629 1.05
tpcds_q40/duckdb:parquet 17186634 17811619 0.96
tpcds_q41/duckdb:parquet 7312864 7675628 0.95
tpcds_q42/duckdb:parquet 9743268 10493096 0.93
tpcds_q43/duckdb:parquet 15801723 15702640 1.01
tpcds_q44/duckdb:parquet 21654912 21837001 0.99
tpcds_q45/duckdb:parquet 27155841 26102200 1.04
tpcds_q46/duckdb:parquet 45647552 45525920 1.00
tpcds_q47/duckdb:parquet 46253946 44680101 1.04
tpcds_q48/duckdb:parquet 30379143 30750853 0.99
tpcds_q49/duckdb:parquet 24146305 24015478 1.01
tpcds_q50/duckdb:parquet 24535376 24839040 0.99
tpcds_q51/duckdb:parquet 🚀 96591335 119729841 0.81
tpcds_q52/duckdb:parquet 10698211 10699278 1.00
tpcds_q53/duckdb:parquet 15956939 15973587 1.00
tpcds_q54/duckdb:parquet 40312424 37124219 1.09
tpcds_q55/duckdb:parquet 10773000 10935892 0.99
tpcds_q56/duckdb:parquet 66489594 66517408 1.00
tpcds_q57/duckdb:parquet 35931351 35050306 1.03
tpcds_q58/duckdb:parquet 22835929 21144535 1.08
tpcds_q59/duckdb:parquet 35396154 36096382 0.98
tpcds_q60/duckdb:parquet 67935245 72602623 0.94
tpcds_q61/duckdb:parquet 30532556 30734100 0.99
tpcds_q62/duckdb:parquet 12156650 11488956 1.06
tpcds_q63/duckdb:parquet 15734618 14708641 1.07
tpcds_q64/duckdb:parquet 73312556 73713271 0.99
tpcds_q65/duckdb:parquet 🚨 21993408 19975604 1.10
tpcds_q66/duckdb:parquet 59779980 56565966 1.06
tpcds_q67/duckdb:parquet 133269186 135124685 0.99
tpcds_q68/duckdb:parquet 37312242 37449695 1.00
tpcds_q69/duckdb:parquet 37244759 36346040 1.02
tpcds_q70/duckdb:parquet 20791821 19991739 1.04
tpcds_q71/duckdb:parquet 19399597 18149686 1.07
tpcds_q72/duckdb:parquet 164904391 162265173 1.02
tpcds_q73/duckdb:parquet 19613069 18055173 1.09
tpcds_q74/duckdb:parquet 48677870 51900662 0.94
tpcds_q75/duckdb:parquet 53739699 53315000 1.01
tpcds_q76/duckdb:parquet 70503219 66606886 1.06
tpcds_q77/duckdb:parquet 60660990 59689108 1.02
tpcds_q78/duckdb:parquet 74390615 75355941 0.99
tpcds_q79/duckdb:parquet 26901358 27091256 0.99
tpcds_q80/duckdb:parquet 85165200 82050955 1.04
tpcds_q81/duckdb:parquet 47856867 47234366 1.01
tpcds_q82/duckdb:parquet 15062001 15208651 0.99
tpcds_q83/duckdb:parquet 16576661 16477851 1.01
tpcds_q84/duckdb:parquet 19605242 19635182 1.00
tpcds_q85/duckdb:parquet 39866084 39613813 1.01
tpcds_q86/duckdb:parquet 12273513 12914508 0.95
tpcds_q87/duckdb:parquet 37113781 37002231 1.00
tpcds_q88/duckdb:parquet 28767300 28437468 1.01
tpcds_q89/duckdb:parquet 17450683 17394070 1.00
tpcds_q90/duckdb:parquet 7983083 8201825 0.97
tpcds_q91/duckdb:parquet 23841918 23810491 1.00
tpcds_q92/duckdb:parquet 11143276 11582790 0.96
tpcds_q93/duckdb:parquet 30040467 29271600 1.03
tpcds_q94/duckdb:parquet 16410291 17447375 0.94
tpcds_q95/duckdb:parquet 🚨 142501295 128456617 1.11
tpcds_q96/duckdb:parquet 9347900 9077522 1.03
tpcds_q97/duckdb:parquet 36515540 33781291 1.08
tpcds_q98/duckdb:parquet 17925098 18174353 0.99
tpcds_q99/duckdb:parquet 20423516 19386011 1.05
duckdb / duckdb (1.039x ➖, 1↑ 11↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20686115 19582395 1.06
tpcds_q02/duckdb:duckdb 19332514 18135147 1.07
tpcds_q03/duckdb:duckdb 8411058 8041778 1.05
tpcds_q04/duckdb:duckdb 165634442 157057408 1.05
tpcds_q05/duckdb:duckdb 19272028 19480665 0.99
tpcds_q06/duckdb:duckdb 22872601 22898821 1.00
tpcds_q07/duckdb:duckdb 39394721 38286680 1.03
tpcds_q08/duckdb:duckdb 120334975 120235567 1.00
tpcds_q09/duckdb:duckdb 19943455 19616902 1.02
tpcds_q10/duckdb:duckdb 23909024 23400584 1.02
tpcds_q11/duckdb:duckdb 143940750 135160939 1.06
tpcds_q12/duckdb:duckdb 11615777 11117572 1.04
tpcds_q13/duckdb:duckdb 24559318 23078665 1.06
tpcds_q14/duckdb:duckdb 94401181 91642359 1.03
tpcds_q15/duckdb:duckdb 24911667 24172234 1.03
tpcds_q16/duckdb:duckdb 16322314 17139232 0.95
tpcds_q17/duckdb:duckdb 21331739 20594107 1.04
tpcds_q18/duckdb:duckdb 44823994 42442666 1.06
tpcds_q19/duckdb:duckdb 17062849 16540293 1.03
tpcds_q20/duckdb:duckdb 11964321 11600033 1.03
tpcds_q21/duckdb:duckdb 6640703 6495636 1.02
tpcds_q22/duckdb:duckdb 61763862 58508189 1.06
tpcds_q23/duckdb:duckdb 🚨 83354664 74106786 1.12
tpcds_q24/duckdb:duckdb 🚨 25304207 22686297 1.12
tpcds_q25/duckdb:duckdb 16896683 16792488 1.01
tpcds_q26/duckdb:duckdb 26949756 25129852 1.07
tpcds_q27/duckdb:duckdb 42177144 38707363 1.09
tpcds_q28/duckdb:duckdb 21441107 20960766 1.02
tpcds_q29/duckdb:duckdb 19490772 19486935 1.00
tpcds_q30/duckdb:duckdb 🚨 29522067 25790362 1.14
tpcds_q31/duckdb:duckdb 20184770 20036551 1.01
tpcds_q32/duckdb:duckdb 7285464 6993552 1.04
tpcds_q33/duckdb:duckdb 12606798 13169520 0.96
tpcds_q34/duckdb:duckdb 14689255 14265332 1.03
tpcds_q35/duckdb:duckdb 34136053 33633231 1.01
tpcds_q36/duckdb:duckdb 🚨 77278843 66705062 1.16
tpcds_q37/duckdb:duckdb 🚨 8002064 7234786 1.11
tpcds_q38/duckdb:duckdb 30730243 30467360 1.01
tpcds_q39/duckdb:duckdb 26010260 25758109 1.01
tpcds_q40/duckdb:duckdb 13372191 13436385 1.00
tpcds_q41/duckdb:duckdb 8322223 8321084 1.00
tpcds_q42/duckdb:duckdb 6457026 6249719 1.03
tpcds_q43/duckdb:duckdb 🚨 12183606 10889769 1.12
tpcds_q44/duckdb:duckdb 13459845 13196639 1.02
tpcds_q45/duckdb:duckdb 17245621 16683585 1.03
tpcds_q46/duckdb:duckdb 37274272 35109438 1.06
tpcds_q47/duckdb:duckdb 40623781 40923119 0.99
tpcds_q48/duckdb:duckdb 🚨 23493326 21075794 1.11
tpcds_q49/duckdb:duckdb 15720219 16400362 0.96
tpcds_q50/duckdb:duckdb 14037705 13370357 1.05
tpcds_q51/duckdb:duckdb 96156152 89076026 1.08
tpcds_q52/duckdb:duckdb 7573467 7012418 1.08
tpcds_q53/duckdb:duckdb 11923491 11413408 1.04
tpcds_q54/duckdb:duckdb 16910918 16223199 1.04
tpcds_q55/duckdb:duckdb 6937702 6682844 1.04
tpcds_q56/duckdb:duckdb 13448621 13697185 0.98
tpcds_q57/duckdb:duckdb 32454968 30944790 1.05
tpcds_q58/duckdb:duckdb 12813637 12491537 1.03
tpcds_q59/duckdb:duckdb 34515259 33943065 1.02
tpcds_q60/duckdb:duckdb 14581774 14642358 1.00
tpcds_q61/duckdb:duckdb 14404936 13967004 1.03
tpcds_q62/duckdb:duckdb 9142681 8987961 1.02
tpcds_q63/duckdb:duckdb 11359307 10927152 1.04
tpcds_q64/duckdb:duckdb 54184028 53062219 1.02
tpcds_q65/duckdb:duckdb 36629213 34011678 1.08
tpcds_q66/duckdb:duckdb 🚨 27405757 24618601 1.11
tpcds_q67/duckdb:duckdb 133293667 127044617 1.05
tpcds_q68/duckdb:duckdb 25062486 24357387 1.03
tpcds_q69/duckdb:duckdb 23705571 24090082 0.98
tpcds_q70/duckdb:duckdb 14346460 14165620 1.01
tpcds_q71/duckdb:duckdb 13192969 12489437 1.06
tpcds_q72/duckdb:duckdb 42292093 42901005 0.99
tpcds_q73/duckdb:duckdb 11246871 10273128 1.09
tpcds_q74/duckdb:duckdb 101046962 95186224 1.06
tpcds_q75/duckdb:duckdb 42801318 40381875 1.06
tpcds_q76/duckdb:duckdb 12577703 11885751 1.06
tpcds_q77/duckdb:duckdb 11882835 11679049 1.02
tpcds_q78/duckdb:duckdb 61810532 60739636 1.02
tpcds_q79/duckdb:duckdb 18106769 17687928 1.02
tpcds_q80/duckdb:duckdb 28534161 26964773 1.06
tpcds_q81/duckdb:duckdb 38640435 36990950 1.04
tpcds_q82/duckdb:duckdb 8547571 8190764 1.04
tpcds_q83/duckdb:duckdb 9017031 8811203 1.02
tpcds_q84/duckdb:duckdb 14062795 13260569 1.06
tpcds_q85/duckdb:duckdb 🚨 25449486 22472716 1.13
tpcds_q86/duckdb:duckdb 🚨 11237194 9912978 1.13
tpcds_q87/duckdb:duckdb 35358173 33563359 1.05
tpcds_q88/duckdb:duckdb 24696947 23739977 1.04
tpcds_q89/duckdb:duckdb 13821335 13072540 1.06
tpcds_q90/duckdb:duckdb 5696549 5662765 1.01
tpcds_q91/duckdb:duckdb 12934244 12139551 1.07
tpcds_q92/duckdb:duckdb 🚨 9512173 8470358 1.12
tpcds_q93/duckdb:duckdb 23437682 22045813 1.06
tpcds_q94/duckdb:duckdb 12674836 12038300 1.05
tpcds_q95/duckdb:duckdb 🚀 110094997 125459120 0.88
tpcds_q96/duckdb:duckdb 4616772 4496013 1.03
tpcds_q97/duckdb:duckdb 29316861 29671433 0.99
tpcds_q98/duckdb:duckdb 13932713 13135692 1.06
tpcds_q99/duckdb:duckdb 16085405 16477240 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.0% -0.6% +0.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -0.0% -0.6% +0.5% +10.0% ➖ noise
1 duckdb:duckdb +5.6% -0.6% +6.2% +11.7% ➖ noise
1 duckdb:vortex-compact +2.9% -0.6% +3.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.3% -0.6% +0.2% +10.6% ➖ noise
2 datafusion:vortex-compact +1.5% +0.7% +0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -3.5% +0.7% -4.2% +10.0% ➖ noise
2 duckdb:duckdb +6.6% +0.7% +5.8% +10.0% ➖ noise
2 duckdb:vortex-compact +3.6% +0.7% +2.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +5.9% +0.7% +5.2% +10.0% ➖ noise
3 datafusion:vortex-compact -0.3% -3.2% +2.9% +10.2% ➖ noise
3 datafusion:vortex-file-compressed +1.5% -3.2% +4.8% +10.3% ➖ noise
3 duckdb:duckdb +4.6% -3.2% +8.0% +14.8% ➖ noise
3 duckdb:vortex-compact +1.0% -3.2% +4.2% +15.0% ➖ noise
3 duckdb:vortex-file-compressed -2.3% -3.2% +0.8% +18.3% ➖ noise
4 datafusion:vortex-compact +1.1% -4.8% +6.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.0% -4.8% +6.1% +10.0% ➖ noise
4 duckdb:duckdb +5.5% -4.8% +10.8% +10.0% 🚨 regression
4 duckdb:vortex-compact +2.0% -4.8% +7.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +8.5% -4.8% +14.0% +10.8% 🚨 regression
5 datafusion:vortex-compact +2.2% +0.9% +1.3% +11.8% ➖ noise
5 datafusion:vortex-file-compressed +3.6% +0.9% +2.7% +11.6% ➖ noise
5 duckdb:duckdb -1.1% +0.9% -2.0% +17.7% ➖ noise
5 duckdb:vortex-compact +3.1% +0.9% +2.1% +14.4% ➖ noise
5 duckdb:vortex-file-compressed +7.0% +0.9% +6.0% +12.6% ➖ noise
6 datafusion:vortex-compact -1.9% -0.1% -1.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.2% -0.1% +5.3% +10.0% ➖ noise
6 duckdb:duckdb -0.1% -0.1% -0.0% +12.7% ➖ noise
6 duckdb:vortex-compact +0.9% -0.1% +0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.3% -0.1% +1.4% +15.6% ➖ noise
7 datafusion:vortex-compact -1.6% +0.5% -2.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.3% +0.5% +0.8% +10.0% ➖ noise
7 duckdb:duckdb +2.9% +0.5% +2.4% +17.3% ➖ noise
7 duckdb:vortex-compact -1.2% +0.5% -1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.7% +0.5% +0.3% +21.7% ➖ noise
8 datafusion:vortex-compact +1.0% +1.8% -0.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.9% +1.8% -0.9% +10.0% ➖ noise
8 duckdb:duckdb +0.1% +1.8% -1.7% +10.0% ➖ noise
8 duckdb:vortex-compact +3.6% +1.8% +1.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.4% +1.8% -4.1% +10.3% ➖ noise
9 datafusion:vortex-compact -0.5% +0.4% -0.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.4% +0.4% +3.0% +10.0% ➖ noise
9 duckdb:duckdb +1.7% +0.4% +1.3% +10.0% ➖ noise
9 duckdb:vortex-compact +0.1% +0.4% -0.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.8% +0.4% +2.4% +10.0% ➖ noise
10 datafusion:vortex-compact +0.5% +0.6% -0.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.1% +0.6% -0.5% +10.0% ➖ noise
10 duckdb:duckdb +2.2% +0.6% +1.5% +10.0% ➖ noise
10 duckdb:vortex-compact +2.4% +0.6% +1.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.5% +0.6% -3.1% +10.0% ➖ noise
11 datafusion:vortex-compact +1.6% -3.2% +5.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.6% -3.2% +4.0% +10.0% ➖ noise
11 duckdb:duckdb +6.5% -3.2% +10.1% +10.0% 🚨 regression
11 duckdb:vortex-compact +2.0% -3.2% +5.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.5% -3.2% -0.2% +11.0% ➖ noise
12 datafusion:vortex-compact +1.1% -1.1% +2.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.5% -1.1% -3.4% +10.2% ➖ noise
12 duckdb:duckdb +4.5% -1.1% +5.7% +11.2% ➖ noise
12 duckdb:vortex-compact +4.8% -1.1% +6.0% +11.4% ➖ noise
12 duckdb:vortex-file-compressed +0.1% -1.1% +1.2% +10.0% ➖ noise
13 datafusion:vortex-compact -0.0% +0.1% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.7% +0.1% -1.8% +10.0% ➖ noise
13 duckdb:duckdb +6.4% +0.1% +6.3% +10.0% ➖ noise
13 duckdb:vortex-compact -2.4% +0.1% -2.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.7% +0.1% -1.8% +10.4% ➖ noise
14 datafusion:vortex-compact +3.0% -0.5% +3.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.8% -0.5% +1.3% +10.0% ➖ noise
14 duckdb:duckdb +3.0% -0.5% +3.5% +10.0% ➖ noise
14 duckdb:vortex-compact +1.4% -0.5% +1.9% +10.4% ➖ noise
14 duckdb:vortex-file-compressed +1.2% -0.5% +1.7% +10.2% ➖ noise
15 datafusion:vortex-compact +2.4% -3.8% +6.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.6% -3.8% +5.5% +10.0% ➖ noise
15 duckdb:duckdb +3.1% -3.8% +7.1% +10.0% ➖ noise
15 duckdb:vortex-compact -0.6% -3.8% +3.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.6% -3.8% +5.6% +10.0% ➖ noise
16 datafusion:vortex-compact +4.1% -2.5% +6.8% +10.8% ➖ noise
16 datafusion:vortex-file-compressed -1.3% -2.5% +1.2% +10.0% ➖ noise
16 duckdb:duckdb -4.8% -2.5% -2.3% +15.0% ➖ noise
16 duckdb:vortex-compact +3.4% -2.5% +6.0% +11.3% ➖ noise
16 duckdb:vortex-file-compressed +1.8% -2.5% +4.5% +13.3% ➖ noise
17 datafusion:vortex-compact +3.7% -5.2% +9.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.3% -5.2% +7.9% +10.0% ➖ noise
17 duckdb:duckdb +3.6% -5.2% +9.3% +10.0% ➖ noise
17 duckdb:vortex-compact +6.4% -5.2% +12.3% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +1.0% -5.2% +6.6% +10.0% ➖ noise
18 datafusion:vortex-compact +1.6% -2.6% +4.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.0% -2.6% +4.7% +10.0% ➖ noise
18 duckdb:duckdb +5.6% -2.6% +8.4% +10.0% ➖ noise
18 duckdb:vortex-compact -0.3% -2.6% +2.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -2.6% +1.4% +10.0% ➖ noise
19 datafusion:vortex-compact +1.0% -3.4% +4.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.9% -3.4% +5.5% +11.1% ➖ noise
19 duckdb:duckdb +3.2% -3.4% +6.8% +12.2% ➖ noise
19 duckdb:vortex-compact -3.9% -3.4% -0.5% +10.8% ➖ noise
19 duckdb:vortex-file-compressed +2.3% -3.4% +6.0% +11.7% ➖ noise
20 datafusion:vortex-compact +2.7% -3.4% +6.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.6% -3.4% +4.1% +10.0% ➖ noise
20 duckdb:duckdb +3.1% -3.4% +6.8% +11.4% ➖ noise
20 duckdb:vortex-compact +8.1% -3.4% +11.9% +14.0% ➖ noise
20 duckdb:vortex-file-compressed -4.8% -3.4% -1.4% +13.7% ➖ noise
21 datafusion:vortex-compact -1.8% -6.0% +4.4% +11.8% ➖ noise
21 datafusion:vortex-file-compressed -3.4% -6.0% +2.8% +12.0% ➖ noise
21 duckdb:duckdb +2.2% -6.0% +8.7% +16.3% ➖ noise
21 duckdb:vortex-compact +0.4% -6.0% +6.8% +13.7% ➖ noise
21 duckdb:vortex-file-compressed +2.9% -6.0% +9.4% +17.8% ➖ noise
22 datafusion:vortex-compact +0.5% +11.8% -10.1% +12.7% ➖ noise
22 datafusion:vortex-file-compressed -0.9% +11.8% -11.3% +10.4% ✅ faster
22 duckdb:duckdb +5.6% +11.8% -5.6% +13.5% ➖ noise
22 duckdb:vortex-compact +0.5% +11.8% -10.1% +11.3% ➖ noise
22 duckdb:vortex-file-compressed +2.0% +11.8% -8.7% +10.9% ➖ noise
23 datafusion:vortex-compact -0.8% -2.5% +1.7% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +0.2% -2.5% +2.7% +10.0% ➖ noise
23 duckdb:duckdb +12.5% -2.5% +15.3% +16.1% ➖ noise
23 duckdb:vortex-compact -1.9% -2.5% +0.6% +10.2% ➖ noise
23 duckdb:vortex-file-compressed +0.8% -2.5% +3.4% +10.0% ➖ noise
24 datafusion:vortex-compact +3.5% +1.5% +2.0% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +2.6% +1.5% +1.1% +10.0% ➖ noise
24 duckdb:duckdb +11.5% +1.5% +9.9% +19.4% ➖ noise
24 duckdb:vortex-compact +0.4% +1.5% -1.0% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.4% +1.5% -0.0% +10.5% ➖ noise
25 datafusion:vortex-compact +1.3% +0.8% +0.5% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -1.8% +0.8% -2.7% +10.0% ➖ noise
25 duckdb:duckdb +0.6% +0.8% -0.2% +10.0% ➖ noise
25 duckdb:vortex-compact +2.1% +0.8% +1.2% +11.0% ➖ noise
25 duckdb:vortex-file-compressed +2.7% +0.8% +1.9% +10.0% ➖ noise
26 datafusion:vortex-compact -6.4% -0.6% -5.8% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +1.4% -0.6% +2.0% +10.0% ➖ noise
26 duckdb:duckdb +7.2% -0.6% +7.9% +12.9% ➖ noise
26 duckdb:vortex-compact -0.1% -0.6% +0.5% +15.3% ➖ noise
26 duckdb:vortex-file-compressed +6.3% -0.6% +6.9% +13.7% ➖ noise
27 datafusion:vortex-compact -4.0% -0.6% -3.4% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.8% -0.6% +1.4% +10.0% ➖ noise
27 duckdb:duckdb +9.0% -0.6% +9.6% +15.2% ➖ noise
27 duckdb:vortex-compact +3.4% -0.6% +4.0% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +3.0% -0.6% +3.6% +10.0% ➖ noise
28 datafusion:vortex-compact +1.2% -1.4% +2.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.7% -1.4% -0.3% +10.0% ➖ noise
28 duckdb:duckdb +2.3% -1.4% +3.7% +10.0% ➖ noise
28 duckdb:vortex-compact -0.3% -1.4% +1.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.2% -1.4% +1.6% +10.0% ➖ noise
29 datafusion:vortex-compact -3.9% -0.1% -3.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +2.0% -0.1% +2.1% +10.0% ➖ noise
29 duckdb:duckdb +0.0% -0.1% +0.1% +11.2% ➖ noise
29 duckdb:vortex-compact -2.5% -0.1% -2.4% +11.0% ➖ noise
29 duckdb:vortex-file-compressed +4.7% -0.1% +4.7% +11.5% ➖ noise
30 datafusion:vortex-compact -3.5% +0.5% -4.0% +12.0% ➖ noise
30 datafusion:vortex-file-compressed +1.6% +0.5% +1.1% +10.0% ➖ noise
30 duckdb:duckdb +14.5% +0.5% +13.8% +10.0% 🚨 regression
30 duckdb:vortex-compact +2.7% +0.5% +2.1% +11.5% ➖ noise
30 duckdb:vortex-file-compressed -0.9% +0.5% -1.5% +12.4% ➖ noise
31 datafusion:vortex-compact +1.3% -3.1% +4.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.1% -3.1% +3.1% +10.0% ➖ noise
31 duckdb:duckdb +0.7% -3.1% +3.9% +10.0% ➖ noise
31 duckdb:vortex-compact -1.3% -3.1% +1.9% +13.0% ➖ noise
31 duckdb:vortex-file-compressed +2.2% -3.1% +5.5% +10.0% ➖ noise
32 datafusion:vortex-compact +2.3% +4.0% -1.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +4.3% +4.0% +0.3% +10.0% ➖ noise
32 duckdb:duckdb +4.2% +4.0% +0.2% +13.2% ➖ noise
32 duckdb:vortex-compact +0.3% +4.0% -3.5% +10.7% ➖ noise
32 duckdb:vortex-file-compressed +6.9% +4.0% +2.8% +10.6% ➖ noise
33 datafusion:vortex-compact +1.9% +0.3% +1.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.1% +0.3% +0.8% +10.0% ➖ noise
33 duckdb:duckdb -4.3% +0.3% -4.6% +10.0% ➖ noise
33 duckdb:vortex-compact -3.6% +0.3% -3.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +6.2% +0.3% +5.9% +13.7% ➖ noise
34 datafusion:vortex-compact +4.1% -0.6% +4.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +2.5% -0.6% +3.2% +10.0% ➖ noise
34 duckdb:duckdb +3.0% -0.6% +3.6% +10.0% ➖ noise
34 duckdb:vortex-compact +2.0% -0.6% +2.7% +23.9% ➖ noise
34 duckdb:vortex-file-compressed -5.2% -0.6% -4.6% +10.5% ➖ noise
35 datafusion:vortex-compact +1.7% +2.4% -0.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.4% +2.4% -4.6% +10.0% ➖ noise
35 duckdb:duckdb +1.5% +2.4% -0.9% +15.8% ➖ noise
35 duckdb:vortex-compact +4.1% +2.4% +1.7% +10.4% ➖ noise
35 duckdb:vortex-file-compressed -0.4% +2.4% -2.7% +12.0% ➖ noise
36 datafusion:vortex-compact +2.2% +2.8% -0.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.7% +2.8% -3.4% +10.0% ➖ noise
36 duckdb:duckdb +15.9% +2.8% +12.6% +13.4% ➖ noise
36 duckdb:vortex-compact -1.9% +2.8% -4.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +6.9% +2.8% +3.9% +12.9% ➖ noise
37 datafusion:vortex-compact +1.6% -0.6% +2.2% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +4.7% -0.6% +5.3% +10.1% ➖ noise
37 duckdb:duckdb +10.6% -0.6% +11.3% +14.6% ➖ noise
37 duckdb:vortex-compact +7.1% -0.6% +7.8% +12.8% ➖ noise
37 duckdb:vortex-file-compressed -0.7% -0.6% -0.1% +11.2% ➖ noise
38 datafusion:vortex-compact -0.4% -3.8% +3.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +2.6% -3.8% +6.7% +10.0% ➖ noise
38 duckdb:duckdb +0.9% -3.8% +4.9% +12.4% ➖ noise
38 duckdb:vortex-compact -4.2% -3.8% -0.3% +11.2% ➖ noise
38 duckdb:vortex-file-compressed -2.4% -3.8% +1.4% +10.0% ➖ noise
39 datafusion:vortex-compact -0.3% +0.3% -0.5% +16.4% ➖ noise
39 datafusion:vortex-file-compressed +1.3% +0.3% +1.0% +14.4% ➖ noise
39 duckdb:duckdb +1.0% +0.3% +0.7% +11.4% ➖ noise
39 duckdb:vortex-compact +3.4% +0.3% +3.1% +14.3% ➖ noise
39 duckdb:vortex-file-compressed -0.0% +0.3% -0.3% +11.7% ➖ noise
40 datafusion:vortex-compact -3.2% -6.7% +3.7% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +2.7% -6.7% +10.1% +10.0% 🚨 regression
40 duckdb:duckdb -0.5% -6.7% +6.6% +15.7% ➖ noise
40 duckdb:vortex-compact +3.9% -6.7% +11.4% +10.0% 🚨 regression
40 duckdb:vortex-file-compressed +0.5% -6.7% +7.6% +10.0% ➖ noise
41 datafusion:vortex-compact +6.1% -5.1% +11.7% +10.4% 🚨 regression
41 datafusion:vortex-file-compressed +3.6% -5.1% +9.1% +12.0% ➖ noise
41 duckdb:duckdb +0.0% -5.1% +5.3% +12.3% ➖ noise
41 duckdb:vortex-compact +0.0% -5.1% +5.3% +11.2% ➖ noise
41 duckdb:vortex-file-compressed -3.6% -5.1% +1.5% +10.4% ➖ noise
42 datafusion:vortex-compact +0.6% -4.7% +5.5% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +6.3% -4.7% +11.5% +10.0% 🚨 regression
42 duckdb:duckdb +3.3% -4.7% +8.4% +14.0% ➖ noise
42 duckdb:vortex-compact +0.6% -4.7% +5.5% +18.1% ➖ noise
42 duckdb:vortex-file-compressed +1.3% -4.7% +6.2% +15.3% ➖ noise
43 datafusion:vortex-compact +1.3% -1.9% +3.2% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +7.6% -1.9% +9.7% +10.2% ➖ noise
43 duckdb:duckdb +11.9% -1.9% +14.0% +36.5% ➖ noise
43 duckdb:vortex-compact +0.9% -1.9% +2.8% +16.7% ➖ noise
43 duckdb:vortex-file-compressed +6.4% -1.9% +8.4% +10.0% ➖ noise
44 datafusion:vortex-compact +1.9% -2.1% +4.1% +14.4% ➖ noise
44 datafusion:vortex-file-compressed +4.1% -2.1% +6.4% +10.0% ➖ noise
44 duckdb:duckdb +2.0% -2.1% +4.2% +17.2% ➖ noise
44 duckdb:vortex-compact -1.2% -2.1% +1.0% +11.1% ➖ noise
44 duckdb:vortex-file-compressed +5.1% -2.1% +7.4% +12.8% ➖ noise
45 datafusion:vortex-compact +3.0% -0.8% +3.8% +10.1% ➖ noise
45 datafusion:vortex-file-compressed +0.1% -0.8% +0.9% +10.0% ➖ noise
45 duckdb:duckdb +3.4% -0.8% +4.2% +12.4% ➖ noise
45 duckdb:vortex-compact -6.5% -0.8% -5.8% +14.9% ➖ noise
45 duckdb:vortex-file-compressed +2.9% -0.8% +3.7% +15.5% ➖ noise
46 datafusion:vortex-compact -0.8% -0.5% -0.3% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +1.2% -0.5% +1.7% +10.0% ➖ noise
46 duckdb:duckdb +6.2% -0.5% +6.7% +10.0% ➖ noise
46 duckdb:vortex-compact +4.4% -0.5% +4.9% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +4.0% -0.5% +4.5% +10.0% ➖ noise
47 datafusion:vortex-compact +2.5% -0.1% +2.6% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.0% -0.1% +1.1% +10.0% ➖ noise
47 duckdb:duckdb -0.7% -0.1% -0.7% +12.0% ➖ noise
47 duckdb:vortex-compact +2.3% -0.1% +2.4% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -2.1% -0.1% -2.0% +10.0% ➖ noise
48 datafusion:vortex-compact -0.4% +0.5% -0.9% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -0.1% +0.5% -0.5% +10.0% ➖ noise
48 duckdb:duckdb +11.5% +0.5% +11.0% +10.0% 🚨 regression
48 duckdb:vortex-compact -2.7% +0.5% -3.1% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +4.9% +0.5% +4.5% +12.8% ➖ noise
49 datafusion:vortex-compact +1.8% -2.6% +4.5% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -3.4% -2.6% -0.8% +10.3% ➖ noise
49 duckdb:duckdb -4.1% -2.6% -1.6% +15.1% ➖ noise
49 duckdb:vortex-compact +2.1% -2.6% +4.9% +10.0% ➖ noise
49 duckdb:vortex-file-compressed +1.2% -2.6% +3.9% +12.5% ➖ noise
50 datafusion:vortex-compact +1.5% -2.3% +4.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +1.4% -2.3% +3.8% +10.0% ➖ noise
50 duckdb:duckdb +5.0% -2.3% +7.5% +10.0% ➖ noise
50 duckdb:vortex-compact +0.4% -2.3% +2.8% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -2.4% -2.3% -0.1% +10.0% ➖ noise
51 datafusion:vortex-compact +1.5% -10.4% +13.3% +11.4% 🚨 regression
51 datafusion:vortex-file-compressed +0.4% -10.4% +12.1% +11.5% 🚨 regression
51 duckdb:duckdb +7.9% -10.4% +20.5% +18.5% 🚨 regression
51 duckdb:vortex-compact -0.5% -10.4% +11.1% +17.9% ➖ noise
51 duckdb:vortex-file-compressed +0.5% -10.4% +12.3% +11.8% 🚨 regression
52 datafusion:vortex-compact -5.4% -1.9% -3.6% +12.3% ➖ noise
52 datafusion:vortex-file-compressed -3.5% -1.9% -1.7% +19.2% ➖ noise
52 duckdb:duckdb +8.0% -1.9% +10.1% +17.3% ➖ noise
52 duckdb:vortex-compact +1.2% -1.9% +3.2% +21.7% ➖ noise
52 duckdb:vortex-file-compressed -3.0% -1.9% -1.2% +20.5% ➖ noise
53 datafusion:vortex-compact +1.4% +2.5% -1.1% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -3.7% +2.5% -6.0% +10.0% ➖ noise
53 duckdb:duckdb +4.5% +2.5% +1.9% +12.2% ➖ noise
53 duckdb:vortex-compact +2.1% +2.5% -0.4% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -3.3% +2.5% -5.7% +10.0% ➖ noise
54 datafusion:vortex-compact +3.1% +4.5% -1.3% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +0.6% +4.5% -3.7% +10.0% ➖ noise
54 duckdb:duckdb +4.2% +4.5% -0.3% +11.5% ➖ noise
54 duckdb:vortex-compact +2.8% +4.5% -1.7% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +10.0% +4.5% +5.2% +12.6% ➖ noise
55 datafusion:vortex-compact +6.7% +0.6% +6.0% +10.5% ➖ noise
55 datafusion:vortex-file-compressed -1.9% +0.6% -2.5% +10.0% ➖ noise
55 duckdb:duckdb +3.8% +0.6% +3.2% +16.8% ➖ noise
55 duckdb:vortex-compact +7.4% +0.6% +6.7% +11.9% ➖ noise
55 duckdb:vortex-file-compressed +3.2% +0.6% +2.6% +15.0% ➖ noise
56 datafusion:vortex-compact +0.7% +0.0% +0.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +0.7% +0.0% +0.7% +10.0% ➖ noise
56 duckdb:duckdb -1.8% +0.0% -1.9% +10.8% ➖ noise
56 duckdb:vortex-compact +2.0% +0.0% +2.0% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +4.6% +0.0% +4.5% +11.0% ➖ noise
57 datafusion:vortex-compact +7.5% -4.4% +12.4% +10.0% 🚨 regression
57 datafusion:vortex-file-compressed +1.7% -4.4% +6.4% +10.0% ➖ noise
57 duckdb:duckdb +4.9% -4.4% +9.7% +10.0% ➖ noise
57 duckdb:vortex-compact +7.1% -4.4% +12.0% +16.0% ➖ noise
57 duckdb:vortex-file-compressed -5.8% -4.4% -1.5% +20.7% ➖ noise
58 datafusion:vortex-compact +2.2% -0.4% +2.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +0.2% -0.4% +0.6% +10.0% ➖ noise
58 duckdb:duckdb +2.6% -0.4% +3.0% +12.2% ➖ noise
58 duckdb:vortex-compact -2.2% -0.4% -1.8% +18.8% ➖ noise
58 duckdb:vortex-file-compressed -2.8% -0.4% -2.4% +12.1% ➖ noise
59 datafusion:vortex-compact +0.7% -6.0% +7.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.8% -6.0% +7.2% +10.0% ➖ noise
59 duckdb:duckdb +1.7% -6.0% +8.2% +10.0% ➖ noise
59 duckdb:vortex-compact +4.6% -6.0% +11.3% +10.0% 🚨 regression
59 duckdb:vortex-file-compressed +4.8% -6.0% +11.6% +10.0% 🚨 regression
60 datafusion:vortex-compact +2.3% -8.5% +11.7% +10.0% 🚨 regression
60 datafusion:vortex-file-compressed +2.1% -8.5% +11.6% +10.0% 🚨 regression
60 duckdb:duckdb -0.4% -8.5% +8.8% +10.0% ➖ noise
60 duckdb:vortex-compact +2.5% -8.5% +12.0% +10.0% 🚨 regression
60 duckdb:vortex-file-compressed +5.8% -8.5% +15.6% +11.8% 🚨 regression
61 datafusion:vortex-compact -0.9% -3.3% +2.5% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -0.1% -3.3% +3.3% +10.0% ➖ noise
61 duckdb:duckdb +3.1% -3.3% +6.7% +10.0% ➖ noise
61 duckdb:vortex-compact -0.8% -3.3% +2.6% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +0.9% -3.3% +4.4% +11.2% ➖ noise
62 datafusion:vortex-compact +0.2% +4.1% -3.7% +16.1% ➖ noise
62 datafusion:vortex-file-compressed +0.9% +4.1% -3.1% +16.3% ➖ noise
62 duckdb:duckdb +1.7% +4.1% -2.2% +23.5% ➖ noise
62 duckdb:vortex-compact +20.7% +4.1% +16.0% +26.6% ➖ noise
62 duckdb:vortex-file-compressed -0.4% +4.1% -4.3% +25.5% ➖ noise
63 datafusion:vortex-compact -1.7% -1.5% -0.2% +11.9% ➖ noise
63 datafusion:vortex-file-compressed +0.5% -1.5% +2.1% +10.0% ➖ noise
63 duckdb:duckdb +4.0% -1.5% +5.6% +11.5% ➖ noise
63 duckdb:vortex-compact +3.0% -1.5% +4.6% +10.1% ➖ noise
63 duckdb:vortex-file-compressed +7.0% -1.5% +8.7% +10.2% ➖ noise
64 datafusion:vortex-compact +1.6% -4.4% +6.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +1.4% -4.4% +6.0% +10.0% ➖ noise
64 duckdb:duckdb +2.1% -4.4% +6.8% +16.4% ➖ noise
64 duckdb:vortex-compact +0.8% -4.4% +5.4% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +5.6% -4.4% +10.4% +10.0% 🚨 regression
65 datafusion:vortex-compact +2.2% -2.1% +4.3% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +3.3% -2.1% +5.4% +10.0% ➖ noise
65 duckdb:duckdb +7.7% -2.1% +10.0% +16.1% ➖ noise
65 duckdb:vortex-compact +5.3% -2.1% +7.5% +13.5% ➖ noise
65 duckdb:vortex-file-compressed +3.7% -2.1% +5.9% +10.0% ➖ noise
66 datafusion:vortex-compact -2.2% -3.1% +0.9% +11.9% ➖ noise
66 datafusion:vortex-file-compressed +2.1% -3.1% +5.3% +11.1% ➖ noise
66 duckdb:duckdb +11.3% -3.1% +14.9% +13.6% 🚨 regression
66 duckdb:vortex-compact +5.6% -3.1% +8.9% +14.2% ➖ noise
66 duckdb:vortex-file-compressed +6.4% -3.1% +9.8% +11.1% ➖ noise
67 datafusion:vortex-compact +2.1% -7.4% +10.4% +10.0% 🚨 regression
67 datafusion:vortex-file-compressed -4.8% -7.4% +2.8% +10.0% ➖ noise
67 duckdb:duckdb +4.9% -7.4% +13.4% +10.0% 🚨 regression
67 duckdb:vortex-compact -1.5% -7.4% +6.4% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.2% -7.4% +10.4% +10.0% 🚨 regression
68 datafusion:vortex-compact +1.0% -5.0% +6.3% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +1.2% -5.0% +6.6% +10.0% ➖ noise
68 duckdb:duckdb +2.9% -5.0% +8.3% +10.0% ➖ noise
68 duckdb:vortex-compact +4.0% -5.0% +9.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +2.0% -5.0% +7.4% +10.0% ➖ noise
69 datafusion:vortex-compact -0.2% -3.1% +3.0% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +2.2% -3.1% +5.5% +10.0% ➖ noise
69 duckdb:duckdb -1.6% -3.1% +1.5% +20.1% ➖ noise
69 duckdb:vortex-compact +3.0% -3.1% +6.3% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +0.7% -3.1% +3.9% +10.0% ➖ noise
70 datafusion:vortex-compact +5.4% -3.4% +9.1% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +1.5% -3.4% +5.1% +10.0% ➖ noise
70 duckdb:duckdb +1.3% -3.4% +4.8% +15.5% ➖ noise
70 duckdb:vortex-compact +2.5% -3.4% +6.0% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +8.0% -3.4% +11.8% +10.5% 🚨 regression
71 datafusion:vortex-compact -1.6% +3.7% -5.1% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +3.6% +3.7% -0.1% +10.4% ➖ noise
71 duckdb:duckdb +5.6% +3.7% +1.8% +15.6% ➖ noise
71 duckdb:vortex-compact -1.9% +3.7% -5.4% +15.0% ➖ noise
71 duckdb:vortex-file-compressed +1.8% +3.7% -1.8% +12.8% ➖ noise
72 datafusion:vortex-compact +1.7% +0.9% +0.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +1.6% +0.9% +0.7% +10.0% ➖ noise
72 duckdb:duckdb -1.4% +0.9% -2.3% +13.3% ➖ noise
72 duckdb:vortex-compact +0.2% +0.9% -0.7% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.9% +0.9% +1.0% +10.0% ➖ noise
73 datafusion:vortex-compact +1.3% +1.6% -0.3% +13.9% ➖ noise
73 datafusion:vortex-file-compressed +2.5% +1.6% +0.9% +23.5% ➖ noise
73 duckdb:duckdb +9.5% +1.6% +7.8% +12.1% ➖ noise
73 duckdb:vortex-compact +7.1% +1.6% +5.5% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +2.0% +1.6% +0.4% +10.0% ➖ noise
74 datafusion:vortex-compact -2.2% -4.8% +2.7% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.1% -4.8% +7.3% +10.0% ➖ noise
74 duckdb:duckdb +6.2% -4.8% +11.5% +10.0% 🚨 regression
74 duckdb:vortex-compact +2.2% -4.8% +7.3% +17.1% ➖ noise
74 duckdb:vortex-file-compressed +2.1% -4.8% +7.3% +10.0% ➖ noise
75 datafusion:vortex-compact +0.4% +0.1% +0.4% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +4.9% +0.1% +4.8% +10.0% ➖ noise
75 duckdb:duckdb +6.0% +0.1% +5.9% +10.0% ➖ noise
75 duckdb:vortex-compact +5.3% +0.1% +5.2% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +4.5% +0.1% +4.4% +10.0% ➖ noise
76 datafusion:vortex-compact +2.1% +5.5% -3.3% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +3.9% +5.5% -1.5% +10.0% ➖ noise
76 duckdb:duckdb +5.8% +5.5% +0.3% +13.5% ➖ noise
76 duckdb:vortex-compact +9.9% +5.5% +4.2% +13.7% ➖ noise
76 duckdb:vortex-file-compressed +20.4% +5.5% +14.2% +28.1% ➖ noise
77 datafusion:vortex-compact +2.2% +1.0% +1.1% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +1.9% +1.0% +0.9% +10.0% ➖ noise
77 duckdb:duckdb +1.7% +1.0% +0.7% +10.0% ➖ noise
77 duckdb:vortex-compact +7.0% +1.0% +5.9% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +3.0% +1.0% +1.9% +10.6% ➖ noise
78 datafusion:vortex-compact +1.1% +0.3% +0.8% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +1.9% +0.3% +1.6% +10.0% ➖ noise
78 duckdb:duckdb +1.8% +0.3% +1.4% +10.0% ➖ noise
78 duckdb:vortex-compact +0.4% +0.3% +0.1% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -2.6% +0.3% -2.9% +10.0% ➖ noise
79 datafusion:vortex-compact -1.7% +1.6% -3.2% +10.1% ➖ noise
79 datafusion:vortex-file-compressed -1.1% +1.6% -2.6% +10.0% ➖ noise
79 duckdb:duckdb +2.4% +1.6% +0.8% +10.0% ➖ noise
79 duckdb:vortex-compact -0.8% +1.6% -2.3% +11.7% ➖ noise
79 duckdb:vortex-file-compressed +5.0% +1.6% +3.4% +12.8% ➖ noise
80 datafusion:vortex-compact +1.6% +2.8% -1.2% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -2.1% +2.8% -4.8% +10.0% ➖ noise
80 duckdb:duckdb +5.8% +2.8% +2.9% +14.6% ➖ noise
80 duckdb:vortex-compact -1.7% +2.8% -4.3% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +6.0% +2.8% +3.2% +10.0% ➖ noise
81 datafusion:vortex-compact +0.3% +3.3% -2.9% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +3.6% +3.3% +0.3% +10.0% ➖ noise
81 duckdb:duckdb +4.5% +3.3% +1.1% +10.0% ➖ noise
81 duckdb:vortex-compact +3.1% +3.3% -0.2% +11.5% ➖ noise
81 duckdb:vortex-file-compressed +6.4% +3.3% +3.0% +10.2% ➖ noise
82 datafusion:vortex-compact +2.4% -0.0% +2.4% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.1% -0.0% -0.1% +11.8% ➖ noise
82 duckdb:duckdb +4.4% -0.0% +4.4% +15.6% ➖ noise
82 duckdb:vortex-compact -5.0% -0.0% -5.0% +19.9% ➖ noise
82 duckdb:vortex-file-compressed -0.5% -0.0% -0.5% +12.0% ➖ noise
83 datafusion:vortex-compact +1.0% +1.1% -0.1% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +3.3% +1.1% +2.1% +10.0% ➖ noise
83 duckdb:duckdb +2.3% +1.1% +1.2% +15.9% ➖ noise
83 duckdb:vortex-compact +4.9% +1.1% +3.8% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -2.4% +1.1% -3.5% +10.8% ➖ noise
84 datafusion:vortex-compact +0.9% -0.1% +0.9% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +3.2% -0.1% +3.3% +10.0% ➖ noise
84 duckdb:duckdb +6.0% -0.1% +6.1% +25.0% ➖ noise
84 duckdb:vortex-compact +5.2% -0.1% +5.2% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +4.7% -0.1% +4.7% +10.0% ➖ noise
85 datafusion:vortex-compact +2.3% +1.2% +1.0% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +2.0% +1.2% +0.8% +10.0% ➖ noise
85 duckdb:duckdb +13.2% +1.2% +11.9% +16.5% ➖ noise
85 duckdb:vortex-compact +1.1% +1.2% -0.1% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +5.2% +1.2% +4.0% +10.0% ➖ noise
86 datafusion:vortex-compact +2.0% -3.9% +6.1% +10.0% ➖ noise
86 datafusion:vortex-file-compressed +7.8% -3.9% +12.2% +13.9% ➖ noise
86 duckdb:duckdb +13.4% -3.9% +18.0% +12.0% 🚨 regression
86 duckdb:vortex-compact +1.4% -3.9% +5.5% +14.6% ➖ noise
86 duckdb:vortex-file-compressed -1.8% -3.9% +2.2% +13.7% ➖ noise
87 datafusion:vortex-compact +1.0% +2.9% -1.9% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +1.0% +2.9% -1.8% +10.0% ➖ noise
87 duckdb:duckdb +5.3% +2.9% +2.4% +12.4% ➖ noise
87 duckdb:vortex-compact +10.2% +2.9% +7.1% +17.1% ➖ noise
87 duckdb:vortex-file-compressed +1.6% +2.9% -1.3% +14.9% ➖ noise
88 datafusion:vortex-compact +1.7% +1.8% -0.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.7% +1.8% -1.1% +10.0% ➖ noise
88 duckdb:duckdb +4.0% +1.8% +2.2% +10.0% ➖ noise
88 duckdb:vortex-compact +5.4% +1.8% +3.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +2.2% +1.8% +0.4% +10.0% ➖ noise
89 datafusion:vortex-compact +0.3% +0.8% -0.4% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -0.8% +0.8% -1.6% +10.0% ➖ noise
89 duckdb:duckdb +5.7% +0.8% +4.9% +12.7% ➖ noise
89 duckdb:vortex-compact +0.7% +0.8% -0.0% +12.7% ➖ noise
89 duckdb:vortex-file-compressed +7.8% +0.8% +7.0% +12.5% ➖ noise
90 datafusion:vortex-compact +0.1% -0.7% +0.8% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +1.9% -0.7% +2.6% +10.0% ➖ noise
90 duckdb:duckdb +0.6% -0.7% +1.3% +11.7% ➖ noise
90 duckdb:vortex-compact +7.1% -0.7% +7.8% +10.7% ➖ noise
90 duckdb:vortex-file-compressed -1.9% -0.7% -1.2% +12.8% ➖ noise
91 datafusion:vortex-compact +1.2% -2.3% +3.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +6.6% -2.3% +9.1% +10.0% ➖ noise
91 duckdb:duckdb +6.5% -2.3% +9.0% +16.4% ➖ noise
91 duckdb:vortex-compact -2.2% -2.3% +0.0% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +3.7% -2.3% +6.1% +10.0% ➖ noise
92 datafusion:vortex-compact +1.1% -0.6% +1.8% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -0.3% -0.6% +0.3% +10.0% ➖ noise
92 duckdb:duckdb +12.3% -0.6% +13.0% +15.3% ➖ noise
92 duckdb:vortex-compact -6.6% -0.6% -5.9% +13.5% ➖ noise
92 duckdb:vortex-file-compressed +3.5% -0.6% +4.2% +14.1% ➖ noise
93 datafusion:vortex-compact -0.6% +4.4% -4.8% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.0% +4.4% -5.2% +10.0% ➖ noise
93 duckdb:duckdb +6.3% +4.4% +1.8% +10.0% ➖ noise
93 duckdb:vortex-compact +4.9% +4.4% +0.4% +10.2% ➖ noise
93 duckdb:vortex-file-compressed +5.7% +4.4% +1.2% +15.6% ➖ noise
94 datafusion:vortex-compact +2.0% -4.7% +7.0% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -5.2% -4.7% -0.5% +17.0% ➖ noise
94 duckdb:duckdb +5.3% -4.7% +10.5% +16.3% ➖ noise
94 duckdb:vortex-compact +5.5% -4.7% +10.7% +15.7% ➖ noise
94 duckdb:vortex-file-compressed -2.7% -4.7% +2.1% +11.8% ➖ noise
95 datafusion:vortex-compact +3.9% +6.2% -2.2% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +4.0% +6.2% -2.0% +10.0% ➖ noise
95 duckdb:duckdb -12.2% +6.2% -17.3% +11.3% ✅ faster
95 duckdb:vortex-compact -3.6% +6.2% -9.2% +14.5% ➖ noise
95 duckdb:vortex-file-compressed +2.1% +6.2% -3.9% +20.2% ➖ noise
96 datafusion:vortex-compact -1.2% +2.8% -3.9% +10.1% ➖ noise
96 datafusion:vortex-file-compressed -1.3% +2.8% -4.0% +11.1% ➖ noise
96 duckdb:duckdb +2.7% +2.8% -0.1% +14.3% ➖ noise
96 duckdb:vortex-compact +7.9% +2.8% +5.0% +10.0% ➖ noise
96 duckdb:vortex-file-compressed -1.7% +2.8% -4.3% +12.5% ➖ noise
97 datafusion:vortex-compact +2.3% +5.3% -2.9% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +2.3% +5.3% -2.8% +10.0% ➖ noise
97 duckdb:duckdb -1.2% +5.3% -6.2% +10.0% ➖ noise
97 duckdb:vortex-compact +1.5% +5.3% -3.6% +12.3% ➖ noise
97 duckdb:vortex-file-compressed +1.9% +5.3% -3.2% +14.2% ➖ noise
98 datafusion:vortex-compact -0.5% -0.7% +0.2% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +2.6% -0.7% +3.4% +10.0% ➖ noise
98 duckdb:duckdb +6.1% -0.7% +6.9% +11.1% ➖ noise
98 duckdb:vortex-compact +14.5% -0.7% +15.3% +12.7% 🚨 regression
98 duckdb:vortex-file-compressed -6.9% -0.7% -6.2% +13.7% ➖ noise
99 datafusion:vortex-compact -1.7% +4.4% -5.9% +10.0% ➖ noise
99 datafusion:vortex-file-compressed -1.9% +4.4% -6.0% +11.2% ➖ noise
99 duckdb:duckdb -2.4% +4.4% -6.5% +18.9% ➖ noise
99 duckdb:vortex-compact -0.3% +4.4% -4.5% +18.4% ➖ noise
99 duckdb:vortex-file-compressed +2.2% +4.4% -2.1% +23.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

BENCHMARK FAILED

Benchmark Random Access failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.6%
Vortex (geomean): 0.945x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -3.9%


datafusion / vortex-file-compressed (0.915x ➖, 9↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 378612458 420906414 0.90
tpch_q02/datafusion:vortex-file-compressed 117132340 125269818 0.94
tpch_q03/datafusion:vortex-file-compressed 201288129 218812378 0.92
tpch_q04/datafusion:vortex-file-compressed 99541949 101862986 0.98
tpch_q05/datafusion:vortex-file-compressed 🚀 379157893 447441088 0.85
tpch_q06/datafusion:vortex-file-compressed 🚀 41311454 46997295 0.88
tpch_q07/datafusion:vortex-file-compressed 🚀 558191041 675072375 0.83
tpch_q08/datafusion:vortex-file-compressed 🚀 377833477 441643490 0.86
tpch_q09/datafusion:vortex-file-compressed 🚀 662394024 745384071 0.89
tpch_q10/datafusion:vortex-file-compressed 🚀 238493355 266477609 0.89
tpch_q11/datafusion:vortex-file-compressed 86088852 87405322 0.98
tpch_q12/datafusion:vortex-file-compressed 109309650 118198379 0.92
tpch_q13/datafusion:vortex-file-compressed 220731693 242647024 0.91
tpch_q14/datafusion:vortex-file-compressed 🚀 56622750 63089714 0.90
tpch_q15/datafusion:vortex-file-compressed 106199976 111663514 0.95
tpch_q16/datafusion:vortex-file-compressed 80008708 83880672 0.95
tpch_q17/datafusion:vortex-file-compressed 647553049 718305391 0.90
tpch_q18/datafusion:vortex-file-compressed 🚀 877943122 981125141 0.89
tpch_q19/datafusion:vortex-file-compressed 98102960 103347724 0.95
tpch_q20/datafusion:vortex-file-compressed 170763380 181755727 0.94
tpch_q21/datafusion:vortex-file-compressed 666990958 698841971 0.95
tpch_q22/datafusion:vortex-file-compressed 61525120 63319408 0.97
datafusion / vortex-compact (0.961x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 431251190 457507076 0.94
tpch_q02/datafusion:vortex-compact 118231871 127495962 0.93
tpch_q03/datafusion:vortex-compact 216114296 225313350 0.96
tpch_q04/datafusion:vortex-compact 121098920 123875046 0.98
tpch_q05/datafusion:vortex-compact 391035248 411894013 0.95
tpch_q06/datafusion:vortex-compact 64777816 65839440 0.98
tpch_q07/datafusion:vortex-compact 588059557 615556500 0.96
tpch_q08/datafusion:vortex-compact 388547455 404342801 0.96
tpch_q09/datafusion:vortex-compact 679202929 712981809 0.95
tpch_q10/datafusion:vortex-compact 275152964 287678273 0.96
tpch_q11/datafusion:vortex-compact 90048007 95046314 0.95
tpch_q12/datafusion:vortex-compact 168527055 177242729 0.95
tpch_q13/datafusion:vortex-compact 274254639 280933377 0.98
tpch_q14/datafusion:vortex-compact 74344470 77671279 0.96
tpch_q15/datafusion:vortex-compact 165689357 172629754 0.96
tpch_q16/datafusion:vortex-compact 83693419 85409705 0.98
tpch_q17/datafusion:vortex-compact 647080389 683522413 0.95
tpch_q18/datafusion:vortex-compact 885193788 932481788 0.95
tpch_q19/datafusion:vortex-compact 140359966 146782670 0.96
tpch_q20/datafusion:vortex-compact 200158486 198904484 1.01
tpch_q21/datafusion:vortex-compact 702622164 714530612 0.98
tpch_q22/datafusion:vortex-compact 71377151 74446074 0.96
datafusion / parquet (0.960x ➖, 1↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 416224494 478969659 0.87
tpch_q02/datafusion:parquet 187523784 204309701 0.92
tpch_q03/datafusion:parquet 301344314 315479199 0.96
tpch_q04/datafusion:parquet 136467503 138538306 0.99
tpch_q05/datafusion:parquet 445358713 450939613 0.99
tpch_q06/datafusion:parquet 125680530 126872729 0.99
tpch_q07/datafusion:parquet 629393097 637698775 0.99
tpch_q08/datafusion:parquet 488552394 502306192 0.97
tpch_q09/datafusion:parquet 758118498 791803708 0.96
tpch_q10/datafusion:parquet 504029148 529647696 0.95
tpch_q11/datafusion:parquet 130084802 133819919 0.97
tpch_q12/datafusion:parquet 216208717 222355644 0.97
tpch_q13/datafusion:parquet 335979033 344015321 0.98
tpch_q14/datafusion:parquet 160523318 159947422 1.00
tpch_q15/datafusion:parquet 246946181 248283000 0.99
tpch_q16/datafusion:parquet 137469284 143751155 0.96
tpch_q17/datafusion:parquet 679344414 745002215 0.91
tpch_q18/datafusion:parquet 887334475 951772043 0.93
tpch_q19/datafusion:parquet 266736504 278000837 0.96
tpch_q20/datafusion:parquet 304478743 321230629 0.95
tpch_q21/datafusion:parquet 741259881 781683292 0.95
tpch_q22/datafusion:parquet 218280454 223598299 0.98
datafusion / arrow (0.926x ➖, 4↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 593309732 661989867 0.90
tpch_q02/datafusion:arrow 166331825 171356085 0.97
tpch_q03/datafusion:arrow 461925007 489034608 0.94
tpch_q04/datafusion:arrow 338491035 363330865 0.93
tpch_q05/datafusion:arrow 917601972 998440987 0.92
tpch_q06/datafusion:arrow 278284026 303514522 0.92
tpch_q07/datafusion:arrow 1150004993 1277452784 0.90
tpch_q08/datafusion:arrow 1166552398 1260638499 0.93
tpch_q09/datafusion:arrow 1369392869 1431376573 0.96
tpch_q10/datafusion:arrow 608693808 651948829 0.93
tpch_q11/datafusion:arrow 151370399 157284516 0.96
tpch_q12/datafusion:arrow 670307200 728377997 0.92
tpch_q13/datafusion:arrow 531455923 545818321 0.97
tpch_q14/datafusion:arrow 318539066 328923158 0.97
tpch_q15/datafusion:arrow 693715130 738224550 0.94
tpch_q16/datafusion:arrow 111583409 113608479 0.98
tpch_q17/datafusion:arrow 🚀 1391450574 1579530416 0.88
tpch_q18/datafusion:arrow 1922987998 2120407426 0.91
tpch_q19/datafusion:arrow 🚀 532113609 615537360 0.86
tpch_q20/datafusion:arrow 🚀 497357615 613705095 0.81
tpch_q21/datafusion:arrow 3088820518 3231556068 0.96
tpch_q22/datafusion:arrow 146184677 156679727 0.93
duckdb / vortex-file-compressed (0.958x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 173250490 180859866 0.96
tpch_q02/duckdb:vortex-file-compressed 53308446 54844061 0.97
tpch_q03/duckdb:vortex-file-compressed 126693055 132377451 0.96
tpch_q04/duckdb:vortex-file-compressed 148987601 156488959 0.95
tpch_q05/duckdb:vortex-file-compressed 130604414 139880595 0.93
tpch_q06/duckdb:vortex-file-compressed 49997132 50495183 0.99
tpch_q07/duckdb:vortex-file-compressed 146107379 151906017 0.96
tpch_q08/duckdb:vortex-file-compressed 175332910 188757620 0.93
tpch_q09/duckdb:vortex-file-compressed 333276282 347482491 0.96
tpch_q10/duckdb:vortex-file-compressed 154637394 158143322 0.98
tpch_q11/duckdb:vortex-file-compressed 36495014 37605481 0.97
tpch_q12/duckdb:vortex-file-compressed 90234228 93856707 0.96
tpch_q13/duckdb:vortex-file-compressed 245330200 259536920 0.95
tpch_q14/duckdb:vortex-file-compressed 71585343 74474195 0.96
tpch_q15/duckdb:vortex-file-compressed 97049500 102350372 0.95
tpch_q16/duckdb:vortex-file-compressed 77609271 84187017 0.92
tpch_q17/duckdb:vortex-file-compressed 102111605 107000306 0.95
tpch_q18/duckdb:vortex-file-compressed 284893462 298249190 0.96
tpch_q19/duckdb:vortex-file-compressed 91545437 95412882 0.96
tpch_q20/duckdb:vortex-file-compressed 173166449 171645399 1.01
tpch_q21/duckdb:vortex-file-compressed 552503004 586786170 0.94
tpch_q22/duckdb:vortex-file-compressed 77761730 80435758 0.97
duckdb / vortex-compact (0.946x ➖, 4↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229450791 232349772 0.99
tpch_q02/duckdb:vortex-compact 58063415 60061798 0.97
tpch_q03/duckdb:vortex-compact 141284910 144825805 0.98
tpch_q04/duckdb:vortex-compact 176202086 177227693 0.99
tpch_q05/duckdb:vortex-compact 149350025 153750998 0.97
tpch_q06/duckdb:vortex-compact 90484225 85773294 1.05
tpch_q07/duckdb:vortex-compact 205752936 209370084 0.98
tpch_q08/duckdb:vortex-compact 192693445 204714323 0.94
tpch_q09/duckdb:vortex-compact 363631962 377858610 0.96
tpch_q10/duckdb:vortex-compact 🚀 184015792 210722076 0.87
tpch_q11/duckdb:vortex-compact 🚀 42188533 47222095 0.89
tpch_q12/duckdb:vortex-compact 206059260 215331651 0.96
tpch_q13/duckdb:vortex-compact 295904011 312654534 0.95
tpch_q14/duckdb:vortex-compact 104694627 116087708 0.90
tpch_q15/duckdb:vortex-compact 120446163 125210907 0.96
tpch_q16/duckdb:vortex-compact 🚀 85174689 96737545 0.88
tpch_q17/duckdb:vortex-compact 117976107 128176486 0.92
tpch_q18/duckdb:vortex-compact 298124065 303099763 0.98
tpch_q19/duckdb:vortex-compact 114776275 120322259 0.95
tpch_q20/duckdb:vortex-compact 🚀 205633015 236999558 0.87
tpch_q21/duckdb:vortex-compact 633711134 675754662 0.94
tpch_q22/duckdb:vortex-compact 91573812 100044967 0.92
duckdb / parquet (0.984x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257902342 266099855 0.97
tpch_q02/duckdb:parquet 104053519 98123883 1.06
tpch_q03/duckdb:parquet 213462411 214717800 0.99
tpch_q04/duckdb:parquet 134644294 138765701 0.97
tpch_q05/duckdb:parquet 219552792 222381227 0.99
tpch_q06/duckdb:parquet 68508044 70426730 0.97
tpch_q07/duckdb:parquet 182582039 186034565 0.98
tpch_q08/duckdb:parquet 255951673 261474289 0.98
tpch_q09/duckdb:parquet 465880572 474350545 0.98
tpch_q10/duckdb:parquet 606206445 620874630 0.98
tpch_q11/duckdb:parquet 41792355 46390014 0.90
tpch_q12/duckdb:parquet 127039725 130559633 0.97
tpch_q13/duckdb:parquet 447236931 430484639 1.04
tpch_q14/duckdb:parquet 171748780 174994299 0.98
tpch_q15/duckdb:parquet 99105034 99416828 1.00
tpch_q16/duckdb:parquet 163784526 162225193 1.01
tpch_q17/duckdb:parquet 179013490 179733450 1.00
tpch_q18/duckdb:parquet 352878263 358067603 0.99
tpch_q19/duckdb:parquet 283860660 286203643 0.99
tpch_q20/duckdb:parquet 229282963 236665479 0.97
tpch_q21/duckdb:parquet 570294932 588142691 0.97
tpch_q22/duckdb:parquet 290261169 295959647 0.98
duckdb / duckdb (0.975x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116932162 123092571 0.95
tpch_q02/duckdb:duckdb 48445808 46728072 1.04
tpch_q03/duckdb:duckdb 98505223 106556717 0.92
tpch_q04/duckdb:duckdb 132672858 137318128 0.97
tpch_q05/duckdb:duckdb 107955856 116600921 0.93
tpch_q06/duckdb:duckdb 38983207 40311033 0.97
tpch_q07/duckdb:duckdb 86097922 92433825 0.93
tpch_q08/duckdb:duckdb 109820499 114085160 0.96
tpch_q09/duckdb:duckdb 278887085 289245671 0.96
tpch_q10/duckdb:duckdb 206168492 211707205 0.97
tpch_q11/duckdb:duckdb 15812944 15593667 1.01
tpch_q12/duckdb:duckdb 83514814 86259245 0.97
tpch_q13/duckdb:duckdb 253387315 266197669 0.95
tpch_q14/duckdb:duckdb 70450093 70852453 0.99
tpch_q15/duckdb:duckdb 78216019 84666125 0.92
tpch_q16/duckdb:duckdb 72310101 75518023 0.96
tpch_q17/duckdb:duckdb 84930139 85575582 0.99
tpch_q18/duckdb:duckdb 212977957 218370507 0.98
tpch_q19/duckdb:duckdb 116117267 114608861 1.01
tpch_q20/duckdb:duckdb 111224039 112451197 0.99
tpch_q21/duckdb:duckdb 296461099 298631986 0.99
tpch_q22/duckdb:duckdb 69366723 63874308 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -10.4% -8.2% -2.3% +10.7% ➖ noise
1 datafusion:vortex-compact -5.7% -8.2% +2.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -10.0% -8.2% -2.0% +12.0% ➖ noise
1 duckdb:duckdb -5.0% -8.2% +3.5% +10.8% ➖ noise
1 duckdb:vortex-compact -1.2% -8.2% +7.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -4.2% -8.2% +4.4% +10.0% ➖ noise
2 datafusion:arrow -2.9% -1.3% -1.6% +10.0% ➖ noise
2 datafusion:vortex-compact -7.3% -1.3% -6.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -6.5% -1.3% -5.2% +10.0% ➖ noise
2 duckdb:duckdb +3.7% -1.3% +5.1% +13.5% ➖ noise
2 duckdb:vortex-compact -3.3% -1.3% -2.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.8% -1.3% -1.5% +10.0% ➖ noise
3 datafusion:arrow -5.5% -2.6% -3.1% +10.0% ➖ noise
3 datafusion:vortex-compact -4.1% -2.6% -1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -8.0% -2.6% -5.6% +10.0% ➖ noise
3 duckdb:duckdb -7.6% -2.6% -5.1% +10.0% ➖ noise
3 duckdb:vortex-compact -2.4% -2.6% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -4.3% -2.6% -1.8% +10.0% ➖ noise
4 datafusion:arrow -6.8% -2.2% -4.7% +10.0% ➖ noise
4 datafusion:vortex-compact -2.2% -2.2% -0.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.3% -2.2% -0.0% +10.0% ➖ noise
4 duckdb:duckdb -3.4% -2.2% -1.2% +10.0% ➖ noise
4 duckdb:vortex-compact -0.6% -2.2% +1.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.8% -2.2% -2.6% +10.0% ➖ noise
5 datafusion:arrow -8.1% -1.3% -6.9% +10.0% ➖ noise
5 datafusion:vortex-compact -5.1% -1.3% -3.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -15.3% -1.3% -14.2% +10.0% ✅ faster
5 duckdb:duckdb -7.4% -1.3% -6.2% +10.0% ➖ noise
5 duckdb:vortex-compact -2.9% -1.3% -1.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.6% -1.3% -5.4% +10.0% ➖ noise
6 datafusion:arrow -8.3% -1.8% -6.6% +10.0% ➖ noise
6 datafusion:vortex-compact -1.6% -1.8% +0.2% +13.9% ➖ noise
6 datafusion:vortex-file-compressed -12.1% -1.8% -10.5% +10.0% ✅ faster
6 duckdb:duckdb -3.3% -1.8% -1.5% +14.2% ➖ noise
6 duckdb:vortex-compact +5.5% -1.8% +7.5% +12.3% ➖ noise
6 duckdb:vortex-file-compressed -1.0% -1.8% +0.9% +16.8% ➖ noise
7 datafusion:arrow -10.0% -1.6% -8.5% +10.0% ➖ noise
7 datafusion:vortex-compact -4.5% -1.6% -2.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -17.3% -1.6% -16.0% +10.0% ✅ faster
7 duckdb:duckdb -6.9% -1.6% -5.4% +11.3% ➖ noise
7 duckdb:vortex-compact -1.7% -1.6% -0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.8% -1.6% -2.3% +10.0% ➖ noise
8 datafusion:arrow -7.5% -2.4% -5.2% +10.0% ➖ noise
8 datafusion:vortex-compact -3.9% -2.4% -1.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -14.4% -2.4% -12.3% +10.0% ✅ faster
8 duckdb:duckdb -3.7% -2.4% -1.3% +10.0% ➖ noise
8 duckdb:vortex-compact -5.9% -2.4% -3.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -7.1% -2.4% -4.8% +10.0% ➖ noise
9 datafusion:arrow -4.3% -3.0% -1.3% +10.0% ➖ noise
9 datafusion:vortex-compact -4.7% -3.0% -1.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -11.1% -3.0% -8.4% +10.0% ➖ noise
9 duckdb:duckdb -3.6% -3.0% -0.6% +10.0% ➖ noise
9 duckdb:vortex-compact -3.8% -3.0% -0.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.1% -3.0% -1.1% +10.0% ➖ noise
10 datafusion:arrow -6.6% -3.6% -3.1% +10.0% ➖ noise
10 datafusion:vortex-compact -4.4% -3.6% -0.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -10.5% -3.6% -7.2% +10.0% ➖ noise
10 duckdb:duckdb -2.6% -3.6% +1.0% +10.0% ➖ noise
10 duckdb:vortex-compact -12.7% -3.6% -9.4% +10.0% ✅ faster
10 duckdb:vortex-file-compressed -2.2% -3.6% +1.4% +10.0% ➖ noise
11 datafusion:arrow -3.8% -6.4% +2.8% +12.4% ➖ noise
11 datafusion:vortex-compact -5.3% -6.4% +1.2% +12.4% ➖ noise
11 datafusion:vortex-file-compressed -1.5% -6.4% +5.2% +13.6% ➖ noise
11 duckdb:duckdb +1.4% -6.4% +8.4% +21.5% ➖ noise
11 duckdb:vortex-compact -10.7% -6.4% -4.5% +16.7% ➖ noise
11 duckdb:vortex-file-compressed -3.0% -6.4% +3.7% +14.2% ➖ noise
12 datafusion:arrow -8.0% -2.7% -5.4% +39.0% ➖ noise
12 datafusion:vortex-compact -4.9% -2.7% -2.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -7.5% -2.7% -4.9% +10.0% ➖ noise
12 duckdb:duckdb -3.2% -2.7% -0.5% +10.0% ➖ noise
12 duckdb:vortex-compact -4.3% -2.7% -1.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.9% -2.7% -1.2% +10.0% ➖ noise
13 datafusion:arrow -2.6% +0.7% -3.3% +11.5% ➖ noise
13 datafusion:vortex-compact -2.4% +0.7% -3.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -9.0% +0.7% -9.7% +10.0% ✅ faster
13 duckdb:duckdb -4.8% +0.7% -5.5% +10.0% ➖ noise
13 duckdb:vortex-compact -5.4% +0.7% -6.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -5.5% +0.7% -6.2% +10.0% ➖ noise
14 datafusion:arrow -3.2% -0.8% -2.4% +10.0% ➖ noise
14 datafusion:vortex-compact -4.3% -0.8% -3.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -10.3% -0.8% -9.6% +14.6% ➖ noise
14 duckdb:duckdb -0.6% -0.8% +0.2% +10.0% ➖ noise
14 duckdb:vortex-compact -9.8% -0.8% -9.1% +10.0% ✅ faster
14 duckdb:vortex-file-compressed -3.9% -0.8% -3.1% +10.1% ➖ noise
15 datafusion:arrow -6.0% -0.4% -5.6% +10.0% ➖ noise
15 datafusion:vortex-compact -4.0% -0.4% -3.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -4.9% -0.4% -4.5% +10.0% ➖ noise
15 duckdb:duckdb -7.6% -0.4% -7.2% +10.0% ➖ noise
15 duckdb:vortex-compact -3.8% -0.4% -3.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -5.2% -0.4% -4.8% +10.0% ➖ noise
16 datafusion:arrow -1.8% -1.7% -0.0% +11.3% ➖ noise
16 datafusion:vortex-compact -2.0% -1.7% -0.3% +10.5% ➖ noise
16 datafusion:vortex-file-compressed -4.6% -1.7% -2.9% +11.3% ➖ noise
16 duckdb:duckdb -4.2% -1.7% -2.6% +10.2% ➖ noise
16 duckdb:vortex-compact -12.0% -1.7% -10.4% +11.5% ✅ faster
16 duckdb:vortex-file-compressed -7.8% -1.7% -6.2% +11.0% ➖ noise
17 datafusion:arrow -11.9% -4.7% -7.6% +10.0% ➖ noise
17 datafusion:vortex-compact -5.3% -4.7% -0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -9.8% -4.7% -5.4% +10.1% ➖ noise
17 duckdb:duckdb -0.8% -4.7% +4.1% +10.0% ➖ noise
17 duckdb:vortex-compact -8.0% -4.7% -3.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.6% -4.7% +0.1% +10.0% ➖ noise
18 datafusion:arrow -9.3% -4.1% -5.4% +10.1% ➖ noise
18 datafusion:vortex-compact -5.1% -4.1% -1.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -10.5% -4.1% -6.6% +10.0% ➖ noise
18 duckdb:duckdb -2.5% -4.1% +1.7% +10.0% ➖ noise
18 duckdb:vortex-compact -1.6% -4.1% +2.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.5% -4.1% -0.3% +10.0% ➖ noise
19 datafusion:arrow -13.6% -2.4% -11.4% +10.0% ✅ faster
19 datafusion:vortex-compact -4.4% -2.4% -2.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.1% -2.4% -2.7% +10.0% ➖ noise
19 duckdb:duckdb +1.3% -2.4% +3.9% +10.0% ➖ noise
19 duckdb:vortex-compact -4.6% -2.4% -2.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -4.1% -2.4% -1.6% +10.0% ➖ noise
20 datafusion:arrow -19.0% -4.2% -15.4% +10.0% ✅ faster
20 datafusion:vortex-compact +0.6% -4.2% +5.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -6.0% -4.2% -2.0% +10.0% ➖ noise
20 duckdb:duckdb -1.1% -4.2% +3.2% +10.0% ➖ noise
20 duckdb:vortex-compact -13.2% -4.2% -9.5% +10.0% ✅ faster
20 duckdb:vortex-file-compressed +0.9% -4.2% +5.3% +10.0% ➖ noise
21 datafusion:arrow -4.4% -4.1% -0.3% +10.0% ➖ noise
21 datafusion:vortex-compact -1.7% -4.1% +2.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -4.6% -4.1% -0.5% +10.0% ➖ noise
21 duckdb:duckdb -0.7% -4.1% +3.5% +10.0% ➖ noise
21 duckdb:vortex-compact -6.2% -4.1% -2.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -5.8% -4.1% -1.8% +10.0% ➖ noise
22 datafusion:arrow -6.7% -2.2% -4.6% +10.0% ➖ noise
22 datafusion:vortex-compact -4.1% -2.2% -2.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -2.8% -2.2% -0.7% +10.0% ➖ noise
22 duckdb:duckdb +8.6% -2.2% +11.0% +10.0% 🚨 regression
22 duckdb:vortex-compact -8.5% -2.2% -6.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -3.3% -2.2% -1.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.8%
Vortex (geomean): 1.059x ➖
Parquet (geomean): 1.041x ➖
Shifts: Parquet (control) +4.1% · Median polish +5.5%


datafusion / vortex-file-compressed (1.098x ➖, 0↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 249668517 207912509 1.20
tpch_q02/datafusion:vortex-file-compressed 459813183 427060664 1.08
tpch_q03/datafusion:vortex-file-compressed 366153566 341501882 1.07
tpch_q04/datafusion:vortex-file-compressed 191379339 195020434 0.98
tpch_q05/datafusion:vortex-file-compressed 384645128 442481557 0.87
tpch_q06/datafusion:vortex-file-compressed 272202472 273827056 0.99
tpch_q07/datafusion:vortex-file-compressed 367754980 355388113 1.03
tpch_q08/datafusion:vortex-file-compressed 521817656 506821297 1.03
tpch_q09/datafusion:vortex-file-compressed 349636859 304234364 1.15
tpch_q10/datafusion:vortex-file-compressed 477101809 378660059 1.26
tpch_q11/datafusion:vortex-file-compressed 284869596 262911604 1.08
tpch_q12/datafusion:vortex-file-compressed 310057271 294836877 1.05
tpch_q13/datafusion:vortex-file-compressed 219958404 212216950 1.04
tpch_q14/datafusion:vortex-file-compressed 177507950 157581705 1.13
tpch_q15/datafusion:vortex-file-compressed 292429116 295964681 0.99
tpch_q16/datafusion:vortex-file-compressed 211692178 176678107 1.20
tpch_q17/datafusion:vortex-file-compressed 336965206 310097859 1.09
tpch_q18/datafusion:vortex-file-compressed 322717563 272094001 1.19
tpch_q19/datafusion:vortex-file-compressed 397471087 331519741 1.20
tpch_q20/datafusion:vortex-file-compressed 398603557 351845548 1.13
tpch_q21/datafusion:vortex-file-compressed 🚨 635001029 459232434 1.38
tpch_q22/datafusion:vortex-file-compressed 195374109 172825805 1.13
datafusion / vortex-compact (1.020x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 229474308 232985914 0.98
tpch_q02/datafusion:vortex-compact 410324952 392847068 1.04
tpch_q03/datafusion:vortex-compact 340200064 358322604 0.95
tpch_q04/datafusion:vortex-compact 195036491 209818577 0.93
tpch_q05/datafusion:vortex-compact 352802793 334311790 1.06
tpch_q06/datafusion:vortex-compact 309625421 277089118 1.12
tpch_q07/datafusion:vortex-compact 391999475 344764846 1.14
tpch_q08/datafusion:vortex-compact 456234140 493366931 0.92
tpch_q09/datafusion:vortex-compact 394073237 382886625 1.03
tpch_q10/datafusion:vortex-compact 405858716 418270400 0.97
tpch_q11/datafusion:vortex-compact 248798547 257801321 0.97
tpch_q12/datafusion:vortex-compact 403487616 390932946 1.03
tpch_q13/datafusion:vortex-compact 212659258 205997379 1.03
tpch_q14/datafusion:vortex-compact 226363723 242351021 0.93
tpch_q15/datafusion:vortex-compact 478928753 435271347 1.10
tpch_q16/datafusion:vortex-compact 190915773 181787977 1.05
tpch_q17/datafusion:vortex-compact 333525604 300321611 1.11
tpch_q18/datafusion:vortex-compact 295239998 267780428 1.10
tpch_q19/datafusion:vortex-compact 442454111 438072684 1.01
tpch_q20/datafusion:vortex-compact 422121388 454211314 0.93
tpch_q21/datafusion:vortex-compact 524394247 495000396 1.06
tpch_q22/datafusion:vortex-compact 151415086 148488857 1.02
datafusion / parquet (1.036x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 192504981 224395115 0.86
tpch_q02/datafusion:parquet 452132310 407327959 1.11
tpch_q03/datafusion:parquet 293881078 290846701 1.01
tpch_q04/datafusion:parquet 140540946 145008112 0.97
tpch_q05/datafusion:parquet 443724050 441741983 1.00
tpch_q06/datafusion:parquet 136415869 134645195 1.01
tpch_q07/datafusion:parquet 497398440 468837389 1.06
tpch_q08/datafusion:parquet 615459492 546942612 1.13
tpch_q09/datafusion:parquet 491318198 458712837 1.07
tpch_q10/datafusion:parquet 527380219 486703289 1.08
tpch_q11/datafusion:parquet 344290169 322508535 1.07
tpch_q12/datafusion:parquet 251337396 245976563 1.02
tpch_q13/datafusion:parquet 486482907 432336515 1.13
tpch_q14/datafusion:parquet 178981859 168008622 1.07
tpch_q15/datafusion:parquet 297060664 298882342 0.99
tpch_q16/datafusion:parquet 177282508 164603979 1.08
tpch_q17/datafusion:parquet 424010527 339889755 1.25
tpch_q18/datafusion:parquet 450956938 450322859 1.00
tpch_q19/datafusion:parquet 305096374 312834909 0.98
tpch_q20/datafusion:parquet 312176875 309493041 1.01
tpch_q21/datafusion:parquet 488182530 478630802 1.02
tpch_q22/datafusion:parquet 115561347 123337326 0.94
duckdb / vortex-file-compressed (1.056x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 269974703 260455983 1.04
tpch_q02/duckdb:vortex-file-compressed 965254016 909569184 1.06
tpch_q03/duckdb:vortex-file-compressed 649420930 552707357 1.17
tpch_q04/duckdb:vortex-file-compressed 387739146 319736417 1.21
tpch_q05/duckdb:vortex-file-compressed 824980499 880678877 0.94
tpch_q06/duckdb:vortex-file-compressed 390265161 373258665 1.05
tpch_q07/duckdb:vortex-file-compressed 788998115 724861347 1.09
tpch_q08/duckdb:vortex-file-compressed 885523454 951214832 0.93
tpch_q09/duckdb:vortex-file-compressed 878110970 781654344 1.12
tpch_q10/duckdb:vortex-file-compressed 716779792 700012528 1.02
tpch_q11/duckdb:vortex-file-compressed 516202312 472477081 1.09
tpch_q12/duckdb:vortex-file-compressed 453815243 500167461 0.91
tpch_q13/duckdb:vortex-file-compressed 469449443 458434208 1.02
tpch_q14/duckdb:vortex-file-compressed 521794582 440785714 1.18
tpch_q15/duckdb:vortex-file-compressed 287543083 287443752 1.00
tpch_q16/duckdb:vortex-file-compressed 354153548 335643735 1.06
tpch_q17/duckdb:vortex-file-compressed 658181922 658467123 1.00
tpch_q18/duckdb:vortex-file-compressed 534963980 510484615 1.05
tpch_q19/duckdb:vortex-file-compressed 454811433 401592296 1.13
tpch_q20/duckdb:vortex-file-compressed 816532234 718259932 1.14
tpch_q21/duckdb:vortex-file-compressed 1017975753 983324520 1.04
tpch_q22/duckdb:vortex-file-compressed 343955255 330899552 1.04
duckdb / vortex-compact (1.063x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 280644903 256100139 1.10
tpch_q02/duckdb:vortex-compact 891226067 846124995 1.05
tpch_q03/duckdb:vortex-compact 565482549 548112042 1.03
tpch_q04/duckdb:vortex-compact 316360125 352355264 0.90
tpch_q05/duckdb:vortex-compact 841182645 741972098 1.13
tpch_q06/duckdb:vortex-compact 404681815 379717667 1.07
tpch_q07/duckdb:vortex-compact 706158123 635405777 1.11
tpch_q08/duckdb:vortex-compact 910421339 832698987 1.09
tpch_q09/duckdb:vortex-compact 895903775 839918335 1.07
tpch_q10/duckdb:vortex-compact 673057466 604588708 1.11
tpch_q11/duckdb:vortex-compact 541080603 465282576 1.16
tpch_q12/duckdb:vortex-compact 449975928 448818135 1.00
tpch_q13/duckdb:vortex-compact 459068002 457806806 1.00
tpch_q14/duckdb:vortex-compact 460996617 478606897 0.96
tpch_q15/duckdb:vortex-compact 306326209 316785974 0.97
tpch_q16/duckdb:vortex-compact 350296950 318525824 1.10
tpch_q17/duckdb:vortex-compact 638098501 583938436 1.09
tpch_q18/duckdb:vortex-compact 478213350 412852183 1.16
tpch_q19/duckdb:vortex-compact 437502136 421540282 1.04
tpch_q20/duckdb:vortex-compact 806678539 649214001 1.24
tpch_q21/duckdb:vortex-compact 1114954497 1058304766 1.05
tpch_q22/duckdb:vortex-compact 358416917 358725288 1.00
duckdb / parquet (1.046x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 610003390 473468151 1.29
tpch_q02/duckdb:parquet 1371304692 1282293240 1.07
tpch_q03/duckdb:parquet 999253968 984078318 1.02
tpch_q04/duckdb:parquet 617316182 614210912 1.01
tpch_q05/duckdb:parquet 1764613292 1619112641 1.09
tpch_q06/duckdb:parquet 416489657 401051248 1.04
tpch_q07/duckdb:parquet 1286330499 1132461311 1.14
tpch_q08/duckdb:parquet 1631303519 1606524680 1.02
tpch_q09/duckdb:parquet 1378690826 1365763516 1.01
tpch_q10/duckdb:parquet 1343766839 1329371055 1.01
tpch_q11/duckdb:parquet 878473853 880783218 1.00
tpch_q12/duckdb:parquet 613174986 614022195 1.00
tpch_q13/duckdb:parquet 865170114 874925161 0.99
tpch_q14/duckdb:parquet 635189401 635254852 1.00
tpch_q15/duckdb:parquet 525592231 534381841 0.98
tpch_q16/duckdb:parquet 546892207 598575957 0.91
tpch_q17/duckdb:parquet 814362385 753812436 1.08
tpch_q18/duckdb:parquet 912183542 856021465 1.07
tpch_q19/duckdb:parquet 908987496 805321282 1.13
tpch_q20/duckdb:parquet 1085857953 953883460 1.14
tpch_q21/duckdb:parquet 1237499943 1124468686 1.10
tpch_q22/duckdb:parquet 485911298 492577146 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.5% +5.1% -6.3% +167.7% ➖ noise
1 datafusion:vortex-file-compressed +20.1% +5.1% +14.2% +136.0% ➖ noise
1 duckdb:vortex-compact +9.6% +5.1% +4.2% +51.4% ➖ noise
1 duckdb:vortex-file-compressed +3.7% +5.1% -1.4% +47.4% ➖ noise
2 datafusion:vortex-compact +4.4% +9.0% -4.1% +49.4% ➖ noise
2 datafusion:vortex-file-compressed +7.7% +9.0% -1.2% +46.7% ➖ noise
2 duckdb:vortex-compact +5.3% +9.0% -3.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +6.1% +9.0% -2.6% +30.0% ➖ noise
3 datafusion:vortex-compact -5.1% +1.3% -6.3% +78.1% ➖ noise
3 datafusion:vortex-file-compressed +7.2% +1.3% +5.9% +98.7% ➖ noise
3 duckdb:vortex-compact +3.2% +1.3% +1.9% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +17.5% +1.3% +16.0% +44.2% ➖ noise
4 datafusion:vortex-compact -7.0% -1.3% -5.8% +65.6% ➖ noise
4 datafusion:vortex-file-compressed -1.9% -1.3% -0.6% +30.0% ➖ noise
4 duckdb:vortex-compact -10.2% -1.3% -9.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +21.3% -1.3% +22.9% +30.0% ➖ noise
5 datafusion:vortex-compact +5.5% +4.6% +0.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -13.1% +4.6% -16.9% +30.0% ➖ noise
5 duckdb:vortex-compact +13.4% +4.6% +8.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.3% +4.6% -10.5% +30.0% ➖ noise
6 datafusion:vortex-compact +11.7% +2.6% +8.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.6% +2.6% -3.1% +30.0% ➖ noise
6 duckdb:vortex-compact +6.6% +2.6% +3.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.6% +2.6% +1.9% +30.0% ➖ noise
7 datafusion:vortex-compact +13.7% +9.8% +3.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.5% +9.8% -5.7% +30.0% ➖ noise
7 duckdb:vortex-compact +11.1% +9.8% +1.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.8% +9.8% -0.8% +30.0% ➖ noise
8 datafusion:vortex-compact -7.5% +6.9% -13.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +3.0% +6.9% -3.7% +30.0% ➖ noise
8 duckdb:vortex-compact +9.3% +6.9% +2.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -6.9% +6.9% -12.9% +30.0% ➖ noise
9 datafusion:vortex-compact +2.9% +4.0% -1.0% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +14.9% +4.0% +10.5% +34.1% ➖ noise
9 duckdb:vortex-compact +6.7% +4.0% +2.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +12.3% +4.0% +8.0% +30.0% ➖ noise
10 datafusion:vortex-compact -3.0% +4.7% -7.3% +34.7% ➖ noise
10 datafusion:vortex-file-compressed +26.0% +4.7% +20.4% +30.0% ➖ noise
10 duckdb:vortex-compact +11.3% +4.7% +6.4% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +2.4% +4.7% -2.2% +30.0% ➖ noise
11 datafusion:vortex-compact -3.5% +3.2% -6.5% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +8.4% +3.2% +5.0% +30.0% ➖ noise
11 duckdb:vortex-compact +16.3% +3.2% +12.7% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +9.3% +3.2% +5.9% +30.0% ➖ noise
12 datafusion:vortex-compact +3.2% +1.0% +2.2% +36.1% ➖ noise
12 datafusion:vortex-file-compressed +5.2% +1.0% +4.1% +47.2% ➖ noise
12 duckdb:vortex-compact +0.3% +1.0% -0.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -9.3% +1.0% -10.2% +52.4% ➖ noise
13 datafusion:vortex-compact +3.2% +5.5% -2.1% +40.4% ➖ noise
13 datafusion:vortex-file-compressed +3.6% +5.5% -1.7% +30.0% ➖ noise
13 duckdb:vortex-compact +0.3% +5.5% -4.9% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +2.4% +5.5% -2.9% +30.0% ➖ noise
14 datafusion:vortex-compact -6.6% +3.2% -9.5% +46.3% ➖ noise
14 datafusion:vortex-file-compressed +12.6% +3.2% +9.1% +30.0% ➖ noise
14 duckdb:vortex-compact -3.7% +3.2% -6.7% +32.4% ➖ noise
14 duckdb:vortex-file-compressed +18.4% +3.2% +14.7% +30.0% ➖ noise
15 datafusion:vortex-compact +10.0% -1.1% +11.3% +32.0% ➖ noise
15 datafusion:vortex-file-compressed -1.2% -1.1% -0.1% +30.0% ➖ noise
15 duckdb:vortex-compact -3.3% -1.1% -2.2% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +0.0% -1.1% +1.2% +30.0% ➖ noise
16 datafusion:vortex-compact +5.0% -0.8% +5.9% +33.6% ➖ noise
16 datafusion:vortex-file-compressed +19.8% -0.8% +20.8% +30.0% ➖ noise
16 duckdb:vortex-compact +10.0% -0.8% +10.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +5.5% -0.8% +6.4% +30.0% ➖ noise
17 datafusion:vortex-compact +11.1% +16.1% -4.3% +39.6% ➖ noise
17 datafusion:vortex-file-compressed +8.7% +16.1% -6.4% +30.0% ➖ noise
17 duckdb:vortex-compact +9.3% +16.1% -5.9% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -0.0% +16.1% -13.9% +30.0% ➖ noise
18 datafusion:vortex-compact +10.3% +3.3% +6.7% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +18.6% +3.3% +14.8% +49.1% ➖ noise
18 duckdb:vortex-compact +15.8% +3.3% +12.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +4.8% +3.3% +1.4% +30.0% ➖ noise
19 datafusion:vortex-compact +1.0% +4.9% -3.7% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +19.9% +4.9% +14.3% +31.3% ➖ noise
19 duckdb:vortex-compact +3.8% +4.9% -1.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +13.3% +4.9% +7.9% +30.0% ➖ noise
20 datafusion:vortex-compact -7.1% +7.2% -13.3% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +13.3% +7.2% +5.7% +52.3% ➖ noise
20 duckdb:vortex-compact +24.3% +7.2% +16.0% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +13.7% +7.2% +6.1% +30.0% ➖ noise
21 datafusion:vortex-compact +5.9% +5.9% -0.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +38.3% +5.9% +30.5% +30.0% 🚨 regression
21 duckdb:vortex-compact +5.4% +5.9% -0.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +3.5% +5.9% -2.3% +30.0% ➖ noise
22 datafusion:vortex-compact +2.0% -3.9% +6.1% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +13.0% -3.9% +17.6% +48.6% ➖ noise
22 duckdb:vortex-compact -0.1% -3.9% +3.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +3.9% -3.9% +8.1% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.0%
Vortex (geomean): 0.974x ➖
Parquet (geomean): 1.026x ➖
Shifts: Parquet (control) +2.6% · Median polish +0.4%


datafusion / vortex-file-compressed (1.040x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 29984502 28652587 1.05
fineweb_q01/datafusion:vortex-file-compressed 467560527 477726047 0.98
fineweb_q02/datafusion:vortex-file-compressed 517001705 526757466 0.98
fineweb_q03/datafusion:vortex-file-compressed 1326125515 1349925821 0.98
fineweb_q04/datafusion:vortex-file-compressed 1352397611 1371067798 0.99
fineweb_q05/datafusion:vortex-file-compressed 1345048050 1323538326 1.02
fineweb_q06/datafusion:vortex-file-compressed 1607646510 1522838029 1.06
fineweb_q07/datafusion:vortex-file-compressed 1443437379 1341401187 1.08
fineweb_q08/datafusion:vortex-file-compressed 685209676 539102253 1.27
datafusion / vortex-compact (1.021x ➖, 0↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 48291316 35919927 1.34
fineweb_q01/datafusion:vortex-compact 529288498 524236251 1.01
fineweb_q02/datafusion:vortex-compact 610589620 661671771 0.92
fineweb_q03/datafusion:vortex-compact 1835885072 1944646672 0.94
fineweb_q04/datafusion:vortex-compact 2241287094 2341068879 0.96
fineweb_q05/datafusion:vortex-compact 1734261959 1728701601 1.00
fineweb_q06/datafusion:vortex-compact 1428648615 1434374422 1.00
fineweb_q07/datafusion:vortex-compact 1398417173 1385514194 1.01
fineweb_q08/datafusion:vortex-compact 408942491 388669072 1.05
datafusion / parquet (1.034x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1075659369 1008232901 1.07
fineweb_q01/datafusion:parquet 1721798422 1711275869 1.01
fineweb_q02/datafusion:parquet 1669231991 1758678459 0.95
fineweb_q03/datafusion:parquet 1874019212 1730923206 1.08
fineweb_q04/datafusion:parquet 1845592080 1728302623 1.07
fineweb_q05/datafusion:parquet 1895876520 1678259464 1.13
fineweb_q06/datafusion:parquet 1788920573 1755673818 1.02
fineweb_q07/datafusion:parquet 1695522908 1692682459 1.00
fineweb_q08/datafusion:parquet 1733043729 1737779167 1.00
duckdb / vortex-file-compressed (0.955x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 89445672 80423384 1.11
fineweb_q01/duckdb:vortex-file-compressed 542355204 562027917 0.96
fineweb_q02/duckdb:vortex-file-compressed 454021590 423264751 1.07
fineweb_q03/duckdb:vortex-file-compressed 1662638765 1655955434 1.00
fineweb_q04/duckdb:vortex-file-compressed 1541972293 1672277951 0.92
fineweb_q05/duckdb:vortex-file-compressed 1443704447 1611862040 0.90
fineweb_q06/duckdb:vortex-file-compressed 1907461470 2005764162 0.95
fineweb_q07/duckdb:vortex-file-compressed 1416569483 1840172649 0.77
fineweb_q08/duckdb:vortex-file-compressed 609760283 645117676 0.95
duckdb / vortex-compact (0.889x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 54986274 67196223 0.82
fineweb_q01/duckdb:vortex-compact 512181372 544543129 0.94
fineweb_q02/duckdb:vortex-compact 525101844 633416026 0.83
fineweb_q03/duckdb:vortex-compact 1571252549 1918258708 0.82
fineweb_q04/duckdb:vortex-compact 1652353546 1972834862 0.84
fineweb_q05/duckdb:vortex-compact 1509821131 1566572975 0.96
fineweb_q06/duckdb:vortex-compact 1441953449 1443754114 1.00
fineweb_q07/duckdb:vortex-compact 1323663055 1448807911 0.91
fineweb_q08/duckdb:vortex-compact 437691558 486171398 0.90
duckdb / parquet (1.017x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1065813155 1040294794 1.02
fineweb_q01/duckdb:parquet 1639619433 1546097639 1.06
fineweb_q02/duckdb:parquet 1569328071 1564278254 1.00
fineweb_q03/duckdb:parquet 3889062152 3740713216 1.04
fineweb_q04/duckdb:parquet 1904755779 1878649455 1.01
fineweb_q05/duckdb:parquet 2632909051 2585516850 1.02
fineweb_q06/duckdb:parquet 3275397870 3301025210 0.99
fineweb_q07/duckdb:parquet 3845935183 3884382992 0.99
fineweb_q08/duckdb:parquet 1093794697 1078024308 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +34.4% +4.5% +28.6% +158.0% ➖ noise
0 datafusion:vortex-file-compressed +4.6% +4.5% +0.1% +199.9% ➖ noise
0 duckdb:vortex-compact -18.2% +4.5% -21.7% +44.5% ➖ noise
0 duckdb:vortex-file-compressed +11.2% +4.5% +6.4% +30.0% ➖ noise
1 datafusion:vortex-compact +1.0% +3.3% -2.3% +59.7% ➖ noise
1 datafusion:vortex-file-compressed -2.1% +3.3% -5.3% +130.2% ➖ noise
1 duckdb:vortex-compact -5.9% +3.3% -8.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -3.5% +3.3% -6.6% +30.0% ➖ noise
2 datafusion:vortex-compact -7.7% -2.4% -5.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -1.9% -2.4% +0.6% +30.0% ➖ noise
2 duckdb:vortex-compact -17.1% -2.4% -15.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +7.3% -2.4% +9.9% +30.0% ➖ noise
3 datafusion:vortex-compact -5.6% +6.1% -11.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -1.8% +6.1% -7.4% +30.0% ➖ noise
3 duckdb:vortex-compact -18.1% +6.1% -22.8% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +0.4% +6.1% -5.4% +30.0% ➖ noise
4 datafusion:vortex-compact -4.3% +4.1% -8.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -1.4% +4.1% -5.2% +30.0% ➖ noise
4 duckdb:vortex-compact -16.2% +4.1% -19.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -7.8% +4.1% -11.4% +30.0% ➖ noise
5 datafusion:vortex-compact +0.3% +7.3% -6.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +1.6% +7.3% -5.2% +30.0% ➖ noise
5 duckdb:vortex-compact -3.6% +7.3% -10.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -10.4% +7.3% -16.5% +30.0% ➖ noise
6 datafusion:vortex-compact -0.4% +0.5% -0.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +5.6% +0.5% +5.0% +30.0% ➖ noise
6 duckdb:vortex-compact -0.1% +0.5% -0.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -4.9% +0.5% -5.4% +30.0% ➖ noise
7 datafusion:vortex-compact +0.9% -0.4% +1.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +7.6% -0.4% +8.1% +30.0% ➖ noise
7 duckdb:vortex-compact -8.6% -0.4% -8.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -23.0% -0.4% -22.7% +30.0% ➖ noise
8 datafusion:vortex-compact +5.2% +0.6% +4.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +27.1% +0.6% +26.4% +30.0% ➖ noise
8 duckdb:vortex-compact -10.0% +0.6% -10.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.5% +0.6% -6.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.4%


duckdb / vortex-file-compressed (1.030x ➖, 0↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11251942 10720961 1.05
statpopgen_q01/duckdb:vortex-file-compressed 🚨 27604086 19256502 1.43
statpopgen_q02/duckdb:vortex-file-compressed 1307748674 1308568897 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3009067980 3074375015 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3040265511 3120995025 0.97
statpopgen_q05/duckdb:vortex-file-compressed 1366667847 1380364878 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2052145958 2059777371 1.00
statpopgen_q07/duckdb:vortex-file-compressed 224414667 226060565 0.99
statpopgen_q08/duckdb:vortex-file-compressed 234461314 242478690 0.97
statpopgen_q09/duckdb:vortex-file-compressed 2850090730 2803325748 1.02
statpopgen_q10/duckdb:vortex-file-compressed 4579823887 4586107231 1.00
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10966255 10559256 1.04
statpopgen_q01/duckdb:vortex-compact 168735703 166815768 1.01
statpopgen_q02/duckdb:vortex-compact 1813352343 1795939557 1.01
statpopgen_q03/duckdb:vortex-compact 3499744437 3515231425 1.00
statpopgen_q04/duckdb:vortex-compact 3517782982 3510745035 1.00
statpopgen_q05/duckdb:vortex-compact 1853387189 1805714514 1.03
statpopgen_q06/duckdb:vortex-compact 2662404579 2660208050 1.00
statpopgen_q07/duckdb:vortex-compact 957693545 954446127 1.00
statpopgen_q08/duckdb:vortex-compact 992215666 994621871 1.00
statpopgen_q09/duckdb:vortex-compact 3361511853 3308276463 1.02
statpopgen_q10/duckdb:vortex-compact 5356692123 5418236494 0.99
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 307192336 310646570 0.99
statpopgen_q01/duckdb:parquet 394130887 387029725 1.02
statpopgen_q02/duckdb:parquet 980100649 993063607 0.99
statpopgen_q03/duckdb:parquet 1480010531 1487995906 0.99
statpopgen_q04/duckdb:parquet 1498713035 1512651351 0.99
statpopgen_q05/duckdb:parquet 984109207 993387474 0.99
statpopgen_q06/duckdb:parquet 1469034561 1477267873 0.99
statpopgen_q07/duckdb:parquet 1888007724 1900199219 0.99
statpopgen_q08/duckdb:parquet 1866254858 1870713660 1.00
statpopgen_q09/duckdb:parquet 1370010807 1388466267 0.99
statpopgen_q10/duckdb:parquet 2606612589 2647980800 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +3.9% -1.1% +5.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +5.0% -1.1% +6.1% +10.0% ➖ noise
1 duckdb:vortex-compact +1.2% +1.8% -0.7% +25.2% ➖ noise
1 duckdb:vortex-file-compressed +43.3% +1.8% +40.8% +249.6% ➖ noise
2 duckdb:vortex-compact +1.0% -1.3% +2.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.1% -1.3% +1.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.4% -0.5% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.1% -0.5% -1.6% +10.0% ➖ noise
4 duckdb:vortex-compact +0.2% -0.9% +1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.6% -0.9% -1.7% +10.0% ➖ noise
5 duckdb:vortex-compact +2.6% -0.9% +3.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% -0.9% -0.1% +10.0% ➖ noise
6 duckdb:vortex-compact +0.1% -0.6% +0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% -0.6% +0.2% +10.0% ➖ noise
7 duckdb:vortex-compact +0.3% -0.6% +1.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.7% -0.6% -0.1% +10.0% ➖ noise
8 duckdb:vortex-compact -0.2% -0.2% -0.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.3% -0.2% -3.1% +10.0% ➖ noise
9 duckdb:vortex-compact +1.6% -1.3% +3.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.7% -1.3% +3.0% +10.0% ➖ noise
10 duckdb:vortex-compact -1.1% -1.6% +0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.1% -1.6% +1.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish -0.5%


datafusion / vortex-file-compressed (1.046x ➖, 0↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 726063493 673045125 1.08
tpch_q02/datafusion:vortex-file-compressed 619324543 666884062 0.93
tpch_q03/datafusion:vortex-file-compressed 823863530 796510019 1.03
tpch_q04/datafusion:vortex-file-compressed 🚨 806563273 583797381 1.38
tpch_q05/datafusion:vortex-file-compressed 1031160074 942108666 1.09
tpch_q06/datafusion:vortex-file-compressed 777482470 624742228 1.24
tpch_q07/datafusion:vortex-file-compressed 1003130355 1040839530 0.96
tpch_q08/datafusion:vortex-file-compressed 1118985244 1083367285 1.03
tpch_q09/datafusion:vortex-file-compressed 1243688236 1230657701 1.01
tpch_q10/datafusion:vortex-file-compressed 936738217 951070605 0.98
tpch_q11/datafusion:vortex-file-compressed 458942343 471365066 0.97
tpch_q12/datafusion:vortex-file-compressed 954720437 881415226 1.08
tpch_q13/datafusion:vortex-file-compressed 458811448 435046365 1.05
tpch_q14/datafusion:vortex-file-compressed 624461758 563293004 1.11
tpch_q15/datafusion:vortex-file-compressed 1042932943 1024687855 1.02
tpch_q16/datafusion:vortex-file-compressed 298073021 369400008 0.81
tpch_q17/datafusion:vortex-file-compressed 1212547781 1158021711 1.05
tpch_q18/datafusion:vortex-file-compressed 1284977206 1228970479 1.05
tpch_q19/datafusion:vortex-file-compressed 718056492 739522603 0.97
tpch_q20/datafusion:vortex-file-compressed 943793349 863765528 1.09
tpch_q21/datafusion:vortex-file-compressed 1644142952 1540346148 1.07
tpch_q22/datafusion:vortex-file-compressed 425911986 380903899 1.12
datafusion / vortex-compact (1.031x ➖, 0↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 796560416 746458412 1.07
tpch_q02/datafusion:vortex-compact 577764494 650317349 0.89
tpch_q03/datafusion:vortex-compact 741731246 760169564 0.98
tpch_q04/datafusion:vortex-compact 564737552 543393655 1.04
tpch_q05/datafusion:vortex-compact 907400662 847168322 1.07
tpch_q06/datafusion:vortex-compact 612271786 615430809 0.99
tpch_q07/datafusion:vortex-compact 1018658143 1019673020 1.00
tpch_q08/datafusion:vortex-compact 1032866715 1066491580 0.97
tpch_q09/datafusion:vortex-compact 1173592949 1210819184 0.97
tpch_q10/datafusion:vortex-compact 864937230 834932947 1.04
tpch_q11/datafusion:vortex-compact 378748059 372029445 1.02
tpch_q12/datafusion:vortex-compact 841842043 728141155 1.16
tpch_q13/datafusion:vortex-compact 406161966 404020656 1.01
tpch_q14/datafusion:vortex-compact 🚨 729182595 555040164 1.31
tpch_q15/datafusion:vortex-compact 1094422225 1036490324 1.06
tpch_q16/datafusion:vortex-compact 315368611 302755519 1.04
tpch_q17/datafusion:vortex-compact 1250403351 1131919156 1.10
tpch_q18/datafusion:vortex-compact 1115129096 1081547835 1.03
tpch_q19/datafusion:vortex-compact 726379303 729897603 1.00
tpch_q20/datafusion:vortex-compact 826583661 822573036 1.00
tpch_q21/datafusion:vortex-compact 1360601681 1399628411 0.97
tpch_q22/datafusion:vortex-compact 349111716 334050740 1.05
datafusion / parquet (1.024x ➖, 0↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 790168247 864492964 0.91
tpch_q02/datafusion:parquet 580500396 588295163 0.99
tpch_q03/datafusion:parquet 882169261 930325559 0.95
tpch_q04/datafusion:parquet 457127453 429516353 1.06
tpch_q05/datafusion:parquet 1126893768 1112473256 1.01
tpch_q06/datafusion:parquet 532210145 502276199 1.06
tpch_q07/datafusion:parquet 1265829707 1192539404 1.06
tpch_q08/datafusion:parquet 1525864274 1425626136 1.07
tpch_q09/datafusion:parquet 1734308244 1625649206 1.07
tpch_q10/datafusion:parquet 2015935747 1973061516 1.02
tpch_q11/datafusion:parquet 492307413 466177628 1.06
tpch_q12/datafusion:parquet 678525518 637389646 1.06
tpch_q13/datafusion:parquet 699164131 705256878 0.99
tpch_q14/datafusion:parquet 762300051 753609356 1.01
tpch_q15/datafusion:parquet 1153672035 1187213076 0.97
tpch_q16/datafusion:parquet 343189833 350674466 0.98
tpch_q17/datafusion:parquet 1278511161 1344468666 0.95
tpch_q18/datafusion:parquet 1445410153 1427261779 1.01
tpch_q19/datafusion:parquet 919254948 935024776 0.98
tpch_q20/datafusion:parquet 1040859349 1051230044 0.99
tpch_q21/datafusion:parquet 1669374329 1626146842 1.03
tpch_q22/datafusion:parquet 🚨 893775085 657002014 1.36
duckdb / vortex-file-compressed (0.981x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 603028928 653261439 0.92
tpch_q02/duckdb:vortex-file-compressed 1093779989 1125627195 0.97
tpch_q03/duckdb:vortex-file-compressed 915263952 917885353 1.00
tpch_q04/duckdb:vortex-file-compressed 625593685 575660818 1.09
tpch_q05/duckdb:vortex-file-compressed 1035075920 1051714524 0.98
tpch_q06/duckdb:vortex-file-compressed 737277416 811766004 0.91
tpch_q07/duckdb:vortex-file-compressed 1005684698 1114889794 0.90
tpch_q08/duckdb:vortex-file-compressed 1463384220 1362706680 1.07
tpch_q09/duckdb:vortex-file-compressed 1444605979 1460448772 0.99
tpch_q10/duckdb:vortex-file-compressed 1132237275 990383922 1.14
tpch_q11/duckdb:vortex-file-compressed 527891945 591352734 0.89
tpch_q12/duckdb:vortex-file-compressed 735776540 666455254 1.10
tpch_q13/duckdb:vortex-file-compressed 869050722 871946058 1.00
tpch_q14/duckdb:vortex-file-compressed 824175802 882057166 0.93
tpch_q15/duckdb:vortex-file-compressed 527938768 561422479 0.94
tpch_q16/duckdb:vortex-file-compressed 412365359 479010972 0.86
tpch_q17/duckdb:vortex-file-compressed 979068699 1005069477 0.97
tpch_q18/duckdb:vortex-file-compressed 815143210 950556494 0.86
tpch_q19/duckdb:vortex-file-compressed 779323179 733792751 1.06
tpch_q20/duckdb:vortex-file-compressed 1361280226 1263261531 1.08
tpch_q21/duckdb:vortex-file-compressed 1952606088 1917661012 1.02
tpch_q22/duckdb:vortex-file-compressed 526782918 552330677 0.95
duckdb / vortex-compact (0.972x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 575289762 618262250 0.93
tpch_q02/duckdb:vortex-compact 1030735697 977377764 1.05
tpch_q03/duckdb:vortex-compact 797307166 855828726 0.93
tpch_q04/duckdb:vortex-compact 478758110 525687944 0.91
tpch_q05/duckdb:vortex-compact 1027784804 959863946 1.07
tpch_q06/duckdb:vortex-compact 690287674 798487376 0.86
tpch_q07/duckdb:vortex-compact 1047422252 995767247 1.05
tpch_q08/duckdb:vortex-compact 1315817476 1363747929 0.96
tpch_q09/duckdb:vortex-compact 1298771020 1319303626 0.98
tpch_q10/duckdb:vortex-compact 952281123 1067591788 0.89
tpch_q11/duckdb:vortex-compact 672940897 649271552 1.04
tpch_q12/duckdb:vortex-compact 607548104 640124508 0.95
tpch_q13/duckdb:vortex-compact 843599786 869668212 0.97
tpch_q14/duckdb:vortex-compact 806136815 814789588 0.99
tpch_q15/duckdb:vortex-compact 511214085 553665194 0.92
tpch_q16/duckdb:vortex-compact 411040457 449626526 0.91
tpch_q17/duckdb:vortex-compact 887133297 925901897 0.96
tpch_q18/duckdb:vortex-compact 730165687 714334048 1.02
tpch_q19/duckdb:vortex-compact 714395811 758862052 0.94
tpch_q20/duckdb:vortex-compact 1160510476 1199425396 0.97
tpch_q21/duckdb:vortex-compact 1644367326 1586110602 1.04
tpch_q22/duckdb:vortex-compact 616324868 577750884 1.07
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 897371492 849542727 1.06
tpch_q02/duckdb:parquet 1550732516 1540065310 1.01
tpch_q03/duckdb:parquet 1597082283 1492141516 1.07
tpch_q04/duckdb:parquet 1021674951 908738288 1.12
tpch_q05/duckdb:parquet 2136976418 2145553010 1.00
tpch_q06/duckdb:parquet 624336382 751808946 0.83
tpch_q07/duckdb:parquet 1664060218 1762201042 0.94
tpch_q08/duckdb:parquet 2395746554 2359809659 1.02
tpch_q09/duckdb:parquet 2181633568 2198831880 0.99
tpch_q10/duckdb:parquet 2861318159 3262999638 0.88
tpch_q11/duckdb:parquet 905167978 978587082 0.92
tpch_q12/duckdb:parquet 923582379 920485263 1.00
tpch_q13/duckdb:parquet 1156197766 1177265375 0.98
tpch_q14/duckdb:parquet 1165191554 1149361973 1.01
tpch_q15/duckdb:parquet 763297776 824201468 0.93
tpch_q16/duckdb:parquet 838133691 734845671 1.14
tpch_q17/duckdb:parquet 1236413262 1115066724 1.11
tpch_q18/duckdb:parquet 1266825512 1367605306 0.93
tpch_q19/duckdb:parquet 1567206103 1436570321 1.09
tpch_q20/duckdb:parquet 1651778275 1658476746 1.00
tpch_q21/duckdb:parquet 1848415795 1730895251 1.07
tpch_q22/duckdb:parquet 1012079642 959681059 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +6.7% -1.7% +8.6% +50.6% ➖ noise
1 datafusion:vortex-file-compressed +7.9% -1.7% +9.8% +69.9% ➖ noise
1 duckdb:vortex-compact -7.0% -1.7% -5.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -7.7% -1.7% -6.1% +30.7% ➖ noise
2 datafusion:vortex-compact -11.2% -0.3% -10.9% +72.8% ➖ noise
2 datafusion:vortex-file-compressed -7.1% -0.3% -6.8% +80.9% ➖ noise
2 duckdb:vortex-compact +5.5% -0.3% +5.8% +31.3% ➖ noise
2 duckdb:vortex-file-compressed -2.8% -0.3% -2.5% +31.8% ➖ noise
3 datafusion:vortex-compact -2.4% +0.7% -3.1% +66.8% ➖ noise
3 datafusion:vortex-file-compressed +3.4% +0.7% +2.7% +92.5% ➖ noise
3 duckdb:vortex-compact -6.8% +0.7% -7.5% +33.2% ➖ noise
3 duckdb:vortex-file-compressed -0.3% +0.7% -1.0% +31.3% ➖ noise
4 datafusion:vortex-compact +3.9% +9.4% -5.0% +31.5% ➖ noise
4 datafusion:vortex-file-compressed +38.2% +9.4% +26.3% +40.1% ➖ noise
4 duckdb:vortex-compact -8.9% +9.4% -16.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +8.7% +9.4% -0.7% +30.0% ➖ noise
5 datafusion:vortex-compact +7.1% +0.4% +6.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +9.5% +0.4% +9.0% +30.0% ➖ noise
5 duckdb:vortex-compact +7.1% +0.4% +6.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.6% +0.4% -2.0% +30.0% ➖ noise
6 datafusion:vortex-compact -0.5% -6.2% +6.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +24.4% -6.2% +32.7% +30.0% 🚨 regression
6 duckdb:vortex-compact -13.6% -6.2% -7.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -9.2% -6.2% -3.2% +30.0% ➖ noise
7 datafusion:vortex-compact -0.1% +0.1% -0.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -3.6% +0.1% -3.7% +30.0% ➖ noise
7 duckdb:vortex-compact +5.2% +0.1% +5.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -9.8% +0.1% -9.9% +30.0% ➖ noise
8 datafusion:vortex-compact -3.2% +4.2% -7.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +3.3% +4.2% -0.9% +30.0% ➖ noise
8 duckdb:vortex-compact -3.5% +4.2% -7.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +7.4% +4.2% +3.0% +30.0% ➖ noise
9 datafusion:vortex-compact -3.1% +2.9% -5.8% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +1.1% +2.9% -1.8% +30.0% ➖ noise
9 duckdb:vortex-compact -1.6% +2.9% -4.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -1.1% +2.9% -3.9% +30.0% ➖ noise
10 datafusion:vortex-compact +3.6% -5.3% +9.4% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -1.5% -5.3% +4.1% +30.0% ➖ noise
10 duckdb:vortex-compact -10.8% -5.3% -5.8% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +14.3% -5.3% +20.8% +31.3% ➖ noise
11 datafusion:vortex-compact +1.8% -1.2% +3.0% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -2.6% -1.2% -1.5% +30.6% ➖ noise
11 duckdb:vortex-compact +3.6% -1.2% +4.9% +30.8% ➖ noise
11 duckdb:vortex-file-compressed -10.7% -1.2% -9.7% +30.0% ➖ noise
12 datafusion:vortex-compact +15.6% +3.3% +11.9% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +8.3% +3.3% +4.8% +30.0% ➖ noise
12 duckdb:vortex-compact -5.1% +3.3% -8.2% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +10.4% +3.3% +6.8% +40.4% ➖ noise
13 datafusion:vortex-compact +0.5% -1.3% +1.9% +39.9% ➖ noise
13 datafusion:vortex-file-compressed +5.5% -1.3% +6.9% +30.0% ➖ noise
13 duckdb:vortex-compact -3.0% -1.3% -1.7% +33.1% ➖ noise
13 duckdb:vortex-file-compressed -0.3% -1.3% +1.0% +41.5% ➖ noise
14 datafusion:vortex-compact +31.4% +1.3% +29.7% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +10.9% +1.3% +9.5% +30.0% ➖ noise
14 duckdb:vortex-compact -1.1% +1.3% -2.3% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -6.6% +1.3% -7.7% +30.0% ➖ noise
15 datafusion:vortex-compact +5.6% -5.1% +11.3% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +1.8% -5.1% +7.3% +30.0% ➖ noise
15 duckdb:vortex-compact -7.7% -5.1% -2.7% +30.6% ➖ noise
15 duckdb:vortex-file-compressed -6.0% -5.1% -0.9% +30.0% ➖ noise
16 datafusion:vortex-compact +4.2% +5.7% -1.4% +55.2% ➖ noise
16 datafusion:vortex-file-compressed -19.3% +5.7% -23.6% +44.4% ➖ noise
16 duckdb:vortex-compact -8.6% +5.7% -13.5% +33.7% ➖ noise
16 duckdb:vortex-file-compressed -13.9% +5.7% -18.5% +30.0% ➖ noise
17 datafusion:vortex-compact +10.5% +2.7% +7.6% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +4.7% +2.7% +2.0% +30.0% ➖ noise
17 duckdb:vortex-compact -4.2% +2.7% -6.7% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -2.6% +2.7% -5.1% +30.0% ➖ noise
18 datafusion:vortex-compact +3.1% -3.1% +6.5% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +4.6% -3.1% +8.0% +30.0% ➖ noise
18 duckdb:vortex-compact +2.2% -3.1% +5.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -14.2% -3.1% -11.5% +30.0% ➖ noise
19 datafusion:vortex-compact -0.5% +3.6% -3.9% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -2.9% +3.6% -6.2% +30.0% ➖ noise
19 duckdb:vortex-compact -5.9% +3.6% -9.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +6.2% +3.6% +2.6% +30.0% ➖ noise
20 datafusion:vortex-compact +0.5% -0.7% +1.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +9.3% -0.7% +10.0% +30.0% ➖ noise
20 duckdb:vortex-compact -3.2% -0.7% -2.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +7.8% -0.7% +8.5% +30.0% ➖ noise
21 datafusion:vortex-compact -2.8% +4.7% -7.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +6.7% +4.7% +1.9% +30.0% ➖ noise
21 duckdb:vortex-compact +3.7% +4.7% -1.0% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +1.8% +4.7% -2.8% +30.0% ➖ noise
22 datafusion:vortex-compact +4.5% +19.8% -12.7% +30.7% ➖ noise
22 datafusion:vortex-file-compressed +11.8% +19.8% -6.6% +45.1% ➖ noise
22 duckdb:vortex-compact +6.7% +19.8% -10.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -4.6% +19.8% -20.4% +34.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 4, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.8%


datafusion / vortex-file-compressed (1.036x ➖, 0↑ 4↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1934921 1899738 1.02
clickbench_q01/datafusion:vortex-file-compressed 🚨 14675786 13259562 1.11
clickbench_q02/datafusion:vortex-file-compressed 33619430 33288243 1.01
clickbench_q03/datafusion:vortex-file-compressed 38126701 38256531 1.00
clickbench_q04/datafusion:vortex-file-compressed 305191902 305848993 1.00
clickbench_q05/datafusion:vortex-file-compressed 318415678 319869319 1.00
clickbench_q06/datafusion:vortex-file-compressed 2013704 1910940 1.05
clickbench_q07/datafusion:vortex-file-compressed 18276646 18175469 1.01
clickbench_q08/datafusion:vortex-file-compressed 381770040 370246519 1.03
clickbench_q09/datafusion:vortex-file-compressed 592164625 551807493 1.07
clickbench_q10/datafusion:vortex-file-compressed 74687394 72125507 1.04
clickbench_q11/datafusion:vortex-file-compressed 84719562 84167814 1.01
clickbench_q12/datafusion:vortex-file-compressed 275851842 283873350 0.97
clickbench_q13/datafusion:vortex-file-compressed 424380815 412412779 1.03
clickbench_q14/datafusion:vortex-file-compressed 260667586 255623870 1.02
clickbench_q15/datafusion:vortex-file-compressed 370401561 362987731 1.02
clickbench_q16/datafusion:vortex-file-compressed 702855785 692139654 1.02
clickbench_q17/datafusion:vortex-file-compressed 688220589 687689277 1.00
clickbench_q18/datafusion:vortex-file-compressed 1391446390 1370754465 1.02
clickbench_q19/datafusion:vortex-file-compressed 25181676 23209453 1.08
clickbench_q20/datafusion:vortex-file-compressed 352486918 352521496 1.00
clickbench_q21/datafusion:vortex-file-compressed 411088250 403411339 1.02
clickbench_q22/datafusion:vortex-file-compressed 508044063 489385798 1.04
clickbench_q23/datafusion:vortex-file-compressed 🚨 1045777141 773203696 1.35
clickbench_q24/datafusion:vortex-file-compressed 45196209 43976633 1.03
clickbench_q25/datafusion:vortex-file-compressed 70979739 68227727 1.04
clickbench_q26/datafusion:vortex-file-compressed 🚨 49908662 45333454 1.10
clickbench_q27/datafusion:vortex-file-compressed 822316878 796382811 1.03
clickbench_q28/datafusion:vortex-file-compressed 6805559321 6667216256 1.02
clickbench_q29/datafusion:vortex-file-compressed 240562113 239024152 1.01
clickbench_q30/datafusion:vortex-file-compressed 235033905 229888637 1.02
clickbench_q31/datafusion:vortex-file-compressed 272536604 269353359 1.01
clickbench_q32/datafusion:vortex-file-compressed 🚨 1375990455 1174816356 1.17
clickbench_q33/datafusion:vortex-file-compressed 1482040326 1404310859 1.06
clickbench_q34/datafusion:vortex-file-compressed 1412999095 1385040534 1.02
clickbench_q35/datafusion:vortex-file-compressed 521563969 509255877 1.02
clickbench_q36/datafusion:vortex-file-compressed 79977805 80941153 0.99
clickbench_q37/datafusion:vortex-file-compressed 40409094 41031982 0.98
clickbench_q38/datafusion:vortex-file-compressed 22997917 23480080 0.98
clickbench_q39/datafusion:vortex-file-compressed 151497591 143852299 1.05
clickbench_q40/datafusion:vortex-file-compressed 19317412 18366963 1.05
clickbench_q41/datafusion:vortex-file-compressed 18486305 16940942 1.09
clickbench_q42/datafusion:vortex-file-compressed 19270669 18693000 1.03
datafusion / parquet (1.008x ➖, 0↑ 2↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2000269 1804483 1.11
clickbench_q01/datafusion:parquet 21516252 20688867 1.04
clickbench_q02/datafusion:parquet 56893364 55665378 1.02
clickbench_q03/datafusion:parquet 45178658 45651253 0.99
clickbench_q04/datafusion:parquet 328242960 349856419 0.94
clickbench_q05/datafusion:parquet 378055701 375055325 1.01
clickbench_q06/datafusion:parquet 1854952 1773257 1.05
clickbench_q07/datafusion:parquet 26446400 26785510 0.99
clickbench_q08/datafusion:parquet 415046596 408621478 1.02
clickbench_q09/datafusion:parquet 643382495 641302148 1.00
clickbench_q10/datafusion:parquet 116008660 108973022 1.06
clickbench_q11/datafusion:parquet 137990149 133054946 1.04
clickbench_q12/datafusion:parquet 376742946 364941952 1.03
clickbench_q13/datafusion:parquet 🚨 567998933 510350067 1.11
clickbench_q14/datafusion:parquet 363607374 353334357 1.03
clickbench_q15/datafusion:parquet 394264085 380643257 1.04
clickbench_q16/datafusion:parquet 722891392 718965190 1.01
clickbench_q17/datafusion:parquet 670805803 673270055 1.00
clickbench_q18/datafusion:parquet 1380356231 1383081231 1.00
clickbench_q19/datafusion:parquet 32345593 33501650 0.97
clickbench_q20/datafusion:parquet 596228927 596914874 1.00
clickbench_q21/datafusion:parquet 660105340 657214689 1.00
clickbench_q22/datafusion:parquet 966038995 964993695 1.00
clickbench_q23/datafusion:parquet 3637275863 3640872725 1.00
clickbench_q24/datafusion:parquet 84534415 88877518 0.95
clickbench_q25/datafusion:parquet 138314081 140277493 0.99
clickbench_q26/datafusion:parquet 85664844 87344910 0.98
clickbench_q27/datafusion:parquet 1053016543 1038973373 1.01
clickbench_q28/datafusion:parquet 6425966800 6500168150 0.99
clickbench_q29/datafusion:parquet 239929243 239575737 1.00
clickbench_q30/datafusion:parquet 364096505 357518764 1.02
clickbench_q31/datafusion:parquet 397928990 382874401 1.04
clickbench_q32/datafusion:parquet 1211743740 1173656094 1.03
clickbench_q33/datafusion:parquet 1518333911 1506143239 1.01
clickbench_q34/datafusion:parquet 1516798643 1501178538 1.01
clickbench_q35/datafusion:parquet 521533369 530559863 0.98
clickbench_q36/datafusion:parquet 144790307 149310686 0.97
clickbench_q37/datafusion:parquet 59457095 61781112 0.96
clickbench_q38/datafusion:parquet 93513153 88214390 1.06
clickbench_q39/datafusion:parquet 271577158 274565271 0.99
clickbench_q40/datafusion:parquet 34006072 35245047 0.96
clickbench_q41/datafusion:parquet 29931852 30501629 0.98
clickbench_q42/datafusion:parquet 32285612 31996948 1.01
duckdb / vortex-file-compressed (1.002x ➖, 1↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6376148 5929347 1.08
clickbench_q01/duckdb:vortex-file-compressed 13569895 13738972 0.99
clickbench_q02/duckdb:vortex-file-compressed 24583324 25305412 0.97
clickbench_q03/duckdb:vortex-file-compressed 30296460 30249652 1.00
clickbench_q04/duckdb:vortex-file-compressed 171086749 172981647 0.99
clickbench_q05/duckdb:vortex-file-compressed 196011791 198987777 0.99
clickbench_q06/duckdb:vortex-file-compressed 17841530 17977735 0.99
clickbench_q07/duckdb:vortex-file-compressed 14916120 15056370 0.99
clickbench_q08/duckdb:vortex-file-compressed 262407245 262059708 1.00
clickbench_q09/duckdb:vortex-file-compressed 377233626 378107365 1.00
clickbench_q10/duckdb:vortex-file-compressed 74100703 74343453 1.00
clickbench_q11/duckdb:vortex-file-compressed 84607367 82777794 1.02
clickbench_q12/duckdb:vortex-file-compressed 218079859 208720195 1.04
clickbench_q13/duckdb:vortex-file-compressed 437758760 433519409 1.01
clickbench_q14/duckdb:vortex-file-compressed 241814005 241863246 1.00
clickbench_q15/duckdb:vortex-file-compressed 212604535 209527816 1.01
clickbench_q16/duckdb:vortex-file-compressed 598938647 649877333 0.92
clickbench_q17/duckdb:vortex-file-compressed 497233342 538540823 0.92
clickbench_q18/duckdb:vortex-file-compressed 1151555107 1229730378 0.94
clickbench_q19/duckdb:vortex-file-compressed 21591610 20511301 1.05
clickbench_q20/duckdb:vortex-file-compressed 369446626 369922179 1.00
clickbench_q21/duckdb:vortex-file-compressed 410447868 393913748 1.04
clickbench_q22/duckdb:vortex-file-compressed 646183312 648116644 1.00
clickbench_q23/duckdb:vortex-file-compressed 🚀 1083921027 1278329487 0.85
clickbench_q24/duckdb:vortex-file-compressed 46784900 49284874 0.95
clickbench_q25/duckdb:vortex-file-compressed 76419644 75118467 1.02
clickbench_q26/duckdb:vortex-file-compressed 41920587 43564023 0.96
clickbench_q27/duckdb:vortex-file-compressed 499032381 494379174 1.01
clickbench_q28/duckdb:vortex-file-compressed 2972968935 2988747138 0.99
clickbench_q29/duckdb:vortex-file-compressed 27716879 27467971 1.01
clickbench_q30/duckdb:vortex-file-compressed 182482914 180903360 1.01
clickbench_q31/duckdb:vortex-file-compressed 259813377 259143972 1.00
clickbench_q32/duckdb:vortex-file-compressed 1315405410 1296440827 1.01
clickbench_q33/duckdb:vortex-file-compressed 1439438801 1495685860 0.96
clickbench_q34/duckdb:vortex-file-compressed 1573608529 1546222869 1.02
clickbench_q35/duckdb:vortex-file-compressed 370378289 368706071 1.00
clickbench_q36/duckdb:vortex-file-compressed 34048288 33246964 1.02
clickbench_q37/duckdb:vortex-file-compressed 25381491 23356342 1.09
clickbench_q38/duckdb:vortex-file-compressed 26205897 25058915 1.05
clickbench_q39/duckdb:vortex-file-compressed 47368308 44465684 1.07
clickbench_q40/duckdb:vortex-file-compressed 24219072 24305842 1.00
clickbench_q41/duckdb:vortex-file-compressed 🚨 25257591 22702790 1.11
clickbench_q42/duckdb:vortex-file-compressed 25324497 23795210 1.06
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 225868054 216325884 1.04
clickbench_q01/duckdb:parquet 51353346 51257538 1.00
clickbench_q02/duckdb:parquet 65171749 65097040 1.00
clickbench_q03/duckdb:parquet 63414569 64117131 0.99
clickbench_q04/duckdb:parquet 206278301 202011307 1.02
clickbench_q05/duckdb:parquet 284151380 277813332 1.02
clickbench_q06/duckdb:parquet 61059147 60652188 1.01
clickbench_q07/duckdb:parquet 52248879 53253677 0.98
clickbench_q08/duckdb:parquet 270392189 267847090 1.01
clickbench_q09/duckdb:parquet 397306426 396656783 1.00
clickbench_q10/duckdb:parquet 95461956 96969706 0.98
clickbench_q11/duckdb:parquet 111563371 110959537 1.01
clickbench_q12/duckdb:parquet 303251441 294275517 1.03
clickbench_q13/duckdb:parquet 522800775 522302536 1.00
clickbench_q14/duckdb:parquet 330389818 333395227 0.99
clickbench_q15/duckdb:parquet 243565738 241924243 1.01
clickbench_q16/duckdb:parquet 614331719 615725332 1.00
clickbench_q17/duckdb:parquet 517487526 510007173 1.01
clickbench_q18/duckdb:parquet 1061141736 1051821520 1.01
clickbench_q19/duckdb:parquet 48407907 49268925 0.98
clickbench_q20/duckdb:parquet 432092476 438325017 0.99
clickbench_q21/duckdb:parquet 563759102 555758063 1.01
clickbench_q22/duckdb:parquet 928083657 919820696 1.01
clickbench_q23/duckdb:parquet 319580434 312179526 1.02
clickbench_q24/duckdb:parquet 79321245 78667994 1.01
clickbench_q25/duckdb:parquet 140656891 139856581 1.01
clickbench_q26/duckdb:parquet 53270843 54013363 0.99
clickbench_q27/duckdb:parquet 641530796 644086234 1.00
clickbench_q28/duckdb:parquet 4863171490 4852508907 1.00
clickbench_q29/duckdb:parquet 61564296 62078445 0.99
clickbench_q30/duckdb:parquet 306748915 304187393 1.01
clickbench_q31/duckdb:parquet 352570269 350071384 1.01
clickbench_q32/duckdb:parquet 1187958579 1160426909 1.02
clickbench_q33/duckdb:parquet 1272853901 1285943193 0.99
clickbench_q34/duckdb:parquet 1314622024 1312707332 1.00
clickbench_q35/duckdb:parquet 352780221 351878702 1.00
clickbench_q36/duckdb:parquet 64391250 64965476 0.99
clickbench_q37/duckdb:parquet 54506299 53485181 1.02
clickbench_q38/duckdb:parquet 58390164 58457089 1.00
clickbench_q39/duckdb:parquet 97459934 97372844 1.00
clickbench_q40/duckdb:parquet 55415913 55012825 1.01
clickbench_q41/duckdb:parquet 60087080 58482263 1.03
clickbench_q42/duckdb:parquet 49247416 51642471 0.95
duckdb / duckdb (0.994x ➖, 4↑ 1↓)
name PR 9f41fc3 (ns) base b2a5a70 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 20154756 17588932 1.15
clickbench_q01/duckdb:duckdb 36765481 33850443 1.09
clickbench_q02/duckdb:duckdb 49218558 46181790 1.07
clickbench_q03/duckdb:duckdb 49888152 47084946 1.06
clickbench_q04/duckdb:duckdb 209787434 225992851 0.93
clickbench_q05/duckdb:duckdb 317495769 342216053 0.93
clickbench_q06/duckdb:duckdb 38357432 36093612 1.06
clickbench_q07/duckdb:duckdb 38735318 36161343 1.07
clickbench_q08/duckdb:duckdb 303540135 321892887 0.94
clickbench_q09/duckdb:duckdb 473767663 503894403 0.94
clickbench_q10/duckdb:duckdb 99816526 96798243 1.03
clickbench_q11/duckdb:duckdb 108928010 106154013 1.03
clickbench_q12/duckdb:duckdb 292311682 311936107 0.94
clickbench_q13/duckdb:duckdb 🚀 535874567 604034502 0.89
clickbench_q14/duckdb:duckdb 341407982 355536364 0.96
clickbench_q15/duckdb:duckdb 254932661 276939442 0.92
clickbench_q16/duckdb:duckdb 674607289 710249114 0.95
clickbench_q17/duckdb:duckdb 590067694 606444218 0.97
clickbench_q18/duckdb:duckdb 1269231991 1316113248 0.96
clickbench_q19/duckdb:duckdb 37764470 35193928 1.07
clickbench_q20/duckdb:duckdb 🚀 918281267 1097349675 0.84
clickbench_q21/duckdb:duckdb 🚀 1003245913 1204511951 0.83
clickbench_q22/duckdb:duckdb 1037462042 1112693630 0.93
clickbench_q23/duckdb:duckdb 251323581 250996952 1.00
clickbench_q24/duckdb:duckdb 63992946 62842998 1.02
clickbench_q25/duckdb:duckdb 125744909 125099572 1.01
clickbench_q26/duckdb:duckdb 59368896 58990781 1.01
clickbench_q27/duckdb:duckdb 🚀 991651476 1168153343 0.85
clickbench_q28/duckdb:duckdb 4646647917 4646133232 1.00
clickbench_q29/duckdb:duckdb 51825422 49146855 1.05
clickbench_q30/duckdb:duckdb 299144321 284262731 1.05
clickbench_q31/duckdb:duckdb 434360912 434125301 1.00
clickbench_q32/duckdb:duckdb 1581387243 1543573545 1.02
clickbench_q33/duckdb:duckdb 1941825068 2002287786 0.97
clickbench_q34/duckdb:duckdb 2115721333 2180488180 0.97
clickbench_q35/duckdb:duckdb 264570409 263881029 1.00
clickbench_q36/duckdb:duckdb 39330609 43454915 0.91
clickbench_q37/duckdb:duckdb 34873301 31774361 1.10
clickbench_q38/duckdb:duckdb 34605317 32366456 1.07
clickbench_q39/duckdb:duckdb 71547488 67134682 1.07
clickbench_q40/duckdb:duckdb 34974054 32389955 1.08
clickbench_q41/duckdb:duckdb 32649317 30275988 1.08
clickbench_q42/duckdb:duckdb 34439749 32193451 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +1.9% +7.6% -5.3% +662.4% ➖ noise
0 duckdb:duckdb +14.6% +7.6% +6.5% +291.6% ➖ noise
0 duckdb:vortex-file-compressed +7.5% +7.6% -0.0% +333.8% ➖ noise
1 datafusion:vortex-file-compressed +10.7% +2.1% +8.4% +34.1% ➖ noise
1 duckdb:duckdb +8.6% +2.1% +6.4% +56.5% ➖ noise
1 duckdb:vortex-file-compressed -1.2% +2.1% -3.2% +21.2% ➖ noise
2 datafusion:vortex-file-compressed +1.0% +1.2% -0.2% +30.4% ➖ noise
2 duckdb:duckdb +6.6% +1.2% +5.4% +22.2% ➖ noise
2 duckdb:vortex-file-compressed -2.9% +1.2% -4.0% +14.2% ➖ noise
3 datafusion:vortex-file-compressed -0.3% -1.1% +0.7% +152.3% ➖ noise
3 duckdb:duckdb +6.0% -1.1% +7.1% +55.1% ➖ noise
3 duckdb:vortex-file-compressed +0.2% -1.1% +1.2% +33.1% ➖ noise
4 datafusion:vortex-file-compressed -0.2% -2.1% +1.9% +10.0% ➖ noise
4 duckdb:duckdb -7.2% -2.1% -5.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.1% -2.1% +1.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.5% +1.5% -2.0% +10.0% ➖ noise
5 duckdb:duckdb -7.2% +1.5% -8.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.5% +1.5% -3.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.4% +2.6% +2.7% +41.9% ➖ noise
6 duckdb:duckdb +6.3% +2.6% +3.6% +31.9% ➖ noise
6 duckdb:vortex-file-compressed -0.8% +2.6% -3.3% +19.8% ➖ noise
7 datafusion:vortex-file-compressed +0.6% -1.6% +2.2% +30.0% ➖ noise
7 duckdb:duckdb +7.1% -1.6% +8.8% +13.2% ➖ noise
7 duckdb:vortex-file-compressed -0.9% -1.6% +0.7% +11.2% ➖ noise
8 datafusion:vortex-file-compressed +3.1% +1.3% +1.8% +10.0% ➖ noise
8 duckdb:duckdb -5.7% +1.3% -6.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% +1.3% -1.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +7.3% +0.2% +7.1% +10.0% ➖ noise
9 duckdb:duckdb -6.0% +0.2% -6.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% +0.2% -0.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.6% +2.4% +1.2% +10.4% ➖ noise
10 duckdb:duckdb +3.1% +2.4% +0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.3% +2.4% -2.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.7% +2.1% -1.4% +10.0% ➖ noise
11 duckdb:duckdb +2.6% +2.1% +0.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.2% +2.1% +0.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.8% +3.1% -5.8% +10.0% ➖ noise
12 duckdb:duckdb -6.3% +3.1% -9.1% +10.0% ✅ faster
12 duckdb:vortex-file-compressed +4.5% +3.1% +1.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.9% +5.5% -2.5% +10.0% ➖ noise
13 duckdb:duckdb -11.3% +5.5% -15.9% +10.0% ✅ faster
13 duckdb:vortex-file-compressed +1.0% +5.5% -4.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.0% +1.0% +1.0% +10.0% ➖ noise
14 duckdb:duckdb -4.0% +1.0% -4.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.0% +1.0% -1.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.0% +2.1% -0.1% +10.0% ➖ noise
15 duckdb:duckdb -7.9% +2.1% -9.9% +10.0% ✅ faster
15 duckdb:vortex-file-compressed +1.5% +2.1% -0.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.5% +0.2% +1.4% +10.0% ➖ noise
16 duckdb:duckdb -5.0% +0.2% -5.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -7.8% +0.2% -8.0% +13.2% ➖ noise
17 datafusion:vortex-file-compressed +0.1% +0.5% -0.5% +10.0% ➖ noise
17 duckdb:duckdb -2.7% +0.5% -3.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -7.7% +0.5% -8.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.5% +0.3% +1.2% +10.0% ➖ noise
18 duckdb:duckdb -3.6% +0.3% -3.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -6.4% +0.3% -6.7% +10.5% ➖ noise
19 datafusion:vortex-file-compressed +8.5% -2.6% +11.4% +11.2% 🚨 regression
19 duckdb:duckdb +7.3% -2.6% +10.2% +12.5% ➖ noise
19 duckdb:vortex-file-compressed +5.3% -2.6% +8.1% +33.0% ➖ noise
20 datafusion:vortex-file-compressed -0.0% -0.8% +0.8% +180.9% ➖ noise
20 duckdb:duckdb -16.3% -0.8% -15.7% +29.6% ➖ noise
20 duckdb:vortex-file-compressed -0.1% -0.8% +0.6% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.9% +0.9% +1.0% +10.0% ➖ noise
21 duckdb:duckdb -16.7% +0.9% -17.5% +10.0% ✅ faster
21 duckdb:vortex-file-compressed +4.2% +0.9% +3.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.8% +0.5% +3.3% +10.8% ➖ noise
22 duckdb:duckdb -6.8% +0.5% -7.2% +13.8% ➖ noise
22 duckdb:vortex-file-compressed -0.3% +0.5% -0.8% +19.3% ➖ noise
23 datafusion:vortex-file-compressed +35.3% +1.1% +33.7% +44.0% ➖ noise
23 duckdb:duckdb +0.1% +1.1% -1.0% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -15.2% +1.1% -16.2% +23.1% ➖ noise
24 datafusion:vortex-file-compressed +2.8% -2.1% +4.9% +17.6% ➖ noise
24 duckdb:duckdb +1.8% -2.1% +4.0% +11.9% ➖ noise
24 duckdb:vortex-file-compressed -5.1% -2.1% -3.1% +20.7% ➖ noise
25 datafusion:vortex-file-compressed +4.0% -0.4% +4.5% +11.6% ➖ noise
25 duckdb:duckdb +0.5% -0.4% +0.9% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.7% -0.4% +2.2% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +10.1% -1.6% +11.9% +15.0% ➖ noise
26 duckdb:duckdb +0.6% -1.6% +2.3% +14.7% ➖ noise
26 duckdb:vortex-file-compressed -3.8% -1.6% -2.2% +22.9% ➖ noise
27 datafusion:vortex-file-compressed +3.3% +0.5% +2.8% +10.0% ➖ noise
27 duckdb:duckdb -15.1% +0.5% -15.5% +14.4% ✅ faster
27 duckdb:vortex-file-compressed +0.9% +0.5% +0.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.1% -0.5% +2.6% +10.0% ➖ noise
28 duckdb:duckdb +0.0% -0.5% +0.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.5% -0.5% -0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.6% -0.3% +1.0% +10.0% ➖ noise
29 duckdb:duckdb +5.5% -0.3% +5.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +0.9% -0.3% +1.3% +11.9% ➖ noise
30 datafusion:vortex-file-compressed +2.2% +1.3% +0.9% +10.0% ➖ noise
30 duckdb:duckdb +5.2% +1.3% +3.8% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.9% +1.3% -0.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.2% +2.3% -1.1% +10.0% ➖ noise
31 duckdb:duckdb +0.1% +2.3% -2.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.3% +2.3% -2.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +17.1% +2.8% +13.9% +13.1% 🚨 regression
32 duckdb:duckdb +2.4% +2.8% -0.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.5% +2.8% -1.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +5.5% -0.1% +5.6% +14.4% ➖ noise
33 duckdb:duckdb -3.0% -0.1% -2.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.8% -0.1% -3.7% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +2.0% +0.6% +1.4% +10.0% ➖ noise
34 duckdb:duckdb -3.0% +0.6% -3.5% +13.5% ➖ noise
34 duckdb:vortex-file-compressed +1.8% +0.6% +1.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.4% -0.7% +3.2% +10.0% ➖ noise
35 duckdb:duckdb +0.3% -0.7% +1.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.5% -0.7% +1.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -1.2% -2.0% +0.8% +10.0% ➖ noise
36 duckdb:duckdb -9.5% -2.0% -7.7% +12.2% ➖ noise
36 duckdb:vortex-file-compressed +2.4% -2.0% +4.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -1.5% -1.0% -0.6% +10.0% ➖ noise
37 duckdb:duckdb +9.8% -1.0% +10.8% +11.6% ➖ noise
37 duckdb:vortex-file-compressed +8.7% -1.0% +9.7% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -2.1% +2.9% -4.8% +10.3% ➖ noise
38 duckdb:duckdb +6.9% +2.9% +3.9% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +4.6% +2.9% +1.6% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +5.3% -0.5% +5.8% +10.0% ➖ noise
39 duckdb:duckdb +6.6% -0.5% +7.1% +17.1% ➖ noise
39 duckdb:vortex-file-compressed +6.5% -0.5% +7.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +5.2% -1.4% +6.7% +10.0% ➖ noise
40 duckdb:duckdb +8.0% -1.4% +9.5% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -0.4% -1.4% +1.1% +16.1% ➖ noise
41 datafusion:vortex-file-compressed +9.1% +0.4% +8.7% +10.0% ➖ noise
41 duckdb:duckdb +7.8% +0.4% +7.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +11.3% +0.4% +10.8% +22.9% ➖ noise
42 datafusion:vortex-file-compressed +3.1% -1.9% +5.1% +10.0% ➖ noise
42 duckdb:duckdb +7.0% -1.9% +9.1% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +6.4% -1.9% +8.5% +10.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant