Skip to content

FileSystem for local reads - #9773

Open
myrrc wants to merge 1 commit into
developfrom
myrrc/local-fs-reads
Open

FileSystem for local reads#9773
myrrc wants to merge 1 commit into
developfrom
myrrc/local-fs-reads

Conversation

@myrrc

@myrrc myrrc commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

We have vortex-cloud and ObjectStoreFileSystem which is a unified interface for
reads. However, it does many things which are needed for an object store but
excessive for local disk i.e. etag creation.
As another example, get_opts currently calls open() for every segment which we
also don't need because a local read may use the cached file descriptor.

This change implements a local FileSystem and adds it support to vortex-duckdb.

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Sep 4, 2026
@myrrc
myrrc requested a review from robert3005 September 4, 2026 16:28
@myrrc
myrrc enabled auto-merge (squash) September 4, 2026 16:28
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 4, 2026
@codspeed-hq

codspeed-hq Bot commented Sep 4, 2026

Copy link
Copy Markdown

Merging this PR will regress 1 benchmark

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 5 improved benchmarks
❌ 1 regressed benchmark
✅ 2193 untouched benchmarks
⏩ 206 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime mul_u32_nonnull_avx512 5.6 µs 6.2 µs -10.16%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.6 µs +21.31%
WallTime arrow_checked_add_u32_avx512[16384] 21.3 µs 17.6 µs +21.17%
WallTime words_gather_scalar_avx2[65536] 9.4 µs 8.2 µs +13.78%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%
Simulation allocate_drop_bytes[0] 520.2 ns 466 ns +11.62%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/local-fs-reads (ecbd0d3) with develop (a997c3f)

Open in CodSpeed

Footnotes

  1. 206 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ecbd0d3 statpopgen 1 Explore Profiling Data
🟢 Done ecbd0d3 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ecbd0d3 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done ecbd0d3 fineweb-s3 1 Explore Profiling Data
🟢 Done ecbd0d3 fineweb 1 Explore Profiling Data
🟢 Done ecbd0d3 clickbench-nvme 1 Explore Profiling Data
🟢 Done ecbd0d3 tpcds-nvme 1 Explore Profiling Data
🟢 Done ecbd0d3 polarsignals 1 Explore Profiling Data
🟢 Done ecbd0d3 tpch-nvme 1 Explore Profiling Data
🟢 Done ecbd0d3 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress ecbd0d3 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR ecbd0d3f vs base 3170657a
Vortex (geomean): hot 0.998x ➖ · cold 1.065x ➖


datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45350628 / 45625720 / -0.6% 94929389 / 90940191 / +4.4% 0.48 / 0.50 / -4.8%
polarsignals_q01/datafusion:vortex-file-compressed 50677792 / 50743195 / -0.1% 116087300 / 112432519 / +3.3% 0.44 / 0.45 / -3.3%
polarsignals_q02/datafusion:vortex-file-compressed 35018630 / 35079350 / -0.2% 82673771 / 80823577 / +2.3% 0.42 / 0.43 / -2.4%
polarsignals_q03/datafusion:vortex-file-compressed 53291043 / 53975775 / -1.3% 119615832 / 118880638 / +0.6% 0.45 / 0.45 / -1.9%
polarsignals_q04/datafusion:vortex-file-compressed 9411546 / 9452505 / -0.4% 55155084 / 48112402 / +14.6% 🔴 0.17 / 0.20 / -13.1%
polarsignals_q05/datafusion:vortex-file-compressed 11822887 / 11236587 / +5.2% 58310840 / 52847112 / +10.3% 🔴 0.20 / 0.21 / -4.6%
polarsignals_q06/datafusion:vortex-file-compressed 21189655 / 21886750 / -3.2% 67418635 / 62329875 / +8.2% 0.31 / 0.35 / -10.5%
polarsignals_q07/datafusion:vortex-file-compressed 11019607 / 10855734 / +1.5% 58421372 / 53307076 / +9.6% 0.19 / 0.20 / -7.4%
polarsignals_q08/datafusion:vortex-file-compressed 100668403 / 100846693 / -0.2% 168021385 / 164739937 / +2.0% 0.60 / 0.61 / -2.1%
polarsignals_q09/datafusion:vortex-file-compressed 9725445 / 9953765 / -2.3% 52281924 / 47265821 / +10.6% 🔴 0.19 / 0.21 / -11.7%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16417678 / 16567336 / -0.9% 47910806 / 48215480 / -0.6% 0.34 / 0.34 / -0.3%
tpch_q02/datafusion:vortex-file-compressed 17491503 / 17463001 / +0.2% 39176496 / 40237591 / -2.6% 0.45 / 0.43 / +2.9%
tpch_q03/datafusion:vortex-file-compressed 19177978 / 19438192 / -1.3% 49949201 / 49229469 / +1.5% 0.38 / 0.39 / -2.8%
tpch_q04/datafusion:vortex-file-compressed 10500750 / 10232926 / +2.6% 35592435 / 35208419 / +1.1% 0.30 / 0.29 / +1.5%
tpch_q05/datafusion:vortex-file-compressed 36408772 / 36794303 / -1.0% 65483620 / 65978201 / -0.7% 0.56 / 0.56 / -0.3%
tpch_q06/datafusion:vortex-file-compressed 6180082 / 6170375 / +0.2% 32363728 / 30777657 / +5.2% 0.19 / 0.20 / -4.8%
tpch_q07/datafusion:vortex-file-compressed 51064318 / 51096112 / -0.1% 74402305 / 74941041 / -0.7% 0.69 / 0.68 / +0.7%
tpch_q08/datafusion:vortex-file-compressed 50998485 / 51340057 / -0.7% 81717296 / 82743152 / -1.2% 0.62 / 0.62 / +0.6%
tpch_q09/datafusion:vortex-file-compressed 49808759 / 48820179 / +2.0% 78147528 / 77043587 / +1.4% 0.64 / 0.63 / +0.6%
tpch_q10/datafusion:vortex-file-compressed 17077899 / 17219618 / -0.8% 48941264 / 48335184 / +1.3% 0.35 / 0.36 / -2.1%
tpch_q11/datafusion:vortex-file-compressed 14867224 / 15068252 / -1.3% 34389224 / 34998076 / -1.7% 0.43 / 0.43 / +0.4%
tpch_q12/datafusion:vortex-file-compressed 22423681 / 22306099 / +0.5% 50581706 / 49688457 / +1.8% 0.44 / 0.45 / -1.2%
tpch_q13/datafusion:vortex-file-compressed 19813333 / 20285805 / -2.3% 40052192 / 41310701 / -3.0% 0.49 / 0.49 / +0.7%
tpch_q14/datafusion:vortex-file-compressed 14577527 / 14718796 / -1.0% 39609082 / 41891528 / -5.4% 0.37 / 0.35 / +4.7%
tpch_q15/datafusion:vortex-file-compressed 17932173 / 17853262 / +0.4% 48363583 / 48606016 / -0.5% 0.37 / 0.37 / +0.9%
tpch_q16/datafusion:vortex-file-compressed 18365979 / 18575718 / -1.1% 37843654 / 38962033 / -2.9% 0.49 / 0.48 / +1.8%
tpch_q17/datafusion:vortex-file-compressed 28058001 / 27838042 / +0.8% 58146261 / 59996235 / -3.1% 0.48 / 0.46 / +4.0%
tpch_q18/datafusion:vortex-file-compressed 36771616 / 36356781 / +1.1% 57848868 / 60203297 / -3.9% 0.64 / 0.60 / +5.3%
tpch_q19/datafusion:vortex-file-compressed 13786279 / 14035313 / -1.8% 40192116 / 41946015 / -4.2% 0.34 / 0.33 / +2.5%
tpch_q20/datafusion:vortex-file-compressed 20381037 / 20264053 / +0.6% 48369929 / 47702745 / +1.4% 0.42 / 0.42 / -0.8%
tpch_q21/datafusion:vortex-file-compressed 38790649 / 39050992 / -0.7% 66897239 / 67721181 / -1.2% 0.58 / 0.58 / +0.6%
tpch_q22/datafusion:vortex-file-compressed 11226250 / 11146720 / +0.7% 31885338 / 33567055 / -5.0% 0.35 / 0.33 / +6.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67199021 / 67273312 / -0.1% 85566228 / 87436651 / -2.1% 0.79 / 0.77 / +2.1%
tpch_q02/datafusion:parquet 52003770 / 52954379 / -1.8% 72232776 / 72683681 / -0.6% 0.72 / 0.73 / -1.2%
tpch_q03/datafusion:parquet 72700977 / 73066600 / -0.5% 98502620 / 100305816 / -1.8% 0.74 / 0.73 / +1.3%
tpch_q04/datafusion:parquet 40481659 / 40396418 / +0.2% 62768610 / 67504239 / -7.0% 0.64 / 0.60 / +7.8%
tpch_q05/datafusion:parquet 88426082 / 88118463 / +0.3% 116661966 / 120201929 / -2.9% 0.76 / 0.73 / +3.4%
tpch_q06/datafusion:parquet 28750356 / 28857249 / -0.4% 49944553 / 51162871 / -2.4% 0.58 / 0.56 / +2.1%
tpch_q07/datafusion:parquet 93442884 / 93407655 / +0.0% 127235620 / 122594983 / +3.8% 0.73 / 0.76 / -3.6%
tpch_q08/datafusion:parquet 97617117 / 97070046 / +0.6% 127841757 / 125715715 / +1.7% 0.76 / 0.77 / -1.1%
tpch_q09/datafusion:parquet 112348988 / 112312916 / +0.0% 144690572 / 148435070 / -2.5% 0.78 / 0.76 / +2.6%
tpch_q10/datafusion:parquet 79716930 / 79610594 / +0.1% 114522766 / 114220685 / +0.3% 0.70 / 0.70 / -0.1%
tpch_q11/datafusion:parquet 38620885 / 37915596 / +1.9% 61721733 / 63603473 / -3.0% 0.63 / 0.60 / +5.0%
tpch_q12/datafusion:parquet 62598455 / 62783034 / -0.3% 89496961 / 89431975 / +0.1% 0.70 / 0.70 / -0.4%
tpch_q13/datafusion:parquet 159188975 / 159582543 / -0.2% 182098741 / 183619856 / -0.8% 0.87 / 0.87 / +0.6%
tpch_q14/datafusion:parquet 40322337 / 40167014 / +0.4% 68311448 / 69602908 / -1.9% 0.59 / 0.58 / +2.3%
tpch_q15/datafusion:parquet 47046138 / 46967902 / +0.2% 69999401 / 74682576 / -6.3% 0.67 / 0.63 / +6.9%
tpch_q16/datafusion:parquet 38541433 / 39286397 / -1.9% 59347861 / 60474235 / -1.9% 0.65 / 0.65 / -0.0%
tpch_q17/datafusion:parquet 116924263 / 115596836 / +1.1% 142254269 / 146583659 / -3.0% 0.82 / 0.79 / +4.2%
tpch_q18/datafusion:parquet 114139711 / 114540475 / -0.3% 137527212 / 139165145 / -1.2% 0.83 / 0.82 / +0.8%
tpch_q19/datafusion:parquet 49654701 / 49732341 / -0.2% 81431899 / 82137605 / -0.9% 0.61 / 0.61 / +0.7%
tpch_q20/datafusion:parquet 57661661 / 58174458 / -0.9% 88896022 / 87655232 / +1.4% 0.65 / 0.66 / -2.3%
tpch_q21/datafusion:parquet 98716317 / 98745758 / -0.0% 123642910 / 124095210 / -0.4% 0.80 / 0.80 / +0.3%
tpch_q22/datafusion:parquet 42078431 / 41521249 / +1.3% 59993993 / 60897501 / -1.5% 0.70 / 0.68 / +2.9%
duckdb / vortex-file-compressed / ns (1.002x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11130139 / 12487422 / -10.9% 🟢 24106400 / 24879521 / -3.1% 0.46 / 0.50 / -8.0%
tpch_q02/duckdb:vortex-file-compressed 17702102 / 17722968 / -0.1% 26912203 / 25916462 / +3.8% 0.66 / 0.68 / -3.8%
tpch_q03/duckdb:vortex-file-compressed 18248596 / 18577432 / -1.8% 33780029 / 37685291 / -10.4% 🟢 0.54 / 0.49 / +9.6%
tpch_q04/duckdb:vortex-file-compressed 16617959 / 16628579 / -0.1% 32458826 / 28914991 / +12.3% 🔴 0.51 / 0.58 / -11.0%
tpch_q05/duckdb:vortex-file-compressed 22372212 / 22131116 / +1.1% 35811881 / 36364966 / -1.5% 0.62 / 0.61 / +2.7%
tpch_q06/duckdb:vortex-file-compressed 5419880 / 5681377 / -4.6% 15304414 / 14195966 / +7.8% 0.35 / 0.40 / -11.5%
tpch_q07/duckdb:vortex-file-compressed 20266236 / 20895634 / -3.0% 41192764 / 39968955 / +3.1% 0.49 / 0.52 / -5.9%
tpch_q08/duckdb:vortex-file-compressed 23301288 / 23917633 / -2.6% 42538246 / 39744908 / +7.0% 0.55 / 0.60 / -9.0%
tpch_q09/duckdb:vortex-file-compressed 30164494 / 30266765 / -0.3% 46496804 / 50966929 / -8.8% 0.65 / 0.59 / +9.2%
tpch_q10/duckdb:vortex-file-compressed 28857732 / 28629686 / +0.8% 49953860 / 43902050 / +13.8% 🔴 0.58 / 0.65 / -11.4%
tpch_q11/duckdb:vortex-file-compressed 10380502 / 8045772 / +29.0% 🔴 16016201 / 18421757 / -13.1% 🟢 0.65 / 0.44 / +48.4%
tpch_q12/duckdb:vortex-file-compressed 15826683 / 16070407 / -1.5% 31143845 / 30898746 / +0.8% 0.51 / 0.52 / -2.3%
tpch_q13/duckdb:vortex-file-compressed 21628982 / 22463848 / -3.7% 39012009 / 37821121 / +3.1% 0.55 / 0.59 / -6.7%
tpch_q14/duckdb:vortex-file-compressed 13016379 / 13142223 / -1.0% 26478777 / 26619389 / -0.5% 0.49 / 0.49 / -0.4%
tpch_q15/duckdb:vortex-file-compressed 10741206 / 8862150 / +21.2% 🔴 22087675 / 22880709 / -3.5% 0.49 / 0.39 / +25.6%
tpch_q16/duckdb:vortex-file-compressed 18395553 / 18683316 / -1.5% 24557068 / 24699414 / -0.6% 0.75 / 0.76 / -1.0%
tpch_q17/duckdb:vortex-file-compressed 15295392 / 15671920 / -2.4% 31628925 / 32855993 / -3.7% 0.48 / 0.48 / +1.4%
tpch_q18/duckdb:vortex-file-compressed 24354024 / 24486866 / -0.5% 37965221 / 36749011 / +3.3% 0.64 / 0.67 / -3.7%
tpch_q19/duckdb:vortex-file-compressed 23893115 / 23457686 / +1.9% 35249315 / 37723766 / -6.6% 0.68 / 0.62 / +9.0%
tpch_q20/duckdb:vortex-file-compressed 17682881 / 18052952 / -2.0% 39853857 / 33332758 / +19.6% 🔴 0.44 / 0.54 / -18.1%
tpch_q21/duckdb:vortex-file-compressed 66418751 / 66064027 / +0.5% 83939328 / 81283784 / +3.3% 0.79 / 0.81 / -2.6%
tpch_q22/duckdb:vortex-file-compressed 11886259 / 12715579 / -6.5% 22906137 / 20605654 / +11.2% 🔴 0.52 / 0.62 / -15.9%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60060632 / 60258294 / -0.3% 66856794 / 66465679 / +0.6% 0.90 / 0.91 / -0.9%
tpch_q02/duckdb:parquet 34806639 / 35049343 / -0.7% 43057353 / 44553444 / -3.4% 0.81 / 0.79 / +2.8%
tpch_q03/duckdb:parquet 62115299 / 62244011 / -0.2% 74083676 / 74545808 / -0.6% 0.84 / 0.83 / +0.4%
tpch_q04/duckdb:parquet 46004090 / 43547591 / +5.6% 55554107 / 53226798 / +4.4% 0.83 / 0.82 / +1.2%
tpch_q05/duckdb:parquet 60386259 / 60975876 / -1.0% 73760111 / 72834261 / +1.3% 0.82 / 0.84 / -2.2%
tpch_q06/duckdb:parquet 20101061 / 20379889 / -1.4% 24624014 / 24558299 / +0.3% 0.82 / 0.83 / -1.6%
tpch_q07/duckdb:parquet 60579644 / 61209106 / -1.0% 71945502 / 71939950 / +0.0% 0.84 / 0.85 / -1.0%
tpch_q08/duckdb:parquet 73191339 / 73622264 / -0.6% 86732753 / 86939577 / -0.2% 0.84 / 0.85 / -0.3%
tpch_q09/duckdb:parquet 114174480 / 114317838 / -0.1% 131520777 / 128357720 / +2.5% 0.87 / 0.89 / -2.5%
tpch_q10/duckdb:parquet 107551407 / 108728394 / -1.1% 122019650 / 123837376 / -1.5% 0.88 / 0.88 / +0.4%
tpch_q11/duckdb:parquet 20007430 / 19969745 / +0.2% 23452466 / 23662233 / -0.9% 0.85 / 0.84 / +1.1%
tpch_q12/duckdb:parquet 41157478 / 41701856 / -1.3% 48915590 / 49608732 / -1.4% 0.84 / 0.84 / +0.1%
tpch_q13/duckdb:parquet 239112750 / 238773098 / +0.1% 248295673 / 248670830 / -0.2% 0.96 / 0.96 / +0.3%
tpch_q14/duckdb:parquet 43361447 / 43707032 / -0.8% 52745521 / 52742864 / +0.0% 0.82 / 0.83 / -0.8%
tpch_q15/duckdb:parquet 24792196 / 25663246 / -3.4% 31714658 / 31448041 / +0.8% 0.78 / 0.82 / -4.2%
tpch_q16/duckdb:parquet 49731045 / 50123080 / -0.8% 56961733 / 57411200 / -0.8% 0.87 / 0.87 / +0.0%
tpch_q17/duckdb:parquet 44346464 / 44747256 / -0.9% 54018884 / 54347156 / -0.6% 0.82 / 0.82 / -0.3%
tpch_q18/duckdb:parquet 87940517 / 89979324 / -2.3% 99907609 / 100742126 / -0.8% 0.88 / 0.89 / -1.4%
tpch_q19/duckdb:parquet 60877209 / 61273872 / -0.6% 71026910 / 71106376 / -0.1% 0.86 / 0.86 / -0.5%
tpch_q20/duckdb:parquet 58692195 / 59046698 / -0.6% 71253022 / 70979618 / +0.4% 0.82 / 0.83 / -1.0%
tpch_q21/duckdb:parquet 136684786 / 137038941 / -0.3% 149499722 / 149122113 / +0.3% 0.91 / 0.92 / -0.5%
tpch_q22/duckdb:parquet 50565430 / 50611435 / -0.1% 57811418 / 58476122 / -1.1% 0.87 / 0.87 / +1.1%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (-2.6%, medium confidence)
Vortex (geomean): hot 0.986x ➖ · cold 0.949x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.960x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6805346 / 6859648 / -0.8% 20862334 / 21434763 / -2.7% 0.33 / 0.32 / +1.9%
fineweb_q01/datafusion:vortex-file-compressed 13884583 / 13116468 / +5.9% 60880784 / 54017521 / +12.7% 🔴 0.23 / 0.24 / -6.1%
fineweb_q02/datafusion:vortex-file-compressed 13352100 / 13543614 / -1.4% 61615281 / 55446707 / +11.1% 🔴 0.22 / 0.24 / -11.3%
fineweb_q03/datafusion:vortex-file-compressed 19945439 / 19426783 / +2.7% 105722991 / 116432768 / -9.2% 0.19 / 0.17 / +13.1%
fineweb_q04/datafusion:vortex-file-compressed 73318187 / 74035111 / -1.0% 159509190 / 167753785 / -4.9% 0.46 / 0.44 / +4.2%
fineweb_q05/datafusion:vortex-file-compressed 57254132 / 57620058 / -0.6% 134821731 / 140798214 / -4.2% 0.42 / 0.41 / +3.8%
fineweb_q06/datafusion:vortex-file-compressed 18487342 / 19664766 / -6.0% 106929420 / 121230267 / -11.8% 🟢 0.17 / 0.16 / +6.6%
fineweb_q07/datafusion:vortex-file-compressed 17956462 / 18342618 / -2.1% 103095724 / 116840886 / -11.8% 🟢 0.17 / 0.16 / +10.9%
fineweb_q08/datafusion:vortex-file-compressed 10069584 / 10152774 / -0.8% 51566520 / 50668925 / +1.8% 0.20 / 0.20 / -2.5%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9163144 / 9197519 / -0.4% 32390371 / 35307587 / -8.3% 0.28 / 0.26 / +8.6%
fineweb_q01/datafusion:parquet 70308962 / 71064950 / -1.1% 153837178 / 168884463 / -8.9% 0.46 / 0.42 / +8.6%
fineweb_q02/datafusion:parquet 71484526 / 71120954 / +0.5% 160224648 / 159474364 / +0.5% 0.45 / 0.45 / +0.0%
fineweb_q03/datafusion:parquet 69909134 / 69023794 / +1.3% 150607104 / 165137117 / -8.8% 0.46 / 0.42 / +11.1%
fineweb_q04/datafusion:parquet 76300882 / 74928552 / +1.8% 155732761 / 167012615 / -6.8% 0.49 / 0.45 / +9.2%
fineweb_q05/datafusion:parquet 75051244 / 74889816 / +0.2% 150921749 / 162784337 / -7.3% 0.50 / 0.46 / +8.1%
fineweb_q06/datafusion:parquet 70404914 / 70354714 / +0.1% 154158705 / 165878796 / -7.1% 0.46 / 0.42 / +7.7%
fineweb_q07/datafusion:parquet 68990898 / 69496012 / -0.7% 155045077 / 166377212 / -6.8% 0.44 / 0.42 / +6.5%
fineweb_q08/datafusion:parquet 67779361 / 68576669 / -1.2% 154432988 / 168680615 / -8.4% 0.44 / 0.41 / +8.0%
duckdb / vortex-file-compressed / ns (0.977x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2045032 / 3544307 / -42.3% 🟢 6780649 / 7667604 / -11.6% 🟢 0.30 / 0.46 / -34.8%
fineweb_q01/duckdb:vortex-file-compressed 18899326 / 18478917 / +2.3% 63030791 / 56695795 / +11.2% 🔴 0.30 / 0.33 / -8.0%
fineweb_q02/duckdb:vortex-file-compressed 17742602 / 18018933 / -1.5% 48940057 / 47611366 / +2.8% 0.36 / 0.38 / -4.2%
fineweb_q03/duckdb:vortex-file-compressed 28016053 / 23257675 / +20.5% 🔴 116484856 / 91836279 / +26.8% 🔴 0.24 / 0.25 / -5.0%
fineweb_q04/duckdb:vortex-file-compressed 74200514 / 79508662 / -6.7% 116205841 / 139017799 / -16.4% 🟢 0.64 / 0.57 / +11.6%
fineweb_q05/duckdb:vortex-file-compressed 60059200 / 61970413 / -3.1% 106808611 / 116970143 / -8.7% 0.56 / 0.53 / +6.1%
fineweb_q06/duckdb:vortex-file-compressed 32635366 / 23653573 / +38.0% 🔴 121803541 / 95690044 / +27.3% 🔴 0.27 / 0.25 / +8.4%
fineweb_q07/duckdb:vortex-file-compressed 30775509 / 21867770 / +40.7% 🔴 109249166 / 90168551 / +21.2% 🔴 0.28 / 0.24 / +16.2%
fineweb_q08/duckdb:vortex-file-compressed 6745565 / 10222335 / -34.0% 🟢 15090642 / 46842087 / -67.8% 🟢 0.45 / 0.22 / +104.8%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21662149 / 23747810 / -8.8% 25120191 / 26561800 / -5.4% 0.86 / 0.89 / -3.5%
fineweb_q01/duckdb:parquet 44493707 / 44447306 / +0.1% 60294547 / 57356747 / +5.1% 0.74 / 0.77 / -4.8%
fineweb_q02/duckdb:parquet 44721346 / 44006196 / +1.6% 54839633 / 53473214 / +2.6% 0.82 / 0.82 / -0.9%
fineweb_q03/duckdb:parquet 95342968 / 95174826 / +0.2% 177964398 / 177232957 / +0.4% 0.54 / 0.54 / -0.2%
fineweb_q04/duckdb:parquet 153422332 / 151397170 / +1.3% 208781022 / 214547483 / -2.7% 0.73 / 0.71 / +4.1%
fineweb_q05/duckdb:parquet 143312962 / 141914198 / +1.0% 196853984 / 198499840 / -0.8% 0.73 / 0.71 / +1.8%
fineweb_q06/duckdb:parquet 70645904 / 70976053 / -0.5% 127924384 / 129981580 / -1.6% 0.55 / 0.55 / +1.1%
fineweb_q07/duckdb:parquet 72793836 / 71656862 / +1.6% 150946834 / 159008374 / -5.1% 0.48 / 0.45 / +7.0%
fineweb_q08/duckdb:parquet 23731934 / 22251640 / +6.7% 24315174 / 24340063 / -0.1% 0.98 / 0.91 / +6.8%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.9%
Engines: DataFusion No clear signal (-5.5%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.971x ➖ · cold 0.952x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.965x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.943x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 185887002 / 227535030 / -18.3% 🟢 653915250 / 612025973 / +6.8% 0.28 / 0.37 / -23.5%
clickbench-sorted_q24/datafusion:vortex-file-compressed 13302378 / 14679556 / -9.4% 51581087 / 52040653 / -0.9% 0.26 / 0.28 / -8.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11260021 / 15107814 / -25.5% 🟢 49241123 / 54672666 / -9.9% 0.23 / 0.28 / -17.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed 29285098 / 28648244 / +2.2% 64127563 / 71816263 / -10.7% 🟢 0.46 / 0.40 / +14.5%
clickbench-sorted_q37/datafusion:vortex-file-compressed 24220336 / 24275597 / -0.2% 63305712 / 67562568 / -6.3% 0.38 / 0.36 / +6.5%
clickbench-sorted_q38/datafusion:vortex-file-compressed 37141252 / 36958038 / +0.5% 72714775 / 79067252 / -8.0% 0.51 / 0.47 / +9.3%
clickbench-sorted_q39/datafusion:vortex-file-compressed 86277278 / 90065664 / -4.2% 114396982 / 125240901 / -8.7% 0.75 / 0.72 / +4.9%
clickbench-sorted_q40/datafusion:vortex-file-compressed 16639188 / 16270578 / +2.3% 45978763 / 52060149 / -11.7% 🟢 0.36 / 0.31 / +15.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 15206068 / 15584032 / -2.4% 46252254 / 51252626 / -9.8% 0.33 / 0.30 / +8.1%
clickbench-sorted_q42/datafusion:vortex-file-compressed 13989048 / 13653124 / +2.5% 39231926 / 45120778 / -13.1% 🟢 0.36 / 0.30 / +17.8%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 751577336 / 757727220 / -0.8% 945522056 / 956224387 / -1.1% 0.79 / 0.79 / +0.3%
clickbench-sorted_q24/datafusion:parquet 8984262 / 8941312 / +0.5% 72445864 / 72722960 / -0.4% 0.12 / 0.12 / +0.9%
clickbench-sorted_q26/datafusion:parquet 9547299 / 9918751 / -3.7% 73581419 / 72892273 / +0.9% 0.13 / 0.14 / -4.6%
clickbench-sorted_q36/datafusion:parquet 94378334 / 93763557 / +0.7% 168671285 / 172109072 / -2.0% 0.56 / 0.54 / +2.7%
clickbench-sorted_q37/datafusion:parquet 64422308 / 64474955 / -0.1% 132424739 / 134520377 / -1.6% 0.49 / 0.48 / +1.5%
clickbench-sorted_q38/datafusion:parquet 87663317 / 86992840 / +0.8% 162008029 / 166089236 / -2.5% 0.54 / 0.52 / +3.3%
clickbench-sorted_q39/datafusion:parquet 159983178 / 159173662 / +0.5% 237824171 / 237939912 / -0.0% 0.67 / 0.67 / +0.6%
clickbench-sorted_q40/datafusion:parquet 44767409 / 44352660 / +0.9% 114266508 / 119744253 / -4.6% 0.39 / 0.37 / +5.8%
clickbench-sorted_q41/datafusion:parquet 42554439 / 42585016 / -0.1% 110725270 / 113568048 / -2.5% 0.38 / 0.37 / +2.5%
clickbench-sorted_q42/datafusion:parquet 26327886 / 26544046 / -0.8% 88081934 / 89457592 / -1.5% 0.30 / 0.30 / +0.7%
duckdb / vortex-file-compressed / ns (1.001x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 73296312 / 65980858 / +11.1% 🔴 87747680 / 95510565 / -8.1% 0.84 / 0.69 / +20.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed 23171284 / 22314318 / +3.8% 33208940 / 32048009 / +3.6% 0.70 / 0.70 / +0.2%
clickbench-sorted_q26/duckdb:vortex-file-compressed 18998878 / 19045057 / -0.2% 26000575 / 29693989 / -12.4% 🟢 0.73 / 0.64 / +13.9%
clickbench-sorted_q36/duckdb:vortex-file-compressed 44157450 / 44773499 / -1.4% 74830961 / 75394768 / -0.7% 0.59 / 0.59 / -0.6%
clickbench-sorted_q37/duckdb:vortex-file-compressed 38534053 / 39006282 / -1.2% 67308979 / 64297357 / +4.7% 0.57 / 0.61 / -5.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 50754262 / 48657736 / +4.3% 73771192 / 72521010 / +1.7% 0.69 / 0.67 / +2.5%
clickbench-sorted_q39/duckdb:vortex-file-compressed 112424056 / 108546450 / +3.6% 139949547 / 147115376 / -4.9% 0.80 / 0.74 / +8.9%
clickbench-sorted_q40/duckdb:vortex-file-compressed 21164287 / 23782042 / -11.0% 🟢 40273604 / 40347221 / -0.2% 0.53 / 0.59 / -10.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed 21731848 / 21678502 / +0.2% 41305223 / 43447824 / -4.9% 0.53 / 0.50 / +5.4%
clickbench-sorted_q42/duckdb:vortex-file-compressed 18884218 / 20163474 / -6.3% 35238744 / 34902306 / +1.0% 0.54 / 0.58 / -7.2%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 132394830 / 127834684 / +3.6% 151020272 / 148481177 / +1.7% 0.88 / 0.86 / +1.8%
clickbench-sorted_q24/duckdb:parquet 17672036 / 18121322 / -2.5% 28074283 / 29137047 / -3.6% 0.63 / 0.62 / +1.2%
clickbench-sorted_q26/duckdb:parquet 12809169 / 12265488 / +4.4% 23225641 / 23691309 / -2.0% 0.55 / 0.52 / +6.5%
clickbench-sorted_q36/duckdb:parquet 43726342 / 43407790 / +0.7% 59737980 / 61128258 / -2.3% 0.73 / 0.71 / +3.1%
clickbench-sorted_q37/duckdb:parquet 29993939 / 31113174 / -3.6% 45285660 / 49979035 / -9.4% 0.66 / 0.62 / +6.4%
clickbench-sorted_q38/duckdb:parquet 39996824 / 40756414 / -1.9% 55164928 / 62589918 / -11.9% 🟢 0.73 / 0.65 / +11.3%
clickbench-sorted_q39/duckdb:parquet 72618198 / 74484720 / -2.5% 85087671 / 87780743 / -3.1% 0.85 / 0.85 / +0.6%
clickbench-sorted_q40/duckdb:parquet 17578882 / 17444462 / +0.8% 35685024 / 44339169 / -19.5% 🟢 0.49 / 0.39 / +25.2%
clickbench-sorted_q41/duckdb:parquet 16165648 / 16147562 / +0.1% 40100609 / 43123069 / -7.0% 0.40 / 0.37 / +7.7%
clickbench-sorted_q42/duckdb:parquet 11377135 / 10875020 / +4.6% 24741104 / 23280619 / +6.3% 0.46 / 0.47 / -1.6%

File Size Changes (100 files changed, +0.0% overall, 57↑ 43↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 188.09 MB 192.73 MB +4.63 MB +2.5%
hits_034.vortex 1.0 vortex-file-compressed 180.89 MB 183.12 MB +2.23 MB +1.2%
hits_017.vortex 1.0 vortex-file-compressed 145.88 MB 146.65 MB +791.87 KB +0.5%
hits_055.vortex 1.0 vortex-file-compressed 198.08 MB 199.06 MB +1001.77 KB +0.5%
hits_045.vortex 1.0 vortex-file-compressed 138.62 MB 139.23 MB +625.25 KB +0.4%
hits_054.vortex 1.0 vortex-file-compressed 146.01 MB 146.62 MB +623.65 KB +0.4%
hits_073.vortex 1.0 vortex-file-compressed 171.86 MB 172.48 MB +642.32 KB +0.4%
hits_014.vortex 1.0 vortex-file-compressed 171.35 MB 171.91 MB +568.85 KB +0.3%
hits_020.vortex 1.0 vortex-file-compressed 159.26 MB 159.76 MB +517.76 KB +0.3%
hits_085.vortex 1.0 vortex-file-compressed 199.03 MB 199.64 MB +625.27 KB +0.3%
hits_068.vortex 1.0 vortex-file-compressed 159.43 MB 159.90 MB +482.41 KB +0.3%
hits_096.vortex 1.0 vortex-file-compressed 198.10 MB 198.55 MB +458.86 KB +0.2%
hits_048.vortex 1.0 vortex-file-compressed 198.91 MB 199.32 MB +413.52 KB +0.2%
hits_058.vortex 1.0 vortex-file-compressed 153.96 MB 154.27 MB +315.39 KB +0.2%
hits_088.vortex 1.0 vortex-file-compressed 171.16 MB 171.50 MB +343.62 KB +0.2%
hits_089.vortex 1.0 vortex-file-compressed 130.81 MB 131.05 MB +240.36 KB +0.2%
hits_057.vortex 1.0 vortex-file-compressed 158.94 MB 159.19 MB +254.80 KB +0.2%
hits_000.vortex 1.0 vortex-file-compressed 130.45 MB 130.62 MB +172.31 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 191.79 MB 192.00 MB +216.45 KB +0.1%
hits_008.vortex 1.0 vortex-file-compressed 138.92 MB 139.07 MB +155.40 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 153.60 MB 153.76 MB +166.83 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 170.45 MB 170.63 MB +182.15 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.66 MB 199.85 MB +194.61 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 129.91 MB 130.02 MB +113.80 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.64 MB 130.75 MB +109.17 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.71 MB 153.83 MB +125.60 KB +0.1%
hits_081.vortex 1.0 vortex-file-compressed 199.28 MB 199.42 MB +142.34 KB +0.1%
hits_030.vortex 1.0 vortex-file-compressed 130.95 MB 131.04 MB +91.61 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 199.55 MB 199.68 MB +135.09 KB +0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.04 MB 192.16 MB +122.38 KB +0.1%
hits_022.vortex 1.0 vortex-file-compressed 198.32 MB 198.45 MB +126.29 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 139.53 MB 139.62 MB +88.57 KB +0.1%
hits_050.vortex 1.0 vortex-file-compressed 158.70 MB 158.79 MB +100.45 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 159.45 MB 159.54 MB +99.55 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.35 MB 153.44 MB +93.82 KB +0.1%
hits_098.vortex 1.0 vortex-file-compressed 136.73 MB 136.81 MB +78.23 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 198.64 MB 198.75 MB +113.24 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.19 MB 171.27 MB +87.17 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.81 MB 130.88 MB +66.15 KB +0.0%
hits_018.vortex 1.0 vortex-file-compressed 198.98 MB 199.07 MB +97.30 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.27 MB 160.35 MB +77.33 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 160.04 MB 160.12 MB +77.18 KB +0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.55 MB 100.59 MB +46.00 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 145.97 MB 146.03 MB +65.81 KB +0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.73 MB 130.78 MB +48.80 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 159.98 MB 160.04 MB +57.48 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 138.55 MB 138.59 MB +46.93 KB +0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.67 MB 179.73 MB +59.15 KB +0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.75 MB 101.78 MB +30.33 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 134.49 MB 134.52 MB +31.02 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 100.69 MB 100.71 MB +20.93 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.87 MB 159.90 MB +28.84 KB +0.0%
hits_042.vortex 1.0 vortex-file-compressed 200.62 MB 200.64 MB +22.04 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.66 MB 125.66 MB +8.07 KB +0.0%
hits_005.vortex 1.0 vortex-file-compressed 166.84 MB 166.85 MB +5.82 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.30 MB 102.31 MB +1.36 KB +0.0%
hits_070.vortex 1.0 vortex-file-compressed 199.61 MB 199.61 MB +144 B +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.17 MB 126.16 MB 8.87 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 189.88 MB 189.86 MB 20.61 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 188.35 MB 188.33 MB 25.19 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.68 MB 141.66 MB 26.95 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.62 MB 153.57 MB 51.38 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.60 MB 168.55 MB 56.59 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.24 MB 130.19 MB 48.64 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.80 MB 125.75 MB 49.23 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.13 MB 156.06 MB 64.17 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.40 MB 130.35 MB 55.47 KB -0.0%
hits_033.vortex 1.0 vortex-file-compressed 199.39 MB 199.31 MB 89.45 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.31 MB 160.24 MB 78.15 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 158.44 MB 158.36 MB 80.41 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.14 MB 191.05 MB 97.40 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.61 MB 153.53 MB 84.86 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.33 MB 130.25 MB 86.12 KB -0.1%
hits_028.vortex 1.0 vortex-file-compressed 150.95 MB 150.83 MB 119.41 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.52 MB 130.42 MB 104.11 KB -0.1%
hits_007.vortex 1.0 vortex-file-compressed 199.60 MB 199.42 MB 181.11 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 198.93 MB 198.75 MB 182.10 KB -0.1%
hits_003.vortex 1.0 vortex-file-compressed 135.78 MB 135.66 MB 127.05 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 190.53 MB 190.35 MB 184.79 KB -0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.16 MB 171.99 MB 176.66 KB -0.1%
hits_071.vortex 1.0 vortex-file-compressed 138.89 MB 138.75 MB 143.64 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 199.01 MB 198.71 MB 301.98 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 171.83 MB 171.55 MB 286.60 KB -0.2%
hits_027.vortex 1.0 vortex-file-compressed 189.19 MB 188.85 MB 346.51 KB -0.2%
hits_087.vortex 1.0 vortex-file-compressed 160.17 MB 159.88 MB 299.92 KB -0.2%
hits_062.vortex 1.0 vortex-file-compressed 170.26 MB 169.92 MB 349.05 KB -0.2%
hits_037.vortex 1.0 vortex-file-compressed 176.89 MB 176.48 MB 414.59 KB -0.2%
hits_079.vortex 1.0 vortex-file-compressed 180.34 MB 179.85 MB 503.40 KB -0.3%
hits_066.vortex 1.0 vortex-file-compressed 162.91 MB 162.40 MB 525.16 KB -0.3%
hits_059.vortex 1.0 vortex-file-compressed 199.01 MB 198.35 MB 669.96 KB -0.3%
hits_036.vortex 1.0 vortex-file-compressed 171.15 MB 170.54 MB 626.75 KB -0.4%
hits_078.vortex 1.0 vortex-file-compressed 130.45 MB 129.94 MB 527.33 KB -0.4%
hits_076.vortex 1.0 vortex-file-compressed 160.58 MB 159.93 MB 663.23 KB -0.4%
hits_040.vortex 1.0 vortex-file-compressed 143.55 MB 142.94 MB 631.13 KB -0.4%
hits_094.vortex 1.0 vortex-file-compressed 158.07 MB 157.33 MB 755.70 KB -0.5%
hits_023.vortex 1.0 vortex-file-compressed 195.46 MB 194.23 MB 1.23 MB -0.6%
hits_090.vortex 1.0 vortex-file-compressed 192.85 MB 191.51 MB 1.34 MB -0.7%
hits_064.vortex 1.0 vortex-file-compressed 192.06 MB 190.30 MB 1.76 MB -0.9%
hits_053.vortex 1.0 vortex-file-compressed 190.94 MB 189.00 MB 1.94 MB -1.0%
hits_038.vortex 1.0 vortex-file-compressed 191.07 MB 189.12 MB 1.94 MB -1.0%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.88 GB (+0.0%)

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.9%
Engines: DataFusion No clear signal (+4.4%, environment too noisy confidence) · DuckDB No clear signal (+7.4%, environment too noisy confidence)
Vortex (geomean): hot 1.020x ➖ · cold 1.060x ➖
Parquet (geomean): hot 0.963x ➖ · cold 0.943x ➖
Shifts: Parquet (control) -3.7% · Median polish -3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.035x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 50828228 / 53088744 / -4.3% 155162055 / 129070938 / +20.2% 0.33 / 0.41 / -20.4%
fineweb_q01/datafusion:vortex-file-compressed 418333898 / 448598473 / -6.7% 984529383 / 734428587 / +34.1% 🔴 0.42 / 0.61 / -30.4%
fineweb_q02/datafusion:vortex-file-compressed 384190892 / 458538869 / -16.2% 671349218 / 579981545 / +15.8% 0.57 / 0.79 / -27.6%
fineweb_q03/datafusion:vortex-file-compressed 498620502 / 467948638 / +6.6% 730023275 / 645291861 / +13.1% 0.68 / 0.73 / -5.8%
fineweb_q04/datafusion:vortex-file-compressed 445326826 / 433097450 / +2.8% 619876612 / 442037132 / +40.2% 🔴 0.72 / 0.98 / -26.7%
fineweb_q05/datafusion:vortex-file-compressed 435257348 / 446062870 / -2.4% 464553821 / 542729176 / -14.4% 0.94 / 0.82 / +14.0%
fineweb_q06/datafusion:vortex-file-compressed 742696178 / 742386690 / +0.0% 687598894 / 705272188 / -2.5% 1.08 / 1.05 / +2.6%
fineweb_q07/datafusion:vortex-file-compressed 969131821 / 448738691 / +116.0% 🔴 848713423 / 479687262 / +76.9% 🔴 1.14 / 0.94 / +22.1%
fineweb_q08/datafusion:vortex-file-compressed 178141930 / 225088276 / -20.9% 246001527 / 200486494 / +22.7% 0.72 / 1.12 / -35.5%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 509156802 / 511961443 / -0.5% 830111852 / 794789087 / +4.4% 0.61 / 0.64 / -4.8%
fineweb_q01/datafusion:parquet 715294788 / 776168322 / -7.8% 716121357 / 969988150 / -26.2% 1.00 / 0.80 / +24.8%
fineweb_q02/datafusion:parquet 787259284 / 795355309 / -1.0% 876508681 / 772513581 / +13.5% 0.90 / 1.03 / -12.8%
fineweb_q03/datafusion:parquet 863053474 / 958226434 / -9.9% 811693506 / 1257937230 / -35.5% 🟢 1.06 / 0.76 / +39.6%
fineweb_q04/datafusion:parquet 767392400 / 785935036 / -2.4% 782413819 / 1040864520 / -24.8% 0.98 / 0.76 / +29.9%
fineweb_q05/datafusion:parquet 734086322 / 746430624 / -1.7% 1272271146 / 747836657 / +70.1% 🔴 0.58 / 1.00 / -42.2%
fineweb_q06/datafusion:parquet 912969622 / 719878076 / +26.8% 941798576 / 830210784 / +13.4% 0.97 / 0.87 / +11.8%
fineweb_q07/datafusion:parquet 800625400 / 805824194 / -0.6% 810798667 / 915948607 / -11.5% 0.99 / 0.88 / +12.2%
fineweb_q08/datafusion:parquet 751317922 / 799565948 / -6.0% 653298475 / 910928172 / -28.3% 1.15 / 0.88 / +31.0%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 54385992 / 48579082 / +12.0% 53418688 / 66323670 / -19.5% 1.02 / 0.73 / +39.0%
fineweb_q01/duckdb:vortex-file-compressed 496229294 / 515381145 / -3.7% 511237492 / 514310765 / -0.6% 0.97 / 1.00 / -3.1%
fineweb_q02/duckdb:vortex-file-compressed 682274182 / 649664504 / +5.0% 719743475 / 690639329 / +4.2% 0.95 / 0.94 / +0.8%
fineweb_q03/duckdb:vortex-file-compressed 1358191477 / 1368650127 / -0.8% 1390127885 / 1897147585 / -26.7% 0.98 / 0.72 / +35.4%
fineweb_q04/duckdb:vortex-file-compressed 1525054522 / 1554047216 / -1.9% 1572592793 / 1593488213 / -1.3% 0.97 / 0.98 / -0.6%
fineweb_q05/duckdb:vortex-file-compressed 1388766942 / 1338673034 / +3.7% 1382829151 / 1355755913 / +2.0% 1.00 / 0.99 / +1.7%
fineweb_q06/duckdb:vortex-file-compressed 1692702827 / 1652273571 / +2.4% 1611770180 / 1666558441 / -3.3% 1.05 / 0.99 / +5.9%
fineweb_q07/duckdb:vortex-file-compressed 1301967280 / 1399675576 / -7.0% 1350216969 / 1446680134 / -6.7% 0.96 / 0.97 / -0.3%
fineweb_q08/duckdb:vortex-file-compressed 574642457 / 600075526 / -4.2% 599017280 / 629311361 / -4.8% 0.96 / 0.95 / +0.6%
duckdb / parquet / ns (0.936x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 517680889 / 516282022 / +0.3% 727714836 / 633938719 / +14.8% 0.71 / 0.81 / -12.7%
fineweb_q01/duckdb:parquet 636827846 / 658001183 / -3.2% 673905208 / 651015638 / +3.5% 0.94 / 1.01 / -6.5%
fineweb_q02/duckdb:parquet 629856531 / 788749948 / -20.1% 630670820 / 633543359 / -0.5% 1.00 / 1.24 / -19.8%
fineweb_q03/duckdb:parquet 1387482299 / 1362803819 / +1.8% 1514530223 / 1699044626 / -10.9% 0.92 / 0.80 / +14.2%
fineweb_q04/duckdb:parquet 792417483 / 872092316 / -9.1% 925956295 / 883062133 / +4.9% 0.86 / 0.99 / -13.3%
fineweb_q05/duckdb:parquet 1007904578 / 978787844 / +3.0% 901370122 / 1133088384 / -20.5% 1.12 / 0.86 / +29.4%
fineweb_q06/duckdb:parquet 1598092536 / 1707445447 / -6.4% 1627400004 / 1557972213 / +4.5% 0.98 / 1.10 / -10.4%
fineweb_q07/duckdb:parquet 1042474057 / 1161723034 / -10.3% 1096202174 / 1225495753 / -10.6% 0.95 / 0.95 / +0.3%
fineweb_q08/duckdb:parquet 527025712 / 593032686 / -11.1% 556758257 / 680669959 / -18.2% 0.95 / 0.87 / +8.6%

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-1.0%, environment too noisy confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.957x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.972x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1241216 / 1241487 / -0.0% 17749764 / 22663780 / -21.7% 🟢 0.07 / 0.05 / +27.7%
clickbench_q01/datafusion:vortex-file-compressed 8997474 / 9301170 / -3.3% 32874078 / 36589276 / -10.2% 🟢 0.27 / 0.25 / +7.7%
clickbench_q02/datafusion:vortex-file-compressed 13521130 / 13596234 / -0.6% 36492483 / 41611738 / -12.3% 🟢 0.37 / 0.33 / +13.4%
clickbench_q03/datafusion:vortex-file-compressed 14026524 / 13994516 / +0.2% 46269732 / 55858272 / -17.2% 🟢 0.30 / 0.25 / +21.0%
clickbench_q04/datafusion:vortex-file-compressed 54550024 / 55309068 / -1.4% 83759540 / 89700236 / -6.6% 0.65 / 0.62 / +5.6%
clickbench_q05/datafusion:vortex-file-compressed 82034976 / 77852052 / +5.4% 109489225 / 113615829 / -3.6% 0.75 / 0.69 / +9.3%
clickbench_q06/datafusion:vortex-file-compressed 1287058 / 1259137 / +2.2% 18018881 / 21369064 / -15.7% 🟢 0.07 / 0.06 / +21.2%
clickbench_q07/datafusion:vortex-file-compressed 14149454 / 13914432 / +1.7% 33793989 / 39702346 / -14.9% 🟢 0.42 / 0.35 / +19.5%
clickbench_q08/datafusion:vortex-file-compressed 83000112 / 82673293 / +0.4% 117055642 / 118260562 / -1.0% 0.71 / 0.70 / +1.4%
clickbench_q09/datafusion:vortex-file-compressed 174046642 / 174283574 / -0.1% 208490286 / 208543289 / -0.0% 0.83 / 0.84 / -0.1%
clickbench_q10/datafusion:vortex-file-compressed 40308590 / 40129669 / +0.4% 62943406 / 71721235 / -12.2% 🟢 0.64 / 0.56 / +14.5%
clickbench_q11/datafusion:vortex-file-compressed 55061508 / 56705020 / -2.9% 80549656 / 84140376 / -4.3% 0.68 / 0.67 / +1.4%
clickbench_q12/datafusion:vortex-file-compressed 76891752 / 79097207 / -2.8% 115371721 / 125176956 / -7.8% 0.67 / 0.63 / +5.5%
clickbench_q13/datafusion:vortex-file-compressed 125325327 / 122951006 / +1.9% 172582447 / 179232648 / -3.7% 0.73 / 0.69 / +5.9%
clickbench_q14/datafusion:vortex-file-compressed 86367536 / 83878168 / +3.0% 124180281 / 127186705 / -2.4% 0.70 / 0.66 / +5.5%
clickbench_q15/datafusion:vortex-file-compressed 65359716 / 62593692 / +4.4% 91721599 / 94588406 / -3.0% 0.71 / 0.66 / +7.7%
clickbench_q16/datafusion:vortex-file-compressed 158242694 / 153426658 / +3.1% 203329045 / 208414246 / -2.4% 0.78 / 0.74 / +5.7%
clickbench_q17/datafusion:vortex-file-compressed 154678100 / 155973512 / -0.8% 211372600 / 212121810 / -0.4% 0.73 / 0.74 / -0.5%
clickbench_q18/datafusion:vortex-file-compressed 301267018 / 298941161 / +0.8% 361930648 / 361652304 / +0.1% 0.83 / 0.83 / +0.7%
clickbench_q19/datafusion:vortex-file-compressed 9354691 / 9511274 / -1.6% 41258465 / 47489336 / -13.1% 🟢 0.23 / 0.20 / +13.2%
clickbench_q20/datafusion:vortex-file-compressed 67832948 / 67244180 / +0.9% 228213908 / 235111398 / -2.9% 0.30 / 0.29 / +3.9%
clickbench_q21/datafusion:vortex-file-compressed 99439052 / 99836270 / -0.4% 261734673 / 267687818 / -2.2% 0.38 / 0.37 / +1.9%
clickbench_q22/datafusion:vortex-file-compressed 122185062 / 121646567 / +0.4% 339508969 / 337195656 / +0.7% 0.36 / 0.36 / -0.2%
clickbench_q23/datafusion:vortex-file-compressed 359461859 / 368851456 / -2.5% 656147314 / 638873945 / +2.7% 0.55 / 0.58 / -5.1%
clickbench_q24/datafusion:vortex-file-compressed 22462734 / 21808954 / +3.0% 60674412 / 66069529 / -8.2% 0.37 / 0.33 / +12.2%
clickbench_q25/datafusion:vortex-file-compressed 27044370 / 28200804 / -4.1% 52359691 / 61909077 / -15.4% 🟢 0.52 / 0.46 / +13.4%
clickbench_q26/datafusion:vortex-file-compressed 21829132 / 21999106 / -0.8% 61793332 / 68642513 / -10.0% 0.35 / 0.32 / +10.2%
clickbench_q27/datafusion:vortex-file-compressed 103919867 / 100084998 / +3.8% 245726635 / 248914589 / -1.3% 0.42 / 0.40 / +5.2%
clickbench_q28/datafusion:vortex-file-compressed 560429616 / 576485609 / -2.8% 610726448 / 612584316 / -0.3% 0.92 / 0.94 / -2.5%
clickbench_q29/datafusion:vortex-file-compressed 25427064 / 25591096 / -0.6% 46591023 / 52806113 / -11.8% 🟢 0.55 / 0.48 / +12.6%
clickbench_q30/datafusion:vortex-file-compressed 90349320 / 86199066 / +4.8% 116255519 / 123143425 / -5.6% 0.78 / 0.70 / +11.0%
clickbench_q31/datafusion:vortex-file-compressed 82680494 / 84073071 / -1.7% 147712292 / 154547060 / -4.4% 0.56 / 0.54 / +2.9%
clickbench_q32/datafusion:vortex-file-compressed 297230654 / 304540926 / -2.4% 365111304 / 381915189 / -4.4% 0.81 / 0.80 / +2.1%
clickbench_q33/datafusion:vortex-file-compressed 336745985 / 335245312 / +0.4% 407909321 / 410658477 / -0.7% 0.83 / 0.82 / +1.1%
clickbench_q34/datafusion:vortex-file-compressed 333223050 / 333945484 / -0.2% 407183978 / 417955452 / -2.6% 0.82 / 0.80 / +2.4%
clickbench_q35/datafusion:vortex-file-compressed 57904268 / 59686874 / -3.0% 84802260 / 89369913 / -5.1% 0.68 / 0.67 / +2.2%
clickbench_q36/datafusion:vortex-file-compressed 37929481 / 37669823 / +0.7% 62393522 / 68292337 / -8.6% 0.61 / 0.55 / +10.2%
clickbench_q37/datafusion:vortex-file-compressed 21779110 / 22311338 / -2.4% 44153088 / 50334165 / -12.3% 🟢 0.49 / 0.44 / +11.3%
clickbench_q38/datafusion:vortex-file-compressed 12309270 / 12348600 / -0.3% 35511060 / 41906601 / -15.3% 🟢 0.35 / 0.29 / +17.6%
clickbench_q39/datafusion:vortex-file-compressed 79550680 / 80071988 / -0.7% 107532806 / 113409900 / -5.2% 0.74 / 0.71 / +4.8%
clickbench_q40/datafusion:vortex-file-compressed 11080316 / 11574064 / -4.3% 32510116 / 38078336 / -14.6% 🟢 0.34 / 0.30 / +12.1%
clickbench_q41/datafusion:vortex-file-compressed 10808634 / 11064060 / -2.3% 32206882 / 38578334 / -16.5% 🟢 0.34 / 0.29 / +17.0%
clickbench_q42/datafusion:vortex-file-compressed 10748118 / 10868849 / -1.1% 32248858 / 37988854 / -15.1% 🟢 0.33 / 0.29 / +16.5%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1268707 / 1264773 / +0.3% 45624058 / 51378776 / -11.2% 🟢 0.03 / 0.02 / +13.0%
clickbench_q01/datafusion:parquet 16049734 / 16526623 / -2.9% 65886900 / 74184042 / -11.2% 🟢 0.24 / 0.22 / +9.3%
clickbench_q02/datafusion:parquet 18548531 / 18756406 / -1.1% 79829225 / 82267837 / -3.0% 0.23 / 0.23 / +1.9%
clickbench_q03/datafusion:parquet 16923784 / 16948897 / -0.1% 78822524 / 81701918 / -3.5% 0.21 / 0.21 / +3.5%
clickbench_q04/datafusion:parquet 60265430 / 60626630 / -0.6% 118718216 / 124879259 / -4.9% 0.51 / 0.49 / +4.6%
clickbench_q05/datafusion:parquet 86756809 / 87403633 / -0.7% 156273544 / 156106838 / +0.1% 0.56 / 0.56 / -0.8%
clickbench_q06/datafusion:parquet 1261616 / 1245291 / +1.3% 45684734 / 49644510 / -8.0% 0.03 / 0.03 / +10.1%
clickbench_q07/datafusion:parquet 17069280 / 16796968 / +1.6% 66793204 / 69329488 / -3.7% 0.26 / 0.24 / +5.5%
clickbench_q08/datafusion:parquet 83443075 / 84522244 / -1.3% 159033824 / 160946712 / -1.2% 0.52 / 0.53 / -0.1%
clickbench_q09/datafusion:parquet 187578169 / 186266798 / +0.7% 265179667 / 262117817 / +1.2% 0.71 / 0.71 / -0.5%
clickbench_q10/datafusion:parquet 35008490 / 35661438 / -1.8% 98932213 / 100496380 / -1.6% 0.35 / 0.35 / -0.3%
clickbench_q11/datafusion:parquet 42203653 / 41155375 / +2.5% 108191853 / 112553070 / -3.9% 0.39 / 0.37 / +6.7%
clickbench_q12/datafusion:parquet 94319659 / 93749096 / +0.6% 155865991 / 160479490 / -2.9% 0.61 / 0.58 / +3.6%
clickbench_q13/datafusion:parquet 142641603 / 141439916 / +0.8% 216186199 / 219256537 / -1.4% 0.66 / 0.65 / +2.3%
clickbench_q14/datafusion:parquet 98924436 / 99410452 / -0.5% 163285244 / 172943456 / -5.6% 0.61 / 0.57 / +5.4%
clickbench_q15/datafusion:parquet 69312268 / 71680382 / -3.3% 123425709 / 135219061 / -8.7% 0.56 / 0.53 / +5.9%
clickbench_q16/datafusion:parquet 154362630 / 152602996 / +1.2% 225762794 / 233398398 / -3.3% 0.68 / 0.65 / +4.6%
clickbench_q17/datafusion:parquet 153578949 / 152616992 / +0.6% 220948698 / 232822154 / -5.1% 0.70 / 0.66 / +6.0%
clickbench_q18/datafusion:parquet 309411856 / 311936469 / -0.8% 395998292 / 409660603 / -3.3% 0.78 / 0.76 / +2.6%
clickbench_q19/datafusion:parquet 20324779 / 20757496 / -2.1% 72771727 / 79318459 / -8.3% 0.28 / 0.26 / +6.7%
clickbench_q20/datafusion:parquet 169034027 / 168891258 / +0.1% 273745970 / 286900174 / -4.6% 0.62 / 0.59 / +4.9%
clickbench_q21/datafusion:parquet 162015293 / 162674367 / -0.4% 281305933 / 296435944 / -5.1% 0.58 / 0.55 / +5.0%
clickbench_q22/datafusion:parquet 245321435 / 247511442 / -0.9% 407135190 / 420533244 / -3.2% 0.60 / 0.59 / +2.4%
clickbench_q23/datafusion:parquet 948179053 / 956722778 / -0.9% 1160747166 / 1178878617 / -1.5% 0.82 / 0.81 / +0.7%
clickbench_q24/datafusion:parquet 29762149 / 29639756 / +0.4% 83300521 / 89788257 / -7.2% 0.36 / 0.33 / +8.2%
clickbench_q25/datafusion:parquet 36995928 / 36121580 / +2.4% 95635391 / 103191465 / -7.3% 0.39 / 0.35 / +10.5%
clickbench_q26/datafusion:parquet 30500835 / 30697956 / -0.6% 83890477 / 91172295 / -8.0% 0.36 / 0.34 / +8.0%
clickbench_q27/datafusion:parquet 179433936 / 180462870 / -0.6% 268250769 / 286079224 / -6.2% 0.67 / 0.63 / +6.0%
clickbench_q28/datafusion:parquet 618073715 / 616016582 / +0.3% 690321366 / 702098502 / -1.7% 0.90 / 0.88 / +2.0%
clickbench_q29/datafusion:parquet 29450285 / 27983012 / +5.2% 87942343 / 92703641 / -5.1% 0.33 / 0.30 / +10.9%
clickbench_q30/datafusion:parquet 88686540 / 88686421 / +0.0% 161136746 / 172904169 / -6.8% 0.55 / 0.51 / +7.3%
clickbench_q31/datafusion:parquet 98745874 / 99123998 / -0.4% 181165737 / 195484892 / -7.3% 0.55 / 0.51 / +7.5%
clickbench_q32/datafusion:parquet 326731221 / 314110438 / +4.0% 415048003 / 424209639 / -2.2% 0.79 / 0.74 / +6.3%
clickbench_q33/datafusion:parquet 370579592 / 367556200 / +0.8% 448215109 / 459670643 / -2.5% 0.83 / 0.80 / +3.4%
clickbench_q34/datafusion:parquet 373282980 / 370659792 / +0.7% 452469045 / 457659405 / -1.1% 0.82 / 0.81 / +1.9%
clickbench_q35/datafusion:parquet 63481330 / 65046796 / -2.4% 121854887 / 125583869 / -3.0% 0.52 / 0.52 / +0.6%
clickbench_q36/datafusion:parquet 73462210 / 72923116 / +0.7% 129933498 / 137159579 / -5.3% 0.57 / 0.53 / +6.3%
clickbench_q37/datafusion:parquet 36070218 / 36014782 / +0.2% 86797609 / 92109107 / -5.8% 0.42 / 0.39 / +6.3%
clickbench_q38/datafusion:parquet 47430416 / 47428873 / +0.0% 101925203 / 111675621 / -8.7% 0.47 / 0.42 / +9.6%
clickbench_q39/datafusion:parquet 143811455 / 143768241 / +0.0% 201655745 / 211277693 / -4.6% 0.71 / 0.68 / +4.8%
clickbench_q40/datafusion:parquet 20548073 / 20595972 / -0.2% 72778807 / 78953094 / -7.8% 0.28 / 0.26 / +8.2%
clickbench_q41/datafusion:parquet 19428584 / 19210822 / +1.1% 71815854 / 76834755 / -6.5% 0.27 / 0.25 / +8.2%
clickbench_q42/datafusion:parquet 19820669 / 19756930 / +0.3% 70413407 / 75030997 / -6.2% 0.28 / 0.26 / +6.9%
duckdb / vortex-file-compressed / ns (1.003x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1651716 / 1671410 / -1.2% 23550298 / 23901067 / -1.5% 0.07 / 0.07 / +0.3%
clickbench_q01/duckdb:vortex-file-compressed 12677496 / 13670420 / -7.3% 29406052 / 32392713 / -9.2% 0.43 / 0.42 / +2.2%
clickbench_q02/duckdb:vortex-file-compressed 17468017 / 14747021 / +18.5% 🔴 34512087 / 34943447 / -1.2% 0.51 / 0.42 / +19.9%
clickbench_q03/duckdb:vortex-file-compressed 18540952 / 20028792 / -7.4% 44602955 / 46665914 / -4.4% 0.42 / 0.43 / -3.1%
clickbench_q04/duckdb:vortex-file-compressed 69815501 / 70837440 / -1.4% 105292425 / 100213317 / +5.1% 0.66 / 0.71 / -6.2%
clickbench_q05/duckdb:vortex-file-compressed 70036401 / 69570266 / +0.7% 96726269 / 93750919 / +3.2% 0.72 / 0.74 / -2.4%
clickbench_q06/duckdb:vortex-file-compressed 1957794 / 1974000 / -0.8% 31258746 / 28932450 / +8.0% 0.06 / 0.07 / -8.2%
clickbench_q07/duckdb:vortex-file-compressed 14994145 / 14643325 / +2.4% 29967102 / 29085877 / +3.0% 0.50 / 0.50 / -0.6%
clickbench_q08/duckdb:vortex-file-compressed 93593815 / 85586980 / +9.4% 123436210 / 126813670 / -2.7% 0.76 / 0.67 / +12.3%
clickbench_q09/duckdb:vortex-file-compressed 111160250 / 109267122 / +1.7% 150728205 / 153070763 / -1.5% 0.74 / 0.71 / +3.3%
clickbench_q10/duckdb:vortex-file-compressed 44087961 / 43684526 / +0.9% 72709900 / 78415122 / -7.3% 0.61 / 0.56 / +8.8%
clickbench_q11/duckdb:vortex-file-compressed 58603207 / 58068925 / +0.9% 85449428 / 88893714 / -3.9% 0.69 / 0.65 / +5.0%
clickbench_q12/duckdb:vortex-file-compressed 76641474 / 75785500 / +1.1% 108288324 / 107548686 / +0.7% 0.71 / 0.70 / +0.4%
clickbench_q13/duckdb:vortex-file-compressed 148668455 / 152948292 / -2.8% 175073074 / 198161825 / -11.7% 🟢 0.85 / 0.77 / +10.0%
clickbench_q14/duckdb:vortex-file-compressed 83489564 / 85502939 / -2.4% 119195499 / 112838502 / +5.6% 0.70 / 0.76 / -7.6%
clickbench_q15/duckdb:vortex-file-compressed 92378130 / 94821128 / -2.6% 136528074 / 131866690 / +3.5% 0.68 / 0.72 / -5.9%
clickbench_q16/duckdb:vortex-file-compressed 169122609 / 162571005 / +4.0% 229076038 / 210565426 / +8.8% 0.74 / 0.77 / -4.4%
clickbench_q17/duckdb:vortex-file-compressed 163515774 / 165391742 / -1.1% 206544567 / 210964908 / -2.1% 0.79 / 0.78 / +1.0%
clickbench_q18/duckdb:vortex-file-compressed 321859836 / 317946355 / +1.2% 376053539 / 425250988 / -11.6% 🟢 0.86 / 0.75 / +14.5%
clickbench_q19/duckdb:vortex-file-compressed 17329160 / 19536670 / -11.3% 🟢 42408253 / 42996581 / -1.4% 0.41 / 0.45 / -10.1%
clickbench_q20/duckdb:vortex-file-compressed 127091773 / 127061806 / +0.0% 202550815 / 208315274 / -2.8% 0.63 / 0.61 / +2.9%
clickbench_q21/duckdb:vortex-file-compressed 180621190 / 184949432 / -2.3% 296129952 / 324129391 / -8.6% 0.61 / 0.57 / +6.9%
clickbench_q22/duckdb:vortex-file-compressed 282481267 / 283909296 / -0.5% 455601488 / 547320000 / -16.8% 🟢 0.62 / 0.52 / +19.5%
clickbench_q23/duckdb:vortex-file-compressed 71045716 / 70260208 / +1.1% 115400129 / 113885185 / +1.3% 0.62 / 0.62 / -0.2%
clickbench_q24/duckdb:vortex-file-compressed 28534603 / 29036975 / -1.7% 42967589 / 40861972 / +5.2% 0.66 / 0.71 / -6.5%
clickbench_q25/duckdb:vortex-file-compressed 37034766 / 35892956 / +3.2% 54925975 / 54812660 / +0.2% 0.67 / 0.65 / +3.0%
clickbench_q26/duckdb:vortex-file-compressed 24684064 / 22799264 / +8.3% 42864512 / 34470191 / +24.4% 🔴 0.58 / 0.66 / -12.9%
clickbench_q27/duckdb:vortex-file-compressed 171957472 / 170233468 / +1.0% 264110221 / 281657676 / -6.2% 0.65 / 0.60 / +7.7%
clickbench_q28/duckdb:vortex-file-compressed 750337252 / 617374801 / +21.5% 🔴 658724621 / 694688171 / -5.2% 1.14 / 0.89 / +28.2%
clickbench_q29/duckdb:vortex-file-compressed 19303576 / 18689675 / +3.3% 36196617 / 37963614 / -4.7% 0.53 / 0.49 / +8.3%
clickbench_q30/duckdb:vortex-file-compressed 95501280 / 93125384 / +2.6% 127979058 / 140506966 / -8.9% 0.75 / 0.66 / +12.6%
clickbench_q31/duckdb:vortex-file-compressed 142033896 / 141977998 / +0.0% 201463206 / 226829291 / -11.2% 🟢 0.71 / 0.63 / +12.6%
clickbench_q32/duckdb:vortex-file-compressed 449540716 / 437735600 / +2.7% 542077549 / 516809576 / +4.9% 0.83 / 0.85 / -2.1%
clickbench_q33/duckdb:vortex-file-compressed 399939824 / 404474639 / -1.1% 495936673 / 506132449 / -2.0% 0.81 / 0.80 / +0.9%
clickbench_q34/duckdb:vortex-file-compressed 426784694 / 418372906 / +2.0% 545103939 / 557443338 / -2.2% 0.78 / 0.75 / +4.3%
clickbench_q35/duckdb:vortex-file-compressed 104639328 / 101565712 / +3.0% 140150699 / 137306930 / +2.1% 0.75 / 0.74 / +0.9%
clickbench_q36/duckdb:vortex-file-compressed 17505888 / 17898344 / -2.2% 36371337 / 35767765 / +1.7% 0.48 / 0.50 / -3.8%
clickbench_q37/duckdb:vortex-file-compressed 12973039 / 13757984 / -5.7% 28647960 / 29022835 / -1.3% 0.45 / 0.47 / -4.5%
clickbench_q38/duckdb:vortex-file-compressed 14266091 / 15365668 / -7.2% 30420481 / 31282775 / -2.8% 0.47 / 0.49 / -4.5%
clickbench_q39/duckdb:vortex-file-compressed 25441169 / 27508420 / -7.5% 46831350 / 43587079 / +7.4% 0.54 / 0.63 / -13.9%
clickbench_q40/duckdb:vortex-file-compressed 12413964 / 12577889 / -1.3% 31292781 / 28698474 / +9.0% 0.40 / 0.44 / -9.5%
clickbench_q41/duckdb:vortex-file-compressed 14032120 / 13468682 / +4.2% 29865902 / 29101921 / +2.6% 0.47 / 0.46 / +1.5%
clickbench_q42/duckdb:vortex-file-compressed 13552916 / 14293297 / -5.2% 30413572 / 31616894 / -3.8% 0.45 / 0.45 / -1.4%
duckdb / parquet / ns (1.013x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 11396234 / 7945762 / +43.4% 🔴 22427957 / 21932540 / +2.3% 0.51 / 0.36 / +40.3%
clickbench_q01/duckdb:parquet 10032492 / 9920746 / +1.1% 18513648 / 20711630 / -10.6% 🟢 0.54 / 0.48 / +13.1%
clickbench_q02/duckdb:parquet 16001398 / 17034646 / -6.1% 34629779 / 32638516 / +6.1% 0.46 / 0.52 / -11.5%
clickbench_q03/duckdb:parquet 15463330 / 16824694 / -8.1% 51403737 / 54866601 / -6.3% 0.30 / 0.31 / -1.9%
clickbench_q04/duckdb:parquet 68852990 / 67716474 / +1.7% 96370094 / 102876693 / -6.3% 0.71 / 0.66 / +8.5%
clickbench_q05/duckdb:parquet 83622181 / 79867738 / +4.7% 121469884 / 125761804 / -3.4% 0.69 / 0.64 / +8.4%
clickbench_q06/duckdb:parquet 15220756 / 15480067 / -1.7% 25124253 / 23701545 / +6.0% 0.61 / 0.65 / -7.2%
clickbench_q07/duckdb:parquet 14797671 / 10143523 / +45.9% 🔴 26601144 / 22907911 / +16.1% 🔴 0.56 / 0.44 / +25.6%
clickbench_q08/duckdb:parquet 82135982 / 84836042 / -3.2% 122617550 / 128386110 / -4.5% 0.67 / 0.66 / +1.4%
clickbench_q09/duckdb:parquet 114258594 / 116530943 / -1.9% 153135102 / 160786436 / -4.8% 0.75 / 0.72 / +2.9%
clickbench_q10/duckdb:parquet 33832671 / 33470463 / +1.1% 68489862 / 70252184 / -2.5% 0.49 / 0.48 / +3.7%
clickbench_q11/duckdb:parquet 36289285 / 36325934 / -0.1% 79453477 / 78148643 / +1.7% 0.46 / 0.46 / -1.7%
clickbench_q12/duckdb:parquet 90306614 / 90025862 / +0.3% 127765452 / 135956452 / -6.0% 0.71 / 0.66 / +6.7%
clickbench_q13/duckdb:parquet 143964706 / 148549948 / -3.1% 206827110 / 206951055 / -0.1% 0.70 / 0.72 / -3.0%
clickbench_q14/duckdb:parquet 96615870 / 99476712 / -2.9% 140245379 / 147526641 / -4.9% 0.69 / 0.67 / +2.2%
clickbench_q15/duckdb:parquet 91592584 / 92385461 / -0.9% 120496982 / 123020354 / -2.1% 0.76 / 0.75 / +1.2%
clickbench_q16/duckdb:parquet 170066317 / 171723622 / -1.0% 225113405 / 228337721 / -1.4% 0.76 / 0.75 / +0.5%
clickbench_q17/duckdb:parquet 173732494 / 179118340 / -3.0% 228637578 / 230283283 / -0.7% 0.76 / 0.78 / -2.3%
clickbench_q18/duckdb:parquet 330782802 / 315487008 / +4.8% 440991281 / 415166043 / +6.2% 0.75 / 0.76 / -1.3%
clickbench_q19/duckdb:parquet 13844172 / 13579561 / +1.9% 43688445 / 41567667 / +5.1% 0.32 / 0.33 / -3.0%
clickbench_q20/duckdb:parquet 135418418 / 136080260 / -0.5% 248940041 / 242634760 / +2.6% 0.54 / 0.56 / -3.0%
clickbench_q21/duckdb:parquet 185330478 / 181364182 / +2.2% 320515185 / 319312703 / +0.4% 0.58 / 0.57 / +1.8%
clickbench_q22/duckdb:parquet 251561098 / 242973674 / +3.5% 404245692 / 423376931 / -4.5% 0.62 / 0.57 / +8.4%
clickbench_q23/duckdb:parquet 146541233 / 147968688 / -1.0% 178792767 / 168971343 / +5.8% 0.82 / 0.88 / -6.4%
clickbench_q24/duckdb:parquet 42370176 / 43119612 / -1.7% 63050650 / 63162185 / -0.2% 0.67 / 0.68 / -1.6%
clickbench_q25/duckdb:parquet 39842766 / 39230556 / +1.6% 88849488 / 92542640 / -4.0% 0.45 / 0.42 / +5.8%
clickbench_q26/duckdb:parquet 29532262 / 32360157 / -8.7% 44270108 / 45255869 / -2.2% 0.67 / 0.72 / -6.7%
clickbench_q27/duckdb:parquet 145267290 / 145085492 / +0.1% 262849849 / 264351805 / -0.6% 0.55 / 0.55 / +0.7%
clickbench_q28/duckdb:parquet 903651648 / 899367794 / +0.5% 1025773820 / 1025373660 / +0.0% 0.88 / 0.88 / +0.4%
clickbench_q29/duckdb:parquet 17110181 / 17362399 / -1.5% 30619634 / 34147954 / -10.3% 🟢 0.56 / 0.51 / +9.9%
clickbench_q30/duckdb:parquet 90234986 / 90898870 / -0.7% 172613214 / 175773461 / -1.8% 0.52 / 0.52 / +1.1%
clickbench_q31/duckdb:parquet 146657320 / 143750626 / +2.0% 289366742 / 293437463 / -1.4% 0.51 / 0.49 / +3.5%
clickbench_q32/duckdb:parquet 462818040 / 454243288 / +1.9% 491054120 / 532408445 / -7.8% 0.94 / 0.85 / +10.5%
clickbench_q33/duckdb:parquet 451381858 / 443975844 / +1.7% 475739403 / 468324400 / +1.6% 0.95 / 0.95 / +0.1%
clickbench_q34/duckdb:parquet 455243136 / 442022274 / +3.0% 488188792 / 470177699 / +3.8% 0.93 / 0.94 / -0.8%
clickbench_q35/duckdb:parquet 100862531 / 100064506 / +0.8% 128490714 / 128379987 / +0.1% 0.78 / 0.78 / +0.7%
clickbench_q36/duckdb:parquet 31333454 / 32044009 / -2.2% 41808957 / 41217625 / +1.4% 0.75 / 0.78 / -3.6%
clickbench_q37/duckdb:parquet 22679344 / 22631138 / +0.2% 31934954 / 31799443 / +0.4% 0.71 / 0.71 / -0.2%
clickbench_q38/duckdb:parquet 24291214 / 24258892 / +0.1% 33017526 / 33824669 / -2.4% 0.74 / 0.72 / +2.6%
clickbench_q39/duckdb:parquet 56261298 / 56984930 / -1.3% 66201839 / 66304914 / -0.2% 0.85 / 0.86 / -1.1%
clickbench_q40/duckdb:parquet 12920188 / 13301275 / -2.9% 21739063 / 21674612 / +0.3% 0.59 / 0.61 / -3.2%
clickbench_q41/duckdb:parquet 13821837 / 12554974 / +10.1% 🔴 23671221 / 22476078 / +5.3% 0.58 / 0.56 / +4.5%
clickbench_q42/duckdb:parquet 14167128 / 14955780 / -5.3% 23966567 / 24027723 / -0.3% 0.59 / 0.62 / -5.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.978x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24183710 / 23894574 / +1.2% 43553132 / 46193889 / -5.7% 0.56 / 0.52 / +7.3%
tpcds_q02/datafusion:vortex-file-compressed 45245680 / 45636728 / -0.9% 62487477 / 63546792 / -1.7% 0.72 / 0.72 / +0.8%
tpcds_q03/datafusion:vortex-file-compressed 11369822 / 11333912 / +0.3% 29078714 / 30456919 / -4.5% 0.39 / 0.37 / +5.1%
tpcds_q04/datafusion:vortex-file-compressed 110108510 / 112718316 / -2.3% 138361680 / 142150225 / -2.7% 0.80 / 0.79 / +0.4%
tpcds_q05/datafusion:vortex-file-compressed 59412942 / 59829640 / -0.7% 82769929 / 82026147 / +0.9% 0.72 / 0.73 / -1.6%
tpcds_q06/datafusion:vortex-file-compressed 23718849 / 23623544 / +0.4% 45805609 / 47020423 / -2.6% 0.52 / 0.50 / +3.1%
tpcds_q07/datafusion:vortex-file-compressed 31564836 / 31415190 / +0.5% 56375020 / 55400085 / +1.8% 0.56 / 0.57 / -1.3%
tpcds_q08/datafusion:vortex-file-compressed 25799993 / 25863388 / -0.2% 45353700 / 46464766 / -2.4% 0.57 / 0.56 / +2.2%
tpcds_q09/datafusion:vortex-file-compressed 18005229 / 17718475 / +1.6% 37152682 / 37117103 / +0.1% 0.48 / 0.48 / +1.5%
tpcds_q10/datafusion:vortex-file-compressed 29254622 / 28995282 / +0.9% 50117577 / 51607776 / -2.9% 0.58 / 0.56 / +3.9%
tpcds_q11/datafusion:vortex-file-compressed 60527441 / 60135320 / +0.7% 83351602 / 86454139 / -3.6% 0.73 / 0.70 / +4.4%
tpcds_q12/datafusion:vortex-file-compressed 16052196 / 16198960 / -0.9% 32969601 / 34126787 / -3.4% 0.49 / 0.47 / +2.6%
tpcds_q13/datafusion:vortex-file-compressed 36906932 / 37353443 / -1.2% 58003540 / 60240272 / -3.7% 0.64 / 0.62 / +2.6%
tpcds_q14/datafusion:vortex-file-compressed 96429618 / 98080407 / -1.7% 119023059 / 121451744 / -2.0% 0.81 / 0.81 / +0.3%
tpcds_q15/datafusion:vortex-file-compressed 24721006 / 24500371 / +0.9% 45916487 / 46249047 / -0.7% 0.54 / 0.53 / +1.6%
tpcds_q16/datafusion:vortex-file-compressed 21165946 / 21325269 / -0.7% 42621557 / 44508697 / -4.2% 0.50 / 0.48 / +3.6%
tpcds_q17/datafusion:vortex-file-compressed 57051144 / 60312912 / -5.4% 84012881 / 88347789 / -4.9% 0.68 / 0.68 / -0.5%
tpcds_q18/datafusion:vortex-file-compressed 68922919 / 68234646 / +1.0% 94016870 / 94528715 / -0.5% 0.73 / 0.72 / +1.6%
tpcds_q19/datafusion:vortex-file-compressed 18109679 / 17891158 / +1.2% 40422544 / 42736210 / -5.4% 0.45 / 0.42 / +7.0%
tpcds_q20/datafusion:vortex-file-compressed 17390094 / 17507923 / -0.7% 34448526 / 36188087 / -4.8% 0.50 / 0.48 / +4.3%
tpcds_q21/datafusion:vortex-file-compressed 16849108 / 17082104 / -1.4% 40090981 / 41437570 / -3.2% 0.42 / 0.41 / +1.9%
tpcds_q22/datafusion:vortex-file-compressed 48774256 / 50202671 / -2.8% 69316320 / 71625365 / -3.2% 0.70 / 0.70 / +0.4%
tpcds_q23/datafusion:vortex-file-compressed 71632326 / 71092012 / +0.8% 97300272 / 98752109 / -1.5% 0.74 / 0.72 / +2.3%
tpcds_q24/datafusion:vortex-file-compressed 69183004 / 68634776 / +0.8% 93168382 / 94862807 / -1.8% 0.74 / 0.72 / +2.6%
tpcds_q25/datafusion:vortex-file-compressed 51357838 / 51118274 / +0.5% 80103352 / 83506702 / -4.1% 0.64 / 0.61 / +4.7%
tpcds_q26/datafusion:vortex-file-compressed 30261662 / 30512564 / -0.8% 52818849 / 52841840 / -0.0% 0.57 / 0.58 / -0.8%
tpcds_q27/datafusion:vortex-file-compressed 64752920 / 60136492 / +7.7% 83733004 / 92645808 / -9.6% 0.77 / 0.65 / +19.1%
tpcds_q28/datafusion:vortex-file-compressed 18080660 / 18065720 / +0.1% 38287939 / 38774002 / -1.3% 0.47 / 0.47 / +1.4%
tpcds_q29/datafusion:vortex-file-compressed 58998563 / 60332210 / -2.2% 81349954 / 82488479 / -1.4% 0.73 / 0.73 / -0.8%
tpcds_q30/datafusion:vortex-file-compressed 27849090 / 27747779 / +0.4% 46647861 / 46124898 / +1.1% 0.60 / 0.60 / -0.8%
tpcds_q31/datafusion:vortex-file-compressed 62964597 / 64037798 / -1.7% 90748380 / 91355262 / -0.7% 0.69 / 0.70 / -1.0%
tpcds_q32/datafusion:vortex-file-compressed 14042618 / 13690628 / +2.6% 32095571 / 33641315 / -4.6% 0.44 / 0.41 / +7.5%
tpcds_q33/datafusion:vortex-file-compressed 26376356 / 26683173 / -1.1% 48173602 / 49737848 / -3.1% 0.55 / 0.54 / +2.1%
tpcds_q34/datafusion:vortex-file-compressed 17980212 / 18020482 / -0.2% 38583881 / 39108109 / -1.3% 0.47 / 0.46 / +1.1%
tpcds_q35/datafusion:vortex-file-compressed 35227968 / 35451111 / -0.6% 57157599 / 60062315 / -4.8% 0.62 / 0.59 / +4.4%
tpcds_q36/datafusion:vortex-file-compressed 46631424 / 48763095 / -4.4% 68711626 / 70682247 / -2.8% 0.68 / 0.69 / -1.6%
tpcds_q37/datafusion:vortex-file-compressed 14033460 / 13209114 / +6.2% 34127932 / 35457718 / -3.8% 0.41 / 0.37 / +10.4%
tpcds_q38/datafusion:vortex-file-compressed 30092398 / 30124456 / -0.1% 52094589 / 51461999 / +1.2% 0.58 / 0.59 / -1.3%
tpcds_q39/datafusion:vortex-file-compressed 64754462 / 64693658 / +0.1% 91557718 / 92554698 / -1.1% 0.71 / 0.70 / +1.2%
tpcds_q40/datafusion:vortex-file-compressed 25035886 / 25279660 / -1.0% 46287038 / 46039710 / +0.5% 0.54 / 0.55 / -1.5%
tpcds_q41/datafusion:vortex-file-compressed 16335216 / 16180359 / +1.0% 32054579 / 32611070 / -1.7% 0.51 / 0.50 / +2.7%
tpcds_q42/datafusion:vortex-file-compressed 10761904 / 11024392 / -2.4% 28702463 / 28635036 / +0.2% 0.37 / 0.38 / -2.6%
tpcds_q43/datafusion:vortex-file-compressed 12715119 / 12637028 / +0.6% 33093440 / 33574187 / -1.4% 0.38 / 0.38 / +2.1%
tpcds_q44/datafusion:vortex-file-compressed 26995836 / 26188338 / +3.1% 49619393 / 51077413 / -2.9% 0.54 / 0.51 / +6.1%
tpcds_q45/datafusion:vortex-file-compressed 28363374 / 27957711 / +1.5% 48861746 / 51262851 / -4.7% 0.58 / 0.55 / +6.4%
tpcds_q46/datafusion:vortex-file-compressed 23915716 / 23878860 / +0.2% 47746318 / 48186621 / -0.9% 0.50 / 0.50 / +1.1%
tpcds_q47/datafusion:vortex-file-compressed 76894198 / 77463244 / -0.7% 104585105 / 106677863 / -2.0% 0.74 / 0.73 / +1.3%
tpcds_q48/datafusion:vortex-file-compressed 31875770 / 31649602 / +0.7% 52593279 / 54571631 / -3.6% 0.61 / 0.58 / +4.5%
tpcds_q49/datafusion:vortex-file-compressed 59285174 / 59083224 / +0.3% 88317273 / 84965264 / +3.9% 0.67 / 0.70 / -3.5%
tpcds_q50/datafusion:vortex-file-compressed 33577176 / 32830884 / +2.3% 53519225 / 55716495 / -3.9% 0.63 / 0.59 / +6.5%
tpcds_q51/datafusion:vortex-file-compressed 60489738 / 61122573 / -1.0% 85729696 / 84935640 / +0.9% 0.71 / 0.72 / -2.0%
tpcds_q52/datafusion:vortex-file-compressed 11507835 / 11047801 / +4.2% 29112366 / 30276066 / -3.8% 0.40 / 0.36 / +8.3%
tpcds_q53/datafusion:vortex-file-compressed 17992778 / 18185225 / -1.1% 38353972 / 39465567 / -2.8% 0.47 / 0.46 / +1.8%
tpcds_q54/datafusion:vortex-file-compressed 33834005 / 33862202 / -0.1% 58021183 / 58282083 / -0.4% 0.58 / 0.58 / +0.4%
tpcds_q55/datafusion:vortex-file-compressed 10839930 / 10951988 / -1.0% 27899343 / 27849747 / +0.2% 0.39 / 0.39 / -1.2%
tpcds_q56/datafusion:vortex-file-compressed 25912185 / 26056216 / -0.6% 47768687 / 50133211 / -4.7% 0.54 / 0.52 / +4.4%
tpcds_q57/datafusion:vortex-file-compressed 74037269 / 73283342 / +1.0% 99196182 / 99748390 / -0.6% 0.75 / 0.73 / +1.6%
tpcds_q58/datafusion:vortex-file-compressed 40252238 / 40372194 / -0.3% 65724612 / 67237217 / -2.2% 0.61 / 0.60 / +2.0%
tpcds_q59/datafusion:vortex-file-compressed 30531084 / 30716810 / -0.6% 52486537 / 51791553 / +1.3% 0.58 / 0.59 / -1.9%
tpcds_q60/datafusion:vortex-file-compressed 26366092 / 25924039 / +1.7% 47406948 / 47898600 / -1.0% 0.56 / 0.54 / +2.8%
tpcds_q61/datafusion:vortex-file-compressed 23623276 / 23724443 / -0.4% 47385913 / 49288162 / -3.9% 0.50 / 0.48 / +3.6%
tpcds_q62/datafusion:vortex-file-compressed 17425202 / 17392212 / +0.2% 36252471 / 36175943 / +0.2% 0.48 / 0.48 / -0.0%
tpcds_q63/datafusion:vortex-file-compressed 18105208 / 17998110 / +0.6% 36988403 / 39899700 / -7.3% 0.49 / 0.45 / +8.5%
tpcds_q64/datafusion:vortex-file-compressed 325159730 / 325687288 / -0.2% 358661658 / 359448499 / -0.2% 0.91 / 0.91 / +0.1%
tpcds_q65/datafusion:vortex-file-compressed 74427124 / 74318789 / +0.1% 95254146 / 98866079 / -3.7% 0.78 / 0.75 / +3.9%
tpcds_q66/datafusion:vortex-file-compressed 52298776 / 52369228 / -0.1% 74878355 / 77639198 / -3.6% 0.70 / 0.67 / +3.5%
tpcds_q67/datafusion:vortex-file-compressed 55000506 / 54868596 / +0.2% 81967273 / 83834316 / -2.2% 0.67 / 0.65 / +2.5%
tpcds_q68/datafusion:vortex-file-compressed 22961017 / 23191213 / -1.0% 47626027 / 47652408 / -0.1% 0.48 / 0.49 / -0.9%
tpcds_q69/datafusion:vortex-file-compressed 28800931 / 28142982 / +2.3% 47137994 / 50312244 / -6.3% 0.61 / 0.56 / +9.2%
tpcds_q70/datafusion:vortex-file-compressed 69339946 / 69899169 / -0.8% 90890407 / 91586439 / -0.8% 0.76 / 0.76 / -0.0%
tpcds_q71/datafusion:vortex-file-compressed 19107640 / 19101189 / +0.0% 41274234 / 42206246 / -2.2% 0.46 / 0.45 / +2.3%
tpcds_q72/datafusion:vortex-file-compressed 461448479 / 459034075 / +0.5% 506939690 / 499519498 / +1.5% 0.91 / 0.92 / -0.9%
tpcds_q73/datafusion:vortex-file-compressed 16492377 / 16638602 / -0.9% 37923792 / 39707461 / -4.5% 0.43 / 0.42 / +3.8%
tpcds_q74/datafusion:vortex-file-compressed 45392163 / 44521594 / +2.0% 66117881 / 69983604 / -5.5% 0.69 / 0.64 / +7.9%
tpcds_q75/datafusion:vortex-file-compressed 130938242 / 128992039 / +1.5% 157021106 / 155532396 / +1.0% 0.83 / 0.83 / +0.5%
tpcds_q76/datafusion:vortex-file-compressed 40806078 / 41355140 / -1.3% 63951370 / 64470537 / -0.8% 0.64 / 0.64 / -0.5%
tpcds_q77/datafusion:vortex-file-compressed 35210064 / 36642250 / -3.9% 57230725 / 59844630 / -4.4% 0.62 / 0.61 / +0.5%
tpcds_q78/datafusion:vortex-file-compressed 78863940 / 78823027 / +0.1% 106146154 / 110125040 / -3.6% 0.74 / 0.72 / +3.8%
tpcds_q79/datafusion:vortex-file-compressed 19609203 / 20074038 / -2.3% 41930654 / 41516265 / +1.0% 0.47 / 0.48 / -3.3%
tpcds_q80/datafusion:vortex-file-compressed 76030922 / 77206522 / -1.5% 104539467 / 105476674 / -0.9% 0.73 / 0.73 / -0.6%
tpcds_q81/datafusion:vortex-file-compressed 28084354 / 28067926 / +0.1% 45327130 / 46076185 / -1.6% 0.62 / 0.61 / +1.7%
tpcds_q82/datafusion:vortex-file-compressed 12817532 / 13156396 / -2.6% 36283674 / 39626380 / -8.4% 0.35 / 0.33 / +6.4%
tpcds_q83/datafusion:vortex-file-compressed 36178962 / 37117598 / -2.5% 55743411 / 58760917 / -5.1% 0.65 / 0.63 / +2.7%
tpcds_q84/datafusion:vortex-file-compressed 12547891 / 12653948 / -0.8% 28739399 / 31790145 / -9.6% 0.44 / 0.40 / +9.7%
tpcds_q85/datafusion:vortex-file-compressed 61365090 / 61638981 / -0.4% 85207454 / 86064154 / -1.0% 0.72 / 0.72 / +0.6%
tpcds_q86/datafusion:vortex-file-compressed 16577114 / 16043588 / +3.3% 32821593 / 34316388 / -4.4% 0.51 / 0.47 / +8.0%
tpcds_q87/datafusion:vortex-file-compressed 30177626 / 29924400 / +0.8% 50122473 / 51258944 / -2.2% 0.60 / 0.58 / +3.1%
tpcds_q88/datafusion:vortex-file-compressed 32736160 / 32172400 / +1.8% 58188701 / 56382266 / +3.2% 0.56 / 0.57 / -1.4%
tpcds_q89/datafusion:vortex-file-compressed 20558756 / 20601074 / -0.2% 41494705 / 40956771 / +1.3% 0.50 / 0.50 / -1.5%
tpcds_q90/datafusion:vortex-file-compressed 10625962 / 10853583 / -2.1% 27462645 / 27895235 / -1.6% 0.39 / 0.39 / -0.6%
tpcds_q91/datafusion:vortex-file-compressed 18297133 / 18107774 / +1.0% 37817481 / 40677768 / -7.0% 0.48 / 0.45 / +8.7%
tpcds_q92/datafusion:vortex-file-compressed 14361611 / 14175211 / +1.3% 31796435 / 33856264 / -6.1% 0.45 / 0.42 / +7.9%
tpcds_q93/datafusion:vortex-file-compressed 22435934 / 22799226 / -1.6% 45772202 / 44815295 / +2.1% 0.49 / 0.51 / -3.7%
tpcds_q94/datafusion:vortex-file-compressed 20242518 / 20289223 / -0.2% 40343183 / 42121091 / -4.2% 0.50 / 0.48 / +4.2%
tpcds_q95/datafusion:vortex-file-compressed 46527262 / 45882135 / +1.4% 69033984 / 69228329 / -0.3% 0.67 / 0.66 / +1.7%
tpcds_q96/datafusion:vortex-file-compressed 8126328 / 8364336 / -2.8% 25491810 / 26703423 / -4.5% 0.32 / 0.31 / +1.8%
tpcds_q97/datafusion:vortex-file-compressed 20875214 / 20824040 / +0.2% 44444108 / 44819958 / -0.8% 0.47 / 0.46 / +1.1%
tpcds_q98/datafusion:vortex-file-compressed 16448148 / 16779186 / -2.0% 36946681 / 38031616 / -2.9% 0.45 / 0.44 / +0.9%
tpcds_q99/datafusion:vortex-file-compressed 20054477 / 20264175 / -1.0% 39003103 / 40433946 / -3.5% 0.51 / 0.50 / +2.6%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 28829093 / 28215470 / +2.2% 51452713 / 45117510 / +14.0% 🔴 0.56 / 0.63 / -10.4%
tpcds_q02/datafusion:parquet 44090288 / 44704220 / -1.4% 60225185 / 62712678 / -4.0% 0.73 / 0.71 / +2.7%
tpcds_q03/datafusion:parquet 18985174 / 18694660 / +1.6% 32231994 / 35268551 / -8.6% 0.59 / 0.53 / +11.1%
tpcds_q04/datafusion:parquet 194802448 / 195791867 / -0.5% 219070621 / 220710310 / -0.7% 0.89 / 0.89 / +0.2%
tpcds_q05/datafusion:parquet 71617360 / 68608300 / +4.4% 88865278 / 95053051 / -6.5% 0.81 / 0.72 / +11.7%
tpcds_q06/datafusion:parquet 35005860 / 34355915 / +1.9% 50843450 / 53768792 / -5.4% 0.69 / 0.64 / +7.8%
tpcds_q07/datafusion:parquet 46532038 / 45950709 / +1.3% 68140076 / 69411597 / -1.8% 0.68 / 0.66 / +3.2%
tpcds_q08/datafusion:parquet 39689596 / 38696398 / +2.6% 55059765 / 56034069 / -1.7% 0.72 / 0.69 / +4.4%
tpcds_q09/datafusion:parquet 30368984 / 30232412 / +0.5% 38678480 / 39420691 / -1.9% 0.79 / 0.77 / +2.4%
tpcds_q10/datafusion:parquet 49282067 / 50549313 / -2.5% 60405980 / 66830994 / -9.6% 0.82 / 0.76 / +7.9%
tpcds_q11/datafusion:parquet 92469802 / 92876663 / -0.4% 116589151 / 114542384 / +1.8% 0.79 / 0.81 / -2.2%
tpcds_q12/datafusion:parquet 23947356 / 24146842 / -0.8% 37618161 / 37252892 / +1.0% 0.64 / 0.65 / -1.8%
tpcds_q13/datafusion:parquet 45504008 / 44429684 / +2.4% 65560208 / 66576053 / -1.5% 0.69 / 0.67 / +4.0%
tpcds_q14/datafusion:parquet 137242976 / 136193102 / +0.8% 149760572 / 156189340 / -4.1% 0.92 / 0.87 / +5.1%
tpcds_q15/datafusion:parquet 30606352 / 30725210 / -0.4% 48852572 / 49532346 / -1.4% 0.63 / 0.62 / +1.0%
tpcds_q16/datafusion:parquet 36598390 / 36849622 / -0.7% 56990683 / 57267688 / -0.5% 0.64 / 0.64 / -0.2%
tpcds_q17/datafusion:parquet 73799679 / 73106500 / +0.9% 98875476 / 101924997 / -3.0% 0.75 / 0.72 / +4.1%
tpcds_q18/datafusion:parquet 57659139 / 55622767 / +3.7% 73832823 / 77493905 / -4.7% 0.78 / 0.72 / +8.8%
tpcds_q19/datafusion:parquet 31530843 / 31563756 / -0.1% 51733218 / 50631368 / +2.2% 0.61 / 0.62 / -2.2%
tpcds_q20/datafusion:parquet 25586770 / 25775018 / -0.7% 40582033 / 38307318 / +5.9% 0.63 / 0.67 / -6.3%
tpcds_q21/datafusion:parquet 20147188 / 20127822 / +0.1% 34176126 / 35169295 / -2.8% 0.59 / 0.57 / +3.0%
tpcds_q22/datafusion:parquet 77103898 / 77164578 / -0.1% 92256298 / 93810476 / -1.7% 0.84 / 0.82 / +1.6%
tpcds_q23/datafusion:parquet 113059730 / 115003934 / -1.7% 134093242 / 139842594 / -4.1% 0.84 / 0.82 / +2.5%
tpcds_q24/datafusion:parquet 88288260 / 89949330 / -1.8% 116874720 / 116533625 / +0.3% 0.76 / 0.77 / -2.1%
tpcds_q25/datafusion:parquet 73757103 / 74016560 / -0.4% 98531520 / 100430147 / -1.9% 0.75 / 0.74 / +1.6%
tpcds_q26/datafusion:parquet 42629694 / 43286757 / -1.5% 58951917 / 60466861 / -2.5% 0.72 / 0.72 / +1.0%
tpcds_q27/datafusion:parquet 78268424 / 76470938 / +2.4% 105793724 / 97959801 / +8.0% 0.74 / 0.78 / -5.2%
tpcds_q28/datafusion:parquet 26594933 / 26972798 / -1.4% 45075521 / 43351426 / +4.0% 0.59 / 0.62 / -5.2%
tpcds_q29/datafusion:parquet 75163603 / 75395784 / -0.3% 101287648 / 98873756 / +2.4% 0.74 / 0.76 / -2.7%
tpcds_q30/datafusion:parquet 47982506 / 44948320 / +6.8% 67101649 / 66803507 / +0.4% 0.72 / 0.67 / +6.3%
tpcds_q31/datafusion:parquet 89968507 / 87413859 / +2.9% 107022482 / 111144440 / -3.7% 0.84 / 0.79 / +6.9%
tpcds_q32/datafusion:parquet 25854522 / 25478400 / +1.5% 41496618 / 42871417 / -3.2% 0.62 / 0.59 / +4.8%
tpcds_q33/datafusion:parquet 39234600 / 39788144 / -1.4% 55193593 / 55395033 / -0.4% 0.71 / 0.72 / -1.0%
tpcds_q34/datafusion:parquet 23751795 / 23419060 / +1.4% 38146979 / 38678557 / -1.4% 0.62 / 0.61 / +2.8%
tpcds_q35/datafusion:parquet 54664086 / 52504748 / +4.1% 71638002 / 73428939 / -2.4% 0.76 / 0.72 / +6.7%
tpcds_q36/datafusion:parquet 53133873 / 50484560 / +5.2% 71319541 / 71557826 / -0.3% 0.75 / 0.71 / +5.6%
tpcds_q37/datafusion:parquet 25506588 / 25126450 / +1.5% 42570569 / 43182999 / -1.4% 0.60 / 0.58 / +3.0%
tpcds_q38/datafusion:parquet 44408066 / 44905415 / -1.1% 61933882 / 63043169 / -1.8% 0.72 / 0.71 / +0.7%
tpcds_q39/datafusion:parquet 71571734 / 71625048 / -0.1% 90127617 / 90565637 / -0.5% 0.79 / 0.79 / +0.4%
tpcds_q40/datafusion:parquet 27420426 / 28783132 / -4.7% 51013971 / 50333227 / +1.4% 0.54 / 0.57 / -6.0%
tpcds_q41/datafusion:parquet 19789716 / 19533198 / +1.3% 33500311 / 34526850 / -3.0% 0.59 / 0.57 / +4.4%
tpcds_q42/datafusion:parquet 18085502 / 18000834 / +0.5% 33296383 / 32705532 / +1.8% 0.54 / 0.55 / -1.3%
tpcds_q43/datafusion:parquet 19068479 / 19411455 / -1.8% 33376830 / 34671389 / -3.7% 0.57 / 0.56 / +2.0%
tpcds_q44/datafusion:parquet 33488606 / 34478970 / -2.9% 51852993 / 53724839 / -3.5% 0.65 / 0.64 / +0.6%
tpcds_q45/datafusion:parquet 38755462 / 37951198 / +2.1% 55207314 / 53595229 / +3.0% 0.70 / 0.71 / -0.9%
tpcds_q46/datafusion:parquet 29298334 / 29396847 / -0.3% 48912425 / 48343373 / +1.2% 0.60 / 0.61 / -1.5%
tpcds_q47/datafusion:parquet 97438693 / 98229408 / -0.8% 119685435 / 122731915 / -2.5% 0.81 / 0.80 / +1.7%
tpcds_q48/datafusion:parquet 40818151 / 41566739 / -1.8% 62278474 / 61758901 / +0.8% 0.66 / 0.67 / -2.6%
tpcds_q49/datafusion:parquet 74755752 / 72502879 / +3.1% 97502495 / 94068642 / +3.7% 0.77 / 0.77 / -0.5%
tpcds_q50/datafusion:parquet 46582456 / 47651676 / -2.2% 67877349 / 71237209 / -4.7% 0.69 / 0.67 / +2.6%
tpcds_q51/datafusion:parquet 70856054 / 71174378 / -0.4% 91523674 / 92461274 / -1.0% 0.77 / 0.77 / +0.6%
tpcds_q52/datafusion:parquet 18497996 / 18498717 / -0.0% 30456474 / 32440218 / -6.1% 0.61 / 0.57 / +6.5%
tpcds_q53/datafusion:parquet 22039690 / 23167027 / -4.9% 38901315 / 40938428 / -5.0% 0.57 / 0.57 / +0.1%
tpcds_q54/datafusion:parquet 54193588 / 54401252 / -0.4% 75359025 / 75250185 / +0.1% 0.72 / 0.72 / -0.5%
tpcds_q55/datafusion:parquet 18124592 / 17804960 / +1.8% 32804135 / 33820632 / -3.0% 0.55 / 0.53 / +4.9%
tpcds_q56/datafusion:parquet 45222720 / 44112185 / +2.5% 61190262 / 64017737 / -4.4% 0.74 / 0.69 / +7.3%
tpcds_q57/datafusion:parquet 99021956 / 100277081 / -1.3% 121168707 / 119864416 / +1.1% 0.82 / 0.84 / -2.3%
tpcds_q58/datafusion:parquet 63377879 / 62889842 / +0.8% 82220194 / 84122475 / -2.3% 0.77 / 0.75 / +3.1%
tpcds_q59/datafusion:parquet 48271212 / 45293594 / +6.6% 64108841 / 64408486 / -0.5% 0.75 / 0.70 / +7.1%
tpcds_q60/datafusion:parquet 44510594 / 44643028 / -0.3% 62299890 / 63464310 / -1.8% 0.71 / 0.70 / +1.6%
tpcds_q61/datafusion:parquet 37951485 / 37159710 / +2.1% 58134725 / 60431338 / -3.8% 0.65 / 0.61 / +6.2%
tpcds_q62/datafusion:parquet 25128388 / 25425294 / -1.2% 38591933 / 40188605 / -4.0% 0.65 / 0.63 / +2.9%
tpcds_q63/datafusion:parquet 22202715 / 22296578 / -0.4% 40333364 / 40948919 / -1.5% 0.55 / 0.54 / +1.1%
tpcds_q64/datafusion:parquet 203068726 / 205971823 / -1.4% 236402893 / 229757136 / +2.9% 0.86 / 0.90 / -4.2%
tpcds_q65/datafusion:parquet 36601105 / 36318148 / +0.8% 56924029 / 58203357 / -2.2% 0.64 / 0.62 / +3.0%
tpcds_q66/datafusion:parquet 61746942 / 61320468 / +0.7% 77641187 / 79075657 / -1.8% 0.80 / 0.78 / +2.6%
tpcds_q67/datafusion:parquet 69017928 / 69045970 / -0.0% 92924357 / 94942054 / -2.1% 0.74 / 0.73 / +2.1%
tpcds_q68/datafusion:parquet 29207938 / 29600473 / -1.3% 50810839 / 50690061 / +0.2% 0.57 / 0.58 / -1.6%
tpcds_q69/datafusion:parquet 50109125 / 50216333 / -0.2% 64444034 / 65269988 / -1.3% 0.78 / 0.77 / +1.1%
tpcds_q70/datafusion:parquet 36276050 / 36443588 / -0.5% 57158698 / 57601891 / -0.8% 0.63 / 0.63 / +0.3%
tpcds_q71/datafusion:parquet 27092092 / 28299972 / -4.3% 44550339 / 45240931 / -1.5% 0.61 / 0.63 / -2.8%
tpcds_q72/datafusion:parquet 554408014 / 549346832 / +0.9% 579635981 / 567434791 / +2.2% 0.96 / 0.97 / -1.2%
tpcds_q73/datafusion:parquet 22412052 / 22271896 / +0.6% 39119467 / 39157197 / -0.1% 0.57 / 0.57 / +0.7%
tpcds_q74/datafusion:parquet 67991810 / 69327130 / -1.9% 88953912 / 85967855 / +3.5% 0.76 / 0.81 / -5.2%
tpcds_q75/datafusion:parquet 148853076 / 145902848 / +2.0% 174043155 / 168344558 / +3.4% 0.86 / 0.87 / -1.3%
tpcds_q76/datafusion:parquet 53128016 / 52598886 / +1.0% 72291364 / 72485778 / -0.3% 0.73 / 0.73 / +1.3%
tpcds_q77/datafusion:parquet 55237462 / 54995418 / +0.4% 73107732 / 78166793 / -6.5% 0.76 / 0.70 / +7.4%
tpcds_q78/datafusion:parquet 91524629 / 90837538 / +0.8% 119735748 / 128729585 / -7.0% 0.76 / 0.71 / +8.3%
tpcds_q79/datafusion:parquet 26015840 / 25520373 / +1.9% 45496887 / 45869301 / -0.8% 0.57 / 0.56 / +2.8%
tpcds_q80/datafusion:parquet 78963758 / 80893048 / -2.4% 110598905 / 112808478 / -2.0% 0.71 / 0.72 / -0.4%
tpcds_q81/datafusion:parquet 41372235 / 41788874 / -1.0% 60007471 / 63054052 / -4.8% 0.69 / 0.66 / +4.0%
tpcds_q82/datafusion:parquet 26406890 / 26287692 / +0.5% 39724265 / 42970808 / -7.6% 0.66 / 0.61 / +8.7%
tpcds_q83/datafusion:parquet 57698107 / 55104004 / +4.7% 78274951 / 79234781 / -1.2% 0.74 / 0.70 / +6.0%
tpcds_q84/datafusion:parquet 30416053 / 29690434 / +2.4% 44929494 / 46173572 / -2.7% 0.68 / 0.64 / +5.3%
tpcds_q85/datafusion:parquet 82971482 / 83296621 / -0.4% 106414390 / 109002528 / -2.4% 0.78 / 0.76 / +2.0%
tpcds_q86/datafusion:parquet 20439630 / 19887002 / +2.8% 34201519 / 35400959 / -3.4% 0.60 / 0.56 / +6.4%
tpcds_q87/datafusion:parquet 45810312 / 45615276 / +0.4% 63211522 / 63334493 / -0.2% 0.72 / 0.72 / +0.6%
tpcds_q88/datafusion:parquet 47086150 / 46388881 / +1.5% 63347904 / 70145466 / -9.7% 0.74 / 0.66 / +12.4%
tpcds_q89/datafusion:parquet 25469368 / 25572720 / -0.4% 42869941 / 44030966 / -2.6% 0.59 / 0.58 / +2.3%
tpcds_q90/datafusion:parquet 19186810 / 20147952 / -4.8% 32910544 / 33535511 / -1.9% 0.58 / 0.60 / -3.0%
tpcds_q91/datafusion:parquet 36535922 / 36504632 / +0.1% 53432112 / 55701771 / -4.1% 0.68 / 0.66 / +4.3%
tpcds_q92/datafusion:parquet 25901274 / 25836928 / +0.2% 42581486 / 40462889 / +5.2% 0.61 / 0.64 / -4.7%
tpcds_q93/datafusion:parquet 26029880 / 26081956 / -0.2% 48105998 / 48707464 / -1.2% 0.54 / 0.54 / +1.0%
tpcds_q94/datafusion:parquet 34767207 / 34489254 / +0.8% 51440264 / 51821048 / -0.7% 0.68 / 0.67 / +1.6%
tpcds_q95/datafusion:parquet 64596296 / 64140047 / +0.7% 81839493 / 79728685 / +2.6% 0.79 / 0.80 / -1.9%
tpcds_q96/datafusion:parquet 16772274 / 16380361 / +2.4% 29621180 / 32550090 / -9.0% 0.57 / 0.50 / +12.5%
tpcds_q97/datafusion:parquet 35192392 / 35405434 / -0.6% 54732801 / 53857158 / +1.6% 0.64 / 0.66 / -2.2%
tpcds_q98/datafusion:parquet 25015910 / 25201242 / -0.7% 39261347 / 40814183 / -3.8% 0.64 / 0.62 / +3.2%
tpcds_q99/datafusion:parquet 30359050 / 29982049 / +1.3% 44768661 / 42308273 / +5.8% 0.68 / 0.71 / -4.3%
duckdb / vortex-file-compressed / ns (0.995x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15307690 / 15767622 / -2.9% 26171200 / 27146453 / -3.6% 0.58 / 0.58 / +0.7%
tpcds_q02/duckdb:vortex-file-compressed 15537052 / 15390330 / +1.0% 20954615 / 21825309 / -4.0% 0.74 / 0.71 / +5.1%
tpcds_q03/duckdb:vortex-file-compressed 13368716 / 15076562 / -11.3% 🟢 21777783 / 21161651 / +2.9% 0.61 / 0.71 / -13.8%
tpcds_q04/duckdb:vortex-file-compressed 51775563 / 51354462 / +0.8% 62389581 / 67887855 / -8.1% 0.83 / 0.76 / +9.7%
tpcds_q05/duckdb:vortex-file-compressed 19582628 / 19587609 / -0.0% 27196540 / 27702152 / -1.8% 0.72 / 0.71 / +1.8%
tpcds_q06/duckdb:vortex-file-compressed 27204808 / 27531622 / -1.2% 40058424 / 40517802 / -1.1% 0.68 / 0.68 / -0.1%
tpcds_q07/duckdb:vortex-file-compressed 16284704 / 16196489 / +0.5% 27083182 / 29001159 / -6.6% 0.60 / 0.56 / +7.7%
tpcds_q08/duckdb:vortex-file-compressed 22692825 / 23128505 / -1.9% 33289606 / 33607435 / -0.9% 0.68 / 0.69 / -0.9%
tpcds_q09/duckdb:vortex-file-compressed 10921961 / 10545744 / +3.6% 18233930 / 18266451 / -0.2% 0.60 / 0.58 / +3.8%
tpcds_q10/duckdb:vortex-file-compressed 30804750 / 30878212 / -0.2% 45252009 / 43625518 / +3.7% 0.68 / 0.71 / -3.8%
tpcds_q11/duckdb:vortex-file-compressed 41757574 / 40772430 / +2.4% 53162372 / 55865301 / -4.8% 0.79 / 0.73 / +7.6%
tpcds_q12/duckdb:vortex-file-compressed 10755543 / 10915596 / -1.5% 17493970 / 17714957 / -1.2% 0.61 / 0.62 / -0.2%
tpcds_q13/duckdb:vortex-file-compressed 22930214 / 21056430 / +8.9% 36384963 / 34562819 / +5.3% 0.63 / 0.61 / +3.4%
tpcds_q14/duckdb:vortex-file-compressed 58895280 / 60478294 / -2.6% 76152765 / 73496910 / +3.6% 0.77 / 0.82 / -6.0%
tpcds_q15/duckdb:vortex-file-compressed 22003059 / 22381292 / -1.7% 29073020 / 28376109 / +2.5% 0.76 / 0.79 / -4.0%
tpcds_q16/duckdb:vortex-file-compressed 21757293 / 24526130 / -11.3% 🟢 27987881 / 35765576 / -21.7% 🟢 0.78 / 0.69 / +13.4%
tpcds_q17/duckdb:vortex-file-compressed 31005100 / 31694836 / -2.2% 49977377 / 47135616 / +6.0% 0.62 / 0.67 / -7.7%
tpcds_q18/duckdb:vortex-file-compressed 29401008 / 29741676 / -1.1% 38195549 / 40377928 / -5.4% 0.77 / 0.74 / +4.5%
tpcds_q19/duckdb:vortex-file-compressed 24480664 / 24936444 / -1.8% 34507530 / 35689282 / -3.3% 0.71 / 0.70 / +1.5%
tpcds_q20/duckdb:vortex-file-compressed 11051742 / 11777968 / -6.2% 17080678 / 17119258 / -0.2% 0.65 / 0.69 / -6.0%
tpcds_q21/duckdb:vortex-file-compressed 13196080 / 10654742 / +23.9% 🔴 19464443 / 21096301 / -7.7% 0.68 / 0.51 / +34.2%
tpcds_q22/duckdb:vortex-file-compressed 29242610 / 29555204 / -1.1% 45209493 / 45832349 / -1.4% 0.65 / 0.64 / +0.3%
tpcds_q23/duckdb:vortex-file-compressed 35508413 / 37091459 / -4.3% 48042875 / 51212657 / -6.2% 0.74 / 0.72 / +2.0%
tpcds_q24/duckdb:vortex-file-compressed 28813324 / 29697586 / -3.0% 38028998 / 40610193 / -6.4% 0.76 / 0.73 / +3.6%
tpcds_q25/duckdb:vortex-file-compressed 26269087 / 26870340 / -2.2% 38206249 / 41686890 / -8.3% 0.69 / 0.64 / +6.7%
tpcds_q26/duckdb:vortex-file-compressed 14912003 / 14892564 / +0.1% 24804475 / 20926067 / +18.5% 🔴 0.60 / 0.71 / -15.5%
tpcds_q27/duckdb:vortex-file-compressed 17580346 / 17207208 / +2.2% 29464280 / 27527014 / +7.0% 0.60 / 0.63 / -4.5%
tpcds_q28/duckdb:vortex-file-compressed 7913543 / 8321512 / -4.9% 12381373 / 12773314 / -3.1% 0.64 / 0.65 / -1.9%
tpcds_q29/duckdb:vortex-file-compressed 29886402 / 30562575 / -2.2% 44719338 / 47031024 / -4.9% 0.67 / 0.65 / +2.8%
tpcds_q30/duckdb:vortex-file-compressed 20107264 / 20148958 / -0.2% 28479987 / 28942411 / -1.6% 0.71 / 0.70 / +1.4%
tpcds_q31/duckdb:vortex-file-compressed 19945188 / 19722364 / +1.1% 28978164 / 28631710 / +1.2% 0.69 / 0.69 / -0.1%
tpcds_q32/duckdb:vortex-file-compressed 11080699 / 11067157 / +0.1% 18094341 / 19068371 / -5.1% 0.61 / 0.58 / +5.5%
tpcds_q33/duckdb:vortex-file-compressed 19002377 / 17585488 / +8.1% 31402893 / 30361379 / +3.4% 0.61 / 0.58 / +4.5%
tpcds_q34/duckdb:vortex-file-compressed 14055600 / 14378198 / -2.2% 22032233 / 24104379 / -8.6% 0.64 / 0.60 / +7.0%
tpcds_q35/duckdb:vortex-file-compressed 48305925 / 48769052 / -0.9% 61732970 / 60141632 / +2.6% 0.78 / 0.81 / -3.5%
tpcds_q36/duckdb:vortex-file-compressed 14836021 / 15646646 / -5.2% 28057063 / 31427804 / -10.7% 🟢 0.53 / 0.50 / +6.2%
tpcds_q37/duckdb:vortex-file-compressed 13924160 / 14202212 / -2.0% 21609337 / 22310552 / -3.1% 0.64 / 0.64 / +1.2%
tpcds_q38/duckdb:vortex-file-compressed 22115643 / 22142480 / -0.1% 29691908 / 28773706 / +3.2% 0.74 / 0.77 / -3.2%
tpcds_q39/duckdb:vortex-file-compressed 18478362 / 18767069 / -1.5% 30578336 / 29464995 / +3.8% 0.60 / 0.64 / -5.1%
tpcds_q40/duckdb:vortex-file-compressed 13656359 / 13760641 / -0.8% 20408950 / 19436151 / +5.0% 0.67 / 0.71 / -5.5%
tpcds_q41/duckdb:vortex-file-compressed 6510450 / 6652565 / -2.1% 9851877 / 9615031 / +2.5% 0.66 / 0.69 / -4.5%
tpcds_q42/duckdb:vortex-file-compressed 8295221 / 8558432 / -3.1% 19476614 / 18070439 / +7.8% 0.43 / 0.47 / -10.1%
tpcds_q43/duckdb:vortex-file-compressed 9980094 / 10379994 / -3.9% 18861315 / 18802742 / +0.3% 0.53 / 0.55 / -4.2%
tpcds_q44/duckdb:vortex-file-compressed 14122244 / 14119412 / +0.0% 26069153 / 24978172 / +4.4% 0.54 / 0.57 / -4.2%
tpcds_q45/duckdb:vortex-file-compressed 23592443 / 23765622 / -0.7% 29606189 / 30845657 / -4.0% 0.80 / 0.77 / +3.4%
tpcds_q46/duckdb:vortex-file-compressed 17126162 / 16918715 / +1.2% 26818909 / 30419974 / -11.8% 🟢 0.64 / 0.56 / +14.8%
tpcds_q47/duckdb:vortex-file-compressed 30205528 / 30658056 / -1.5% 42893535 / 40933084 / +4.8% 0.70 / 0.75 / -6.0%
tpcds_q48/duckdb:vortex-file-compressed 19987912 / 19987562 / +0.0% 32287038 / 31004764 / +4.1% 0.62 / 0.64 / -4.0%
tpcds_q49/duckdb:vortex-file-compressed 18005339 / 18142178 / -0.8% 32874678 / 30378671 / +8.2% 0.55 / 0.60 / -8.3%
tpcds_q50/duckdb:vortex-file-compressed 17999164 / 17402414 / +3.4% 29039119 / 28815210 / +0.8% 0.62 / 0.60 / +2.6%
tpcds_q51/duckdb:vortex-file-compressed 51889228 / 52904856 / -1.9% 60545759 / 61572769 / -1.7% 0.86 / 0.86 / -0.3%
tpcds_q52/duckdb:vortex-file-compressed 8655214 / 9025342 / -4.1% 19306978 / 18911304 / +2.1% 0.45 / 0.48 / -6.1%
tpcds_q53/duckdb:vortex-file-compressed 15454299 / 14693190 / +5.2% 24128009 / 27491759 / -12.2% 🟢 0.64 / 0.53 / +19.8%
tpcds_q54/duckdb:vortex-file-compressed 21103192 / 21218384 / -0.5% 31793982 / 34059938 / -6.7% 0.66 / 0.62 / +6.5%
tpcds_q55/duckdb:vortex-file-compressed 8572788 / 8665173 / -1.1% 17606237 / 21038828 / -16.3% 🟢 0.49 / 0.41 / +18.2%
tpcds_q56/duckdb:vortex-file-compressed 17918334 / 17909250 / +0.1% 28828500 / 31053761 / -7.2% 0.62 / 0.58 / +7.8%
tpcds_q57/duckdb:vortex-file-compressed 24635176 / 24690754 / -0.2% 31887505 / 32355218 / -1.4% 0.77 / 0.76 / +1.2%
tpcds_q58/duckdb:vortex-file-compressed 18524840 / 18471747 / +0.3% 27324348 / 28148168 / -2.9% 0.68 / 0.66 / +3.3%
tpcds_q59/duckdb:vortex-file-compressed 18355950 / 18394324 / -0.2% 30314341 / 28811303 / +5.2% 0.61 / 0.64 / -5.2%
tpcds_q60/duckdb:vortex-file-compressed 18555404 / 18240038 / +1.7% 28877221 / 32763615 / -11.9% 🟢 0.64 / 0.56 / +15.4%
tpcds_q61/duckdb:vortex-file-compressed 22377870 / 21036968 / +6.4% 33589743 / 34145753 / -1.6% 0.67 / 0.62 / +8.1%
tpcds_q62/duckdb:vortex-file-compressed 10452156 / 10719328 / -2.5% 16830714 / 19412900 / -13.3% 🟢 0.62 / 0.55 / +12.5%
tpcds_q63/duckdb:vortex-file-compressed 13310701 / 13537562 / -1.7% 22758659 / 25268741 / -9.9% 0.58 / 0.54 / +9.2%
tpcds_q64/duckdb:vortex-file-compressed 63595730 / 64518772 / -1.4% 78783342 / 80166638 / -1.7% 0.81 / 0.80 / +0.3%
tpcds_q65/duckdb:vortex-file-compressed 13274935 / 13305972 / -0.2% 22098766 / 22048916 / +0.2% 0.60 / 0.60 / -0.5%
tpcds_q66/duckdb:vortex-file-compressed 24010699 / 23022168 / +4.3% 32524692 / 29812181 / +9.1% 0.74 / 0.77 / -4.4%
tpcds_q67/duckdb:vortex-file-compressed 65247439 / 65521492 / -0.4% 81513030 / 92303080 / -11.7% 🟢 0.80 / 0.71 / +12.8%
tpcds_q68/duckdb:vortex-file-compressed 16656298 / 16603146 / +0.3% 30218695 / 28130858 / +7.4% 0.55 / 0.59 / -6.6%
tpcds_q69/duckdb:vortex-file-compressed 31727064 / 32275578 / -1.7% 47898175 / 46672609 / +2.6% 0.66 / 0.69 / -4.2%
tpcds_q70/duckdb:vortex-file-compressed 18540852 / 19315760 / -4.0% 30898602 / 32575567 / -5.1% 0.60 / 0.59 / +1.2%
tpcds_q71/duckdb:vortex-file-compressed 13627830 / 13612298 / +0.1% 24203157 / 25311018 / -4.4% 0.56 / 0.54 / +4.7%
tpcds_q72/duckdb:vortex-file-compressed 62607665 / 63955396 / -2.1% 75161213 / 80198043 / -6.3% 0.83 / 0.80 / +4.5%
tpcds_q73/duckdb:vortex-file-compressed 13246134 / 13179984 / +0.5% 21305253 / 20575688 / +3.5% 0.62 / 0.64 / -2.9%
tpcds_q74/duckdb:vortex-file-compressed 28499351 / 28543537 / -0.2% 37708375 / 39062775 / -3.5% 0.76 / 0.73 / +3.4%
tpcds_q75/duckdb:vortex-file-compressed 28709411 / 28848028 / -0.5% 39400999 / 42456632 / -7.2% 0.73 / 0.68 / +7.2%
tpcds_q76/duckdb:vortex-file-compressed 13109430 / 13513077 / -3.0% 24434092 / 25595813 / -4.5% 0.54 / 0.53 / +1.6%
tpcds_q77/duckdb:vortex-file-compressed 16722644 / 16203775 / +3.2% 26006099 / 26004027 / +0.0% 0.64 / 0.62 / +3.2%
tpcds_q78/duckdb:vortex-file-compressed 38928615 / 38137171 / +2.1% 47155250 / 52181174 / -9.6% 0.83 / 0.73 / +13.0%
tpcds_q79/duckdb:vortex-file-compressed 14436390 / 14968889 / -3.6% 23551101 / 25050543 / -6.0% 0.61 / 0.60 / +2.6%
tpcds_q80/duckdb:vortex-file-compressed 28506960 / 28133220 / +1.3% 44937573 / 45659402 / -1.6% 0.63 / 0.62 / +3.0%
tpcds_q81/duckdb:vortex-file-compressed 23681716 / 23370564 / +1.3% 30239191 / 31559297 / -4.2% 0.78 / 0.74 / +5.8%
tpcds_q82/duckdb:vortex-file-compressed 32390830 / 32609356 / -0.7% 40792429 / 40395173 / +1.0% 0.79 / 0.81 / -1.6%
tpcds_q83/duckdb:vortex-file-compressed 22472480 / 20888754 / +7.6% 30972587 / 28586864 / +8.3% 0.73 / 0.73 / -0.7%
tpcds_q84/duckdb:vortex-file-compressed 13506702 / 13821060 / -2.3% 23414807 / 28219499 / -17.0% 🟢 0.58 / 0.49 / +17.8%
tpcds_q85/duckdb:vortex-file-compressed 33242672 / 32983048 / +0.8% 41045374 / 42693484 / -3.9% 0.81 / 0.77 / +4.8%
tpcds_q86/duckdb:vortex-file-compressed 11189204 / 11114504 / +0.7% 19910974 / 18796534 / +5.9% 0.56 / 0.59 / -5.0%
tpcds_q87/duckdb:vortex-file-compressed 23793701 / 23926967 / -0.6% 30782782 / 30994468 / -0.7% 0.77 / 0.77 / +0.1%
tpcds_q88/duckdb:vortex-file-compressed 37449365 / 36258903 / +3.3% 51627916 / 50613056 / +2.0% 0.73 / 0.72 / +1.3%
tpcds_q89/duckdb:vortex-file-compressed 13718703 / 14596978 / -6.0% 23091459 / 23258818 / -0.7% 0.59 / 0.63 / -5.3%
tpcds_q90/duckdb:vortex-file-compressed 8551732 / 8285958 / +3.2% 15950419 / 14424117 / +10.6% 🔴 0.54 / 0.57 / -6.7%
tpcds_q91/duckdb:vortex-file-compressed 17302472 / 17199479 / +0.6% 22912752 / 23628880 / -3.0% 0.76 / 0.73 / +3.7%
tpcds_q92/duckdb:vortex-file-compressed 14251868 / 14369854 / -0.8% 22232873 / 22467500 / -1.0% 0.64 / 0.64 / +0.2%
tpcds_q93/duckdb:vortex-file-compressed 16721554 / 16287928 / +2.7% 22520120 / 28205780 / -20.2% 🟢 0.74 / 0.58 / +28.6%
tpcds_q94/duckdb:vortex-file-compressed 17377496 / 17625714 / -1.4% 28313912 / 30060094 / -5.8% 0.61 / 0.59 / +4.7%
tpcds_q95/duckdb:vortex-file-compressed 71829298 / 72768133 / -1.3% 79674830 / 79968110 / -0.4% 0.90 / 0.91 / -0.9%
tpcds_q96/duckdb:vortex-file-compressed 8487988 / 8614816 / -1.5% 19977446 / 18628233 / +7.2% 0.42 / 0.46 / -8.1%
tpcds_q97/duckdb:vortex-file-compressed 23261874 / 23350213 / -0.4% 32077832 / 30029526 / +6.8% 0.73 / 0.78 / -6.7%
tpcds_q98/duckdb:vortex-file-compressed 14323610 / 15907420 / -10.0% 23907321 / 22857641 / +4.6% 0.60 / 0.70 / -13.9%
tpcds_q99/duckdb:vortex-file-compressed 14418540 / 14519438 / -0.7% 20906249 / 21367943 / -2.2% 0.69 / 0.68 / +1.5%
duckdb / parquet / ns (0.994x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23555208 / 24951902 / -5.6% 33349848 / 32350875 / +3.1% 0.71 / 0.77 / -8.4%
tpcds_q02/duckdb:parquet 15596934 / 15626170 / -0.2% 19787130 / 19783063 / +0.0% 0.79 / 0.79 / -0.2%
tpcds_q03/duckdb:parquet 8781790 / 8668564 / +1.3% 15853999 / 15707913 / +0.9% 0.55 / 0.55 / +0.4%
tpcds_q04/duckdb:parquet 127406272 / 127579752 / -0.1% 132271712 / 132304869 / -0.0% 0.96 / 0.96 / -0.1%
tpcds_q05/duckdb:parquet 21376138 / 21205046 / +0.8% 26413156 / 26455778 / -0.2% 0.81 / 0.80 / +1.0%
tpcds_q06/duckdb:parquet 26491104 / 26768668 / -1.0% 39084039 / 36056911 / +8.4% 0.68 / 0.74 / -8.7%
tpcds_q07/duckdb:parquet 15159377 / 15178936 / -0.1% 22949934 / 24259425 / -5.4% 0.66 / 0.63 / +5.6%
tpcds_q08/duckdb:parquet 25656963 / 25050392 / +2.4% 36505767 / 35504390 / +2.8% 0.70 / 0.71 / -0.4%
tpcds_q09/duckdb:parquet 18386734 / 19513111 / -5.8% 22433529 / 22312207 / +0.5% 0.82 / 0.87 / -6.3%
tpcds_q10/duckdb:parquet 27294917 / 27539989 / -0.9% 37877216 / 40385979 / -6.2% 0.72 / 0.68 / +5.7%
tpcds_q11/duckdb:parquet 71284558 / 71048751 / +0.3% 76593390 / 76481337 / +0.1% 0.93 / 0.93 / +0.2%
tpcds_q12/duckdb:parquet 12671502 / 12657148 / +0.1% 17225466 / 17939140 / -4.0% 0.74 / 0.71 / +4.3%
tpcds_q13/duckdb:parquet 23790928 / 23785254 / +0.0% 31295231 / 30987055 / +1.0% 0.76 / 0.77 / -1.0%
tpcds_q14/duckdb:parquet 60430466 / 60758504 / -0.5% 68085228 / 69010783 / -1.3% 0.89 / 0.88 / +0.8%
tpcds_q15/duckdb:parquet 24730584 / 24856904 / -0.5% 30709733 / 30633753 / +0.2% 0.81 / 0.81 / -0.8%
tpcds_q16/duckdb:parquet 19576489 / 19967654 / -2.0% 28782494 / 29114221 / -1.1% 0.68 / 0.69 / -0.8%
tpcds_q17/duckdb:parquet 31846490 / 32095036 / -0.8% 40342792 / 40583925 / -0.6% 0.79 / 0.79 / -0.2%
tpcds_q18/duckdb:parquet 39583697 / 38539653 / +2.7% 51916665 / 51454352 / +0.9% 0.76 / 0.75 / +1.8%
tpcds_q19/duckdb:parquet 24163533 / 24256114 / -0.4% 34836115 / 32566040 / +7.0% 0.69 / 0.74 / -6.9%
tpcds_q20/duckdb:parquet 13408414 / 13506267 / -0.7% 17851190 / 17938775 / -0.5% 0.75 / 0.75 / -0.2%
tpcds_q21/duckdb:parquet 9388068 / 9425446 / -0.4% 13251496 / 13090845 / +1.2% 0.71 / 0.72 / -1.6%
tpcds_q22/duckdb:parquet 36522948 / 36146152 / +1.0% 39338760 / 38948657 / +1.0% 0.93 / 0.93 / +0.0%
tpcds_q23/duckdb:parquet 40473636 / 41484005 / -2.4% 45860138 / 50113846 / -8.5% 0.88 / 0.83 / +6.6%
tpcds_q24/duckdb:parquet 33042174 / 33239894 / -0.6% 49446604 / 46561575 / +6.2% 0.67 / 0.71 / -6.4%
tpcds_q25/duckdb:parquet 29905723 / 30073885 / -0.6% 39855157 / 40365851 / -1.3% 0.75 / 0.75 / +0.7%
tpcds_q26/duckdb:parquet 30757950 / 31036385 / -0.9% 38991174 / 39231843 / -0.6% 0.79 / 0.79 / -0.3%
tpcds_q27/duckdb:parquet 31607254 / 31710254 / -0.3% 39736549 / 43701274 / -9.1% 0.80 / 0.73 / +9.6%
tpcds_q28/duckdb:parquet 17915491 / 17016244 / +5.3% 19860858 / 20018840 / -0.8% 0.90 / 0.85 / +6.1%
tpcds_q29/duckdb:parquet 30547302 / 30566582 / -0.1% 39049415 / 38654682 / +1.0% 0.78 / 0.79 / -1.1%
tpcds_q30/duckdb:parquet 32281405 / 34287766 / -5.9% 41685850 / 41647072 / +0.1% 0.77 / 0.82 / -5.9%
tpcds_q31/duckdb:parquet 19851558 / 20015948 / -0.8% 27400629 / 29156758 / -6.0% 0.72 / 0.69 / +5.5%
tpcds_q32/duckdb:parquet 11079638 / 11695310 / -5.3% 17325312 / 17464778 / -0.8% 0.64 / 0.67 / -4.5%
tpcds_q33/duckdb:parquet 15647496 / 16091673 / -2.8% 22466768 / 23051422 / -2.5% 0.70 / 0.70 / -0.2%
tpcds_q34/duckdb:parquet 15915212 / 18306832 / -13.1% 🟢 22023868 / 25185682 / -12.6% 🟢 0.72 / 0.73 / -0.6%
tpcds_q35/duckdb:parquet 46494244 / 48418246 / -4.0% 55819396 / 57078166 / -2.2% 0.83 / 0.85 / -1.8%
tpcds_q36/duckdb:parquet 14880938 / 14917626 / -0.2% 22916159 / 23167197 / -1.1% 0.65 / 0.64 / +0.8%
tpcds_q37/duckdb:parquet 11743654 / 11642794 / +0.9% 17697454 / 18850067 / -6.1% 0.66 / 0.62 / +7.4%
tpcds_q38/duckdb:parquet 26599754 / 26203636 / +1.5% 30274304 / 31647161 / -4.3% 0.88 / 0.83 / +6.1%
tpcds_q39/duckdb:parquet 24466928 / 24611726 / -0.6% 30942385 / 32258783 / -4.1% 0.79 / 0.76 / +3.6%
tpcds_q40/duckdb:parquet 15643164 / 16077128 / -2.7% 21174462 / 24459060 / -13.4% 🟢 0.74 / 0.66 / +12.4%
tpcds_q41/duckdb:parquet 10533485 / 7742510 / +36.0% 🔴 14324306 / 12930332 / +10.8% 🔴 0.74 / 0.60 / +22.8%
tpcds_q42/duckdb:parquet 8252220 / 8354242 / -1.2% 14311415 / 15089721 / -5.2% 0.58 / 0.55 / +4.2%
tpcds_q43/duckdb:parquet 10510136 / 11962653 / -12.1% 🟢 15849731 / 18764149 / -15.5% 🟢 0.66 / 0.64 / +4.0%
tpcds_q44/duckdb:parquet 17415065 / 16145678 / +7.9% 22174122 / 21976184 / +0.9% 0.79 / 0.73 / +6.9%
tpcds_q45/duckdb:parquet 22932717 / 24603784 / -6.8% 28754690 / 29699471 / -3.2% 0.80 / 0.83 / -3.7%
tpcds_q46/duckdb:parquet 35895974 / 36234580 / -0.9% 44797981 / 45850722 / -2.3% 0.80 / 0.79 / +1.4%
tpcds_q47/duckdb:parquet 31207486 / 32744938 / -4.7% 37712535 / 37812171 / -0.3% 0.83 / 0.87 / -4.4%
tpcds_q48/duckdb:parquet 20987426 / 21039130 / -0.2% 28717511 / 29242462 / -1.8% 0.73 / 0.72 / +1.6%
tpcds_q49/duckdb:parquet 18871114 / 18963580 / -0.5% 27871995 / 29490831 / -5.5% 0.68 / 0.64 / +5.3%
tpcds_q50/duckdb:parquet 17566095 / 17437694 / +0.7% 24463182 / 24817170 / -1.4% 0.72 / 0.70 / +2.2%
tpcds_q51/duckdb:parquet 52904954 / 52960112 / -0.1% 85348178 / 60024064 / +42.2% 🔴 0.62 / 0.88 / -29.7%
tpcds_q52/duckdb:parquet 8584710 / 8568408 / +0.2% 15048035 / 15359648 / -2.0% 0.57 / 0.56 / +2.3%
tpcds_q53/duckdb:parquet 11562456 / 11845396 / -2.4% 19778409 / 17443091 / +13.4% 🔴 0.58 / 0.68 / -13.9%
tpcds_q54/duckdb:parquet 20651562 / 20367168 / +1.4% 29967167 / 29805252 / +0.5% 0.69 / 0.68 / +0.8%
tpcds_q55/duckdb:parquet 8438142 / 8573510 / -1.6% 15067287 / 14986160 / +0.5% 0.56 / 0.57 / -2.1%
tpcds_q56/duckdb:parquet 16237390 / 17435812 / -6.9% 22901116 / 24986619 / -8.3% 0.71 / 0.70 / +1.6%
tpcds_q57/duckdb:parquet 30121409 / 28994662 / +3.9% 33715433 / 34256397 / -1.6% 0.89 / 0.85 / +5.6%
tpcds_q58/duckdb:parquet 18286886 / 19462104 / -6.0% 26347746 / 26981884 / -2.4% 0.69 / 0.72 / -3.8%
tpcds_q59/duckdb:parquet 19934793 / 19837672 / +0.5% 24916097 / 25353078 / -1.7% 0.80 / 0.78 / +2.3%
tpcds_q60/duckdb:parquet 16818247 / 16879934 / -0.4% 24121027 / 24397688 / -1.1% 0.70 / 0.69 / +0.8%
tpcds_q61/duckdb:parquet 21295752 / 21875174 / -2.6% 30001648 / 29700174 / +1.0% 0.71 / 0.74 / -3.6%
tpcds_q62/duckdb:parquet 10704126 / 10773372 / -0.6% 14976766 / 14873694 / +0.7% 0.71 / 0.72 / -1.3%
tpcds_q63/duckdb:parquet 10847810 / 10894723 / -0.4% 16519595 / 16846442 / -1.9% 0.66 / 0.65 / +1.5%
tpcds_q64/duckdb:parquet 52196150 / 52337107 / -0.3% 65981138 / 68442806 / -3.6% 0.79 / 0.76 / +3.5%
tpcds_q65/duckdb:parquet 14395952 / 14648082 / -1.7% 21082291 / 21318076 / -1.1% 0.68 / 0.69 / -0.6%
tpcds_q66/duckdb:parquet 24402900 / 24491776 / -0.4% 30878912 / 31530136 / -2.1% 0.79 / 0.78 / +1.7%
tpcds_q67/duckdb:parquet 76280112 / 77857968 / -2.0% 90799210 / 90909616 / -0.1% 0.84 / 0.86 / -1.9%
tpcds_q68/duckdb:parquet 29258992 / 29092322 / +0.6% 40028193 / 45951070 / -12.9% 🟢 0.73 / 0.63 / +15.5%
tpcds_q69/duckdb:parquet 28516330 / 28850514 / -1.2% 38486239 / 38298114 / +0.5% 0.74 / 0.75 / -1.6%
tpcds_q70/duckdb:parquet 16492996 / 16068160 / +2.6% 27077740 / 23380833 / +15.8% 🔴 0.61 / 0.69 / -11.4%
tpcds_q71/duckdb:parquet 14776947 / 14674804 / +0.7% 20502621 / 20893250 / -1.9% 0.72 / 0.70 / +2.6%
tpcds_q72/duckdb:parquet 81415904 / 82882356 / -1.8% 86176834 / 87214827 / -1.2% 0.94 / 0.95 / -0.6%
tpcds_q73/duckdb:parquet 13497700 / 13438033 / +0.4% 19695078 / 19885442 / -1.0% 0.69 / 0.68 / +1.4%
tpcds_q74/duckdb:parquet 100777533 / 101698440 / -0.9% 106218162 / 106202065 / +0.0% 0.95 / 0.96 / -0.9%
tpcds_q75/duckdb:parquet 39938943 / 40006483 / -0.2% 50246360 / 49912209 / +0.7% 0.79 / 0.80 / -0.8%
tpcds_q76/duckdb:parquet 13609788 / 14928759 / -8.8% 19437396 / 21186339 / -8.3% 0.70 / 0.70 / -0.6%
tpcds_q77/duckdb:parquet 16616290 / 16898796 / -1.7% 24289405 / 25107194 / -3.3% 0.68 / 0.67 / +1.6%
tpcds_q78/duckdb:parquet 47705750 / 48139868 / -0.9% 53022573 / 53780259 / -1.4% 0.90 / 0.90 / +0.5%
tpcds_q79/duckdb:parquet 20224684 / 20466516 / -1.2% 28956759 / 28582151 / +1.3% 0.70 / 0.72 / -2.5%
tpcds_q80/duckdb:parquet 31289368 / 31091689 / +0.6% 39453040 / 40080858 / -1.6% 0.79 / 0.78 / +2.2%
tpcds_q81/duckdb:parquet 29676032 / 29685418 / -0.0% 37712372 / 39400792 / -4.3% 0.79 / 0.75 / +4.4%
tpcds_q82/duckdb:parquet 13381414 / 14463104 / -7.5% 18077436 / 19912383 / -9.2% 0.74 / 0.73 / +1.9%
tpcds_q83/duckdb:parquet 15504005 / 15734604 / -1.5% 23031473 / 20763375 / +10.9% 🔴 0.67 / 0.76 / -11.2%
tpcds_q84/duckdb:parquet 17181040 / 17549898 / -2.1% 24218170 / 23460050 / +3.2% 0.71 / 0.75 / -5.2%
tpcds_q85/duckdb:parquet 34728093 / 35382808 / -1.9% 45451372 / 46368137 / -2.0% 0.76 / 0.76 / +0.1%
tpcds_q86/duckdb:parquet 13574444 / 10709357 / +26.8% 🔴 18195466 / 15446997 / +17.8% 🔴 0.75 / 0.69 / +7.6%
tpcds_q87/duckdb:parquet 28060212 / 28513860 / -1.6% 31888631 / 31780224 / +0.3% 0.88 / 0.90 / -1.9%
tpcds_q88/duckdb:parquet 27492712 / 26681038 / +3.0% 32519619 / 32586814 / -0.2% 0.85 / 0.82 / +3.3%
tpcds_q89/duckdb:parquet 15536306 / 12634991 / +23.0% 🔴 22764573 / 18728425 / +21.6% 🔴 0.68 / 0.67 / +1.2%
tpcds_q90/duckdb:parquet 9449526 / 9773798 / -3.3% 11344222 / 12999932 / -12.7% 🟢 0.83 / 0.75 / +10.8%
tpcds_q91/duckdb:parquet 20564730 / 20664268 / -0.5% 29874375 / 29204853 / +2.3% 0.69 / 0.71 / -2.7%
tpcds_q92/duckdb:parquet 11391468 / 11409201 / -0.2% 21184864 / 18215973 / +16.3% 🔴 0.54 / 0.63 / -14.1%
tpcds_q93/duckdb:parquet 21133282 / 22325598 / -5.3% 28660092 / 28634308 / +0.1% 0.74 / 0.78 / -5.4%
tpcds_q94/duckdb:parquet 15875092 / 17047378 / -6.9% 27891922 / 25777056 / +8.2% 0.57 / 0.66 / -13.9%
tpcds_q95/duckdb:parquet 89761061 / 89896012 / -0.2% 96323606 / 98000338 / -1.7% 0.93 / 0.92 / +1.6%
tpcds_q96/duckdb:parquet 6850308 / 6962482 / -1.6% 10798143 / 10771313 / +0.2% 0.63 / 0.65 / -1.9%
tpcds_q97/duckdb:parquet 25562466 / 25692746 / -0.5% 31739652 / 31355930 / +1.2% 0.81 / 0.82 / -1.7%
tpcds_q98/duckdb:parquet 14700264 / 15599032 / -5.8% 22069054 / 22193255 / -0.6% 0.67 / 0.70 / -5.2%
tpcds_q99/duckdb:parquet 17216497 / 17137996 / +0.5% 21369848 / 21107313 / +1.2% 0.81 / 0.81 / -0.8%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92162804 / 91073293 / +1.2% 166650681 / 164190427 / +1.5% 0.55 / 0.55 / -0.3%
tpch_q02/datafusion:vortex-file-compressed 65205396 / 62910146 / +3.6% 94233090 / 95092035 / -0.9% 0.69 / 0.66 / +4.6%
tpch_q03/datafusion:vortex-file-compressed 65500636 / 65496714 / +0.0% 114334299 / 116826795 / -2.1% 0.57 / 0.56 / +2.2%
tpch_q04/datafusion:vortex-file-compressed 35109811 / 35004647 / +0.3% 80335163 / 77303889 / +3.9% 0.44 / 0.45 / -3.5%
tpch_q05/datafusion:vortex-file-compressed 119571664 / 116874500 / +2.3% 176380339 / 176918981 / -0.3% 0.68 / 0.66 / +2.6%
tpch_q06/datafusion:vortex-file-compressed 14343808 / 15316208 / -6.3% 75271481 / 75272594 / -0.0% 0.19 / 0.20 / -6.3%
tpch_q07/datafusion:vortex-file-compressed 138038454 / 140608200 / -1.8% 202204419 / 195795858 / +3.3% 0.68 / 0.72 / -4.9%
tpch_q08/datafusion:vortex-file-compressed 144812374 / 141457795 / +2.4% 212046214 / 205239683 / +3.3% 0.68 / 0.69 / -0.9%
tpch_q09/datafusion:vortex-file-compressed 185866917 / 190172609 / -2.3% 252247252 / 257049324 / -1.9% 0.74 / 0.74 / -0.4%
tpch_q10/datafusion:vortex-file-compressed 75560552 / 75031435 / +0.7% 133236184 / 135339338 / -1.6% 0.57 / 0.55 / +2.3%
tpch_q11/datafusion:vortex-file-compressed 42971213 / 42832259 / +0.3% 68040185 / 71866675 / -5.3% 0.63 / 0.60 / +6.0%
tpch_q12/datafusion:vortex-file-compressed 47040595 / 45925424 / +2.4% 91066449 / 91794827 / -0.8% 0.52 / 0.50 / +3.2%
tpch_q13/datafusion:vortex-file-compressed 46697222 / 46437081 / +0.6% 80744484 / 85307779 / -5.3% 0.58 / 0.54 / +6.2%
tpch_q14/datafusion:vortex-file-compressed 24427641 / 23934340 / +2.1% 100341632 / 98842128 / +1.5% 0.24 / 0.24 / +0.5%
tpch_q15/datafusion:vortex-file-compressed 35904397 / 36104651 / -0.6% 105685358 / 102970938 / +2.6% 0.34 / 0.35 / -3.1%
tpch_q16/datafusion:vortex-file-compressed 37489076 / 37026526 / +1.2% 68047711 / 67917245 / +0.2% 0.55 / 0.55 / +1.1%
tpch_q17/datafusion:vortex-file-compressed 177167782 / 174194849 / +1.7% 232320590 / 222997995 / +4.2% 0.76 / 0.78 / -2.4%
tpch_q18/datafusion:vortex-file-compressed 203019236 / 203207593 / -0.1% 248809837 / 255660154 / -2.7% 0.82 / 0.79 / +2.7%
tpch_q19/datafusion:vortex-file-compressed 38943496 / 38360004 / +1.5% 94164935 / 95552415 / -1.5% 0.41 / 0.40 / +3.0%
tpch_q20/datafusion:vortex-file-compressed 62686571 / 62646245 / +0.1% 124488807 / 125567562 / -0.9% 0.50 / 0.50 / +0.9%
tpch_q21/datafusion:vortex-file-compressed 178253648 / 180893539 / -1.5% 239871497 / 236568295 / +1.4% 0.74 / 0.76 / -2.8%
tpch_q22/datafusion:vortex-file-compressed 25107012 / 25095451 / +0.0% 57098858 / 58110043 / -1.7% 0.44 / 0.43 / +1.8%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83211921 / 83048588 / +0.2% 130284443 / 132875197 / -1.9% 0.64 / 0.63 / +2.2%
tpch_q02/datafusion:parquet 135164303 / 133544164 / +1.2% 163036351 / 161733489 / +0.8% 0.83 / 0.83 / +0.4%
tpch_q03/datafusion:parquet 124435900 / 124442883 / -0.0% 186301519 / 190140309 / -2.0% 0.67 / 0.65 / +2.1%
tpch_q04/datafusion:parquet 54045226 / 54497663 / -0.8% 105166219 / 101986015 / +3.1% 0.51 / 0.53 / -3.8%
tpch_q05/datafusion:parquet 164460382 / 163398375 / +0.6% 232678358 / 231364740 / +0.6% 0.71 / 0.71 / +0.1%
tpch_q06/datafusion:parquet 32412636 / 33519285 / -3.3% 80245576 / 82940868 / -3.2% 0.40 / 0.40 / -0.1%
tpch_q07/datafusion:parquet 214206421 / 214218229 / -0.0% 294902993 / 302828801 / -2.6% 0.73 / 0.71 / +2.7%
tpch_q08/datafusion:parquet 212203278 / 209037257 / +1.5% 283693008 / 291198023 / -2.6% 0.75 / 0.72 / +4.2%
tpch_q09/datafusion:parquet 278762356 / 279603189 / -0.3% 361367817 / 361065032 / +0.1% 0.77 / 0.77 / -0.4%
tpch_q10/datafusion:parquet 302550034 / 301183490 / +0.5% 371928760 / 378931216 / -1.8% 0.81 / 0.79 / +2.3%
tpch_q11/datafusion:parquet 96594471 / 95428132 / +1.2% 120664721 / 120527009 / +0.1% 0.80 / 0.79 / +1.1%
tpch_q12/datafusion:parquet 79389393 / 78804973 / +0.7% 131995407 / 132824410 / -0.6% 0.60 / 0.59 / +1.4%
tpch_q13/datafusion:parquet 194375167 / 193998645 / +0.2% 230112601 / 229220217 / +0.4% 0.84 / 0.85 / -0.2%
tpch_q14/datafusion:parquet 75500480 / 73767754 / +2.3% 171467011 / 172500452 / -0.6% 0.44 / 0.43 / +3.0%
tpch_q15/datafusion:parquet 77502352 / 77606188 / -0.1% 140922528 / 142357095 / -1.0% 0.55 / 0.55 / +0.9%
tpch_q16/datafusion:parquet 85629396 / 85263473 / +0.4% 114326725 / 113486844 / +0.7% 0.75 / 0.75 / -0.3%
tpch_q17/datafusion:parquet 204478867 / 205636544 / -0.6% 269577668 / 264303449 / +2.0% 0.76 / 0.78 / -2.5%
tpch_q18/datafusion:parquet 263334686 / 262570380 / +0.3% 316805628 / 311851997 / +1.6% 0.83 / 0.84 / -1.3%
tpch_q19/datafusion:parquet 97096075 / 97116084 / -0.0% 175167958 / 169998737 / +3.0% 0.55 / 0.57 / -3.0%
tpch_q20/datafusion:parquet 152457278 / 152391922 / +0.0% 217966012 / 220771960 / -1.3% 0.70 / 0.69 / +1.3%
tpch_q21/datafusion:parquet 226764412 / 227347109 / -0.3% 306125270 / 306537299 / -0.1% 0.74 / 0.74 / -0.1%
tpch_q22/datafusion:parquet 160403406 / 160946229 / -0.3% 186851736 / 188306811 / -0.8% 0.86 / 0.85 / +0.4%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 55570505 / 55893427 / -0.6% 102176676 / 102245183 / -0.1% 0.54 / 0.55 / -0.5%
tpch_q02/duckdb:vortex-file-compressed 32142106 / 32454343 / -1.0% 45693500 / 46866217 / -2.5% 0.70 / 0.69 / +1.6%
tpch_q03/duckdb:vortex-file-compressed 57847979 / 59434096 / -2.7% 108339128 / 111785488 / -3.1% 0.53 / 0.53 / +0.4%
tpch_q04/duckdb:vortex-file-compressed 79740760 / 80528611 / -1.0% 123261057 / 120836266 / +2.0% 0.65 / 0.67 / -2.9%
tpch_q05/duckdb:vortex-file-compressed 66758916 / 65943117 / +1.2% 122327434 / 117729177 / +3.9% 0.55 / 0.56 / -2.6%
tpch_q06/duckdb:vortex-file-compressed 21386706 / 21821528 / -2.0% 70945709 / 67704078 / +4.8% 0.30 / 0.32 / -6.5%
tpch_q07/duckdb:vortex-file-compressed 60629403 / 62286699 / -2.7% 133212866 / 145229593 / -8.3% 0.46 / 0.43 / +6.1%
tpch_q08/duckdb:vortex-file-compressed 84207616 / 85412373 / -1.4% 150209338 / 146535113 / +2.5% 0.56 / 0.58 / -3.8%
tpch_q09/duckdb:vortex-file-compressed 170785119 / 169325781 / +0.9% 232536499 / 240944653 / -3.5% 0.73 / 0.70 / +4.5%
tpch_q10/duckdb:vortex-file-compressed 115052099 / 115327136 / -0.2% 191259375 / 193915437 / -1.4% 0.60 / 0.59 / +1.1%
tpch_q11/duckdb:vortex-file-compressed 16831675 / 17994698 / -6.5% 30384472 / 38517842 / -21.1% 🟢 0.55 / 0.47 / +18.6%
tpch_q12/duckdb:vortex-file-compressed 55383861 / 54464664 / +1.7% 101912942 / 92337959 / +10.4% 🔴 0.54 / 0.59 / -7.9%
tpch_q13/duckdb:vortex-file-compressed 90130053 / 90329560 / -0.2% 142349988 / 140220093 / +1.5% 0.63 / 0.64 / -1.7%
tpch_q14/duckdb:vortex-file-compressed 30889591 / 30721052 / +0.5% 78269341 / 79624290 / -1.7% 0.39 / 0.39 / +2.3%
tpch_q15/duckdb:vortex-file-compressed 37594255 / 37626189 / -0.1% 89747591 / 92805402 / -3.3% 0.42 / 0.41 / +3.3%
tpch_q16/duckdb:vortex-file-compressed 42558907 / 43128917 / -1.3% 58339824 / 55874578 / +4.4% 0.73 / 0.77 / -5.5%
tpch_q17/duckdb:vortex-file-compressed 75942394 / 59223537 / +28.2% 🔴 162917115 / 119341687 / +36.5% 🔴 0.47 / 0.50 / -6.1%
tpch_q18/duckdb:vortex-file-compressed 137652370 / 135257319 / +1.8% 168056654 / 158367787 / +6.1% 0.82 / 0.85 / -4.1%
tpch_q19/duckdb:vortex-file-compressed 43867697 / 47135994 / -6.9% 110141244 / 135384898 / -18.6% 🟢 0.40 / 0.35 / +14.4%
tpch_q20/duckdb:vortex-file-compressed 60174363 / 60130279 / +0.1% 125469978 / 125103052 / +0.3% 0.48 / 0.48 / -0.2%
tpch_q21/duckdb:vortex-file-compressed 244735134 / 243596830 / +0.5% 282338207 / 289854780 / -2.6% 0.87 / 0.84 / +3.1%
tpch_q22/duckdb:vortex-file-compressed 40025502 / 40395644 / -0.9% 60484533 / 59827368 / +1.1% 0.66 / 0.68 / -2.0%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70321244 / 70606992 / -0.4% 93605587 / 98018995 / -4.5% 0.75 / 0.72 / +4.3%
tpch_q02/duckdb:parquet 70777854 / 71179025 / -0.6% 83753587 / 84129866 / -0.4% 0.85 / 0.85 / -0.1%
tpch_q03/duckdb:parquet 112537453 / 116281545 / -3.2% 145244025 / 152984680 / -5.1% 0.77 / 0.76 / +1.9%
tpch_q04/duckdb:parquet 74628280 / 75065638 / -0.6% 96120646 / 97756506 / -1.7% 0.78 / 0.77 / +1.1%
tpch_q05/duckdb:parquet 124936744 / 125075321 / -0.1% 174407207 / 164110754 / +6.3% 0.72 / 0.76 / -6.0%
tpch_q06/duckdb:parquet 34547062 / 35121220 / -1.6% 47939894 / 48177766 / -0.5% 0.72 / 0.73 / -1.1%
tpch_q07/duckdb:parquet 90126062 / 90607876 / -0.5% 130258396 / 144466178 / -9.8% 0.69 / 0.63 / +10.3%
tpch_q08/duckdb:parquet 143216323 / 153481344 / -6.7% 188862179 / 189716626 / -0.5% 0.76 / 0.81 / -6.3%
tpch_q09/duckdb:parquet 221949839 / 223351374 / -0.6% 264589555 / 268232622 / -1.4% 0.84 / 0.83 / +0.7%
tpch_q10/duckdb:parquet 470586853 / 471935843 / -0.3% 511388402 / 511505443 / -0.0% 0.92 / 0.92 / -0.3%
tpch_q11/duckdb:parquet 30648033 / 30527100 / +0.4% 38327499 / 38082043 / +0.6% 0.80 / 0.80 / -0.2%
tpch_q12/duckdb:parquet 74629312 / 76587772 / -2.6% 98836511 / 109771593 / -10.0% 0.76 / 0.70 / +8.2%
tpch_q13/duckdb:parquet 319766013 / 316543546 / +1.0% 332800276 / 331737084 / +0.3% 0.96 / 0.95 / +0.7%
tpch_q14/duckdb:parquet 104356688 / 106020312 / -1.6% 134632090 / 130545308 / +3.1% 0.78 / 0.81 / -4.6%
tpch_q15/duckdb:parquet 43248089 / 43367405 / -0.3% 73168157 / 72400637 / +1.1% 0.59 / 0.60 / -1.3%
tpch_q16/duckdb:parquet 114494914 / 114065069 / +0.4% 124973377 / 125840025 / -0.7% 0.92 / 0.91 / +1.1%
tpch_q17/duckdb:parquet 74900898 / 74818965 / +0.1% 99939371 / 98008562 / +2.0% 0.75 / 0.76 / -1.8%
tpch_q18/duckdb:parquet 181497460 / 201100602 / -9.7% 173490220 / 174418049 / -0.5% 1.05 / 1.15 / -9.3%
tpch_q19/duckdb:parquet 174671135 / 164149627 / +6.4% 189539317 / 194084391 / -2.3% 0.92 / 0.85 / +9.0%
tpch_q20/duckdb:parquet 127530380 / 128340674 / -0.6% 164720755 / 166196690 / -0.9% 0.77 / 0.77 / +0.3%
tpch_q21/duckdb:parquet 267812058 / 260171691 / +2.9% 307171746 / 293296395 / +4.7% 0.87 / 0.89 / -1.7%
tpch_q22/duckdb:parquet 262270972 / 261938796 / +0.1% 271167938 / 276072012 / -1.8% 0.97 / 0.95 / +1.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9468170 / 9440319 / +0.3% 9944677 / 9797121 / +1.5% 0.95 / 0.96 / -1.2%
statpopgen_q01/duckdb:vortex-file-compressed 10762936 / 10731461 / +0.3% 14650865 / 16362987 / -10.5% 🟢 0.73 / 0.66 / +12.0%
statpopgen_q02/duckdb:vortex-file-compressed 378597964 / 376823954 / +0.5% 402853908 / 402341892 / +0.1% 0.94 / 0.94 / +0.3%
statpopgen_q03/duckdb:vortex-file-compressed 889692518 / 892058342 / -0.3% 896476279 / 917482221 / -2.3% 0.99 / 0.97 / +2.1%
statpopgen_q04/duckdb:vortex-file-compressed 883404010 / 894529467 / -1.2% 894925151 / 901667267 / -0.7% 0.99 / 0.99 / -0.5%
statpopgen_q05/duckdb:vortex-file-compressed 424217745 / 425189904 / -0.2% 435871083 / 436708714 / -0.2% 0.97 / 0.97 / -0.0%
statpopgen_q06/duckdb:vortex-file-compressed 1164444992 / 1159829444 / +0.4% 1168982519 / 1172349396 / -0.3% 1.00 / 0.99 / +0.7%
statpopgen_q07/duckdb:vortex-file-compressed 184554976 / 182692012 / +1.0% 187549247 / 202405316 / -7.3% 0.98 / 0.90 / +9.0%
statpopgen_q08/duckdb:vortex-file-compressed 203895628 / 198713985 / +2.6% 228258949 / 229898220 / -0.7% 0.89 / 0.86 / +3.3%
statpopgen_q09/duckdb:vortex-file-compressed 702780803 / 713194218 / -1.5% 771352039 / 715724780 / +7.8% 0.91 / 1.00 / -8.6%
statpopgen_q10/duckdb:vortex-file-compressed 1984225161 / 1994952248 / -0.5% 1967935899 / 1989552677 / -1.1% 1.01 / 1.00 / +0.6%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 247050272 / 248055553 / -0.4% 246265305 / 248578571 / -0.9% 1.00 / 1.00 / +0.5%
statpopgen_q01/duckdb:parquet 303818282 / 305185617 / -0.4% 306558888 / 306844781 / -0.1% 0.99 / 0.99 / -0.4%
statpopgen_q02/duckdb:parquet 544039036 / 529483778 / +2.7% 567395825 / 570139117 / -0.5% 0.96 / 0.93 / +3.2%
statpopgen_q03/duckdb:parquet 861908570 / 889275463 / -3.1% 869089619 / 891668503 / -2.5% 0.99 / 1.00 / -0.6%
statpopgen_q04/duckdb:parquet 824302094 / 825905660 / -0.2% 829341814 / 827336438 / +0.2% 0.99 / 1.00 / -0.4%
statpopgen_q05/duckdb:parquet 593754989 / 591775730 / +0.3% 596779090 / 594273785 / +0.4% 0.99 / 1.00 / -0.1%
statpopgen_q06/duckdb:parquet 720058242 / 702207302 / +2.5% 717439051 / 701035749 / +2.3% 1.00 / 1.00 / +0.2%
statpopgen_q07/duckdb:parquet 608188340 / 613845880 / -0.9% 717949146 / 675276233 / +6.3% 0.85 / 0.91 / -6.8%
statpopgen_q08/duckdb:parquet 624319673 / 619599186 / +0.8% 690999501 / 704174583 / -1.9% 0.90 / 0.88 / +2.7%
statpopgen_q09/duckdb:parquet 796144478 / 792721978 / +0.4% 810143619 / 810733738 / -0.1% 0.98 / 0.98 / +0.5%
statpopgen_q10/duckdb:parquet 1437281528 / 1466914988 / -2.0% 1345220800 / 1328701086 / +1.2% 1.07 / 1.10 / -3.2%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ecbd0d3f vs base 3170657a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+4.3%, environment too noisy confidence) · DuckDB No clear signal (-1.0%, environment too noisy confidence)
Vortex (geomean): hot 0.951x ➖ · cold 0.954x ➖
Parquet (geomean): hot 0.936x ➖ · cold 0.880x ➖
Shifts: Parquet (control) -6.4% · Median polish -3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.970x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 222382485 / 211050500 / +5.4% 835564080 / 739689475 / +13.0% 0.27 / 0.29 / -6.7%
tpch_q02/datafusion:vortex-file-compressed 370986143 / 355673566 / +4.3% 676895069 / 691290926 / -2.1% 0.55 / 0.51 / +6.5%
tpch_q03/datafusion:vortex-file-compressed 326517948 / 445731613 / -26.7% 1017134875 / 892135907 / +14.0% 0.32 / 0.50 / -35.7%
tpch_q04/datafusion:vortex-file-compressed 169903757 / 172300877 / -1.4% 441453941 / 395681275 / +11.6% 0.38 / 0.44 / -11.6%
tpch_q05/datafusion:vortex-file-compressed 337568594 / 423351448 / -20.3% 526283527 / 563824957 / -6.7% 0.64 / 0.75 / -14.6%
tpch_q06/datafusion:vortex-file-compressed 372623726 / 277689036 / +34.2% 🔴 404266564 / 397340232 / +1.7% 0.92 / 0.70 / +31.9%
tpch_q07/datafusion:vortex-file-compressed 544805116 / 361445662 / +50.7% 🔴 808682985 / 553440974 / +46.1% 🔴 0.67 / 0.65 / +3.2%
tpch_q08/datafusion:vortex-file-compressed 576896603 / 793143701 / -27.3% 675830283 / 910797050 / -25.8% 0.85 / 0.87 / -2.0%
tpch_q09/datafusion:vortex-file-compressed 450610690 / 496984162 / -9.3% 504109284 / 589311873 / -14.5% 0.89 / 0.84 / +6.0%
tpch_q10/datafusion:vortex-file-compressed 348447153 / 395063531 / -11.8% 538435239 / 575106833 / -6.4% 0.65 / 0.69 / -5.8%
tpch_q11/datafusion:vortex-file-compressed 332718826 / 291446188 / +14.2% 429711714 / 412514151 / +4.2% 0.77 / 0.71 / +9.6%
tpch_q12/datafusion:vortex-file-compressed 333049628 / 375955553 / -11.4% 507387923 / 836911133 / -39.4% 🟢 0.66 / 0.45 / +46.1%
tpch_q13/datafusion:vortex-file-compressed 108476785 / 111828702 / -3.0% 318759382 / 353219412 / -9.8% 0.34 / 0.32 / +7.5%
tpch_q14/datafusion:vortex-file-compressed 190459649 / 182294747 / +4.5% 317697247 / 344733282 / -7.8% 0.60 / 0.53 / +13.4%
tpch_q15/datafusion:vortex-file-compressed 295012727 / 505825345 / -41.7% 🟢 513358091 / 755978143 / -32.1% 🟢 0.57 / 0.67 / -14.1%
tpch_q16/datafusion:vortex-file-compressed 153451593 / 165880804 / -7.5% 290850492 / 400218996 / -27.3% 0.53 / 0.41 / +27.3%
tpch_q17/datafusion:vortex-file-compressed 310063661 / 415097136 / -25.3% 451730971 / 523056218 / -13.6% 0.69 / 0.79 / -13.5%
tpch_q18/datafusion:vortex-file-compressed 235507693 / 220845696 / +6.6% 411687897 / 393062072 / +4.7% 0.57 / 0.56 / +1.8%
tpch_q19/datafusion:vortex-file-compressed 340566294 / 335589766 / +1.5% 506369843 / 456125165 / +11.0% 0.67 / 0.74 / -8.6%
tpch_q20/datafusion:vortex-file-compressed 279546521 / 283099719 / -1.3% 428155283 / 527973883 / -18.9% 0.65 / 0.54 / +21.8%
tpch_q21/datafusion:vortex-file-compressed 498983829 / 469109730 / +6.4% 782760178 / 593751762 / +31.8% 🔴 0.64 / 0.79 / -19.3%
tpch_q22/datafusion:vortex-file-compressed 250825757 / 170588043 / +47.0% 🔴 395050629 / 388510448 / +1.7% 0.63 / 0.44 / +44.6%
datafusion / parquet / ns (0.930x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 165418898 / 189195623 / -12.6% 485080026 / 482556068 / +0.5% 0.34 / 0.39 / -13.0%
tpch_q02/datafusion:parquet 270748215 / 273821640 / -1.1% 506933357 / 555896948 / -8.8% 0.53 / 0.49 / +8.4%
tpch_q03/datafusion:parquet 261775673 / 284714598 / -8.1% 736035850 / 745802351 / -1.3% 0.36 / 0.38 / -6.8%
tpch_q04/datafusion:parquet 161296165 / 146959528 / +9.8% 403522958 / 411797749 / -2.0% 0.40 / 0.36 / +12.0%
tpch_q05/datafusion:parquet 387942095 / 326941620 / +18.7% 544381709 / 560300028 / -2.8% 0.71 / 0.58 / +22.1%
tpch_q06/datafusion:parquet 126379286 / 153220085 / -17.5% 291579727 / 292187027 / -0.2% 0.43 / 0.52 / -17.3%
tpch_q07/datafusion:parquet 341865778 / 351378901 / -2.7% 457597142 / 572366513 / -20.1% 0.75 / 0.61 / +21.7%
tpch_q08/datafusion:parquet 416882130 / 446632523 / -6.7% 560298674 / 1133229684 / -50.6% 🟢 0.74 / 0.39 / +88.8%
tpch_q09/datafusion:parquet 427053167 / 445058773 / -4.0% 567421378 / 647205083 / -12.3% 0.75 / 0.69 / +9.4%
tpch_q10/datafusion:parquet 365817385 / 383224097 / -4.5% 500624450 / 558151587 / -10.3% 0.73 / 0.69 / +6.4%
tpch_q11/datafusion:parquet 257022743 / 260912291 / -1.5% 417455803 / 404783796 / +3.1% 0.62 / 0.64 / -4.5%
tpch_q12/datafusion:parquet 182040411 / 195832536 / -7.0% 360646028 / 400927118 / -10.0% 0.50 / 0.49 / +3.3%
tpch_q13/datafusion:parquet 399025525 / 398555850 / +0.1% 652546025 / 541650924 / +20.5% 0.61 / 0.74 / -16.9%
tpch_q14/datafusion:parquet 161372678 / 184020166 / -12.3% 291302117 / 335588234 / -13.2% 0.55 / 0.55 / +1.0%
tpch_q15/datafusion:parquet 254431054 / 317067793 / -19.8% 435184491 / 788812507 / -44.8% 🟢 0.58 / 0.40 / +45.5%
tpch_q16/datafusion:parquet 104132083 / 105396371 / -1.2% 269929290 / 235908840 / +14.4% 0.39 / 0.45 / -13.7%
tpch_q17/datafusion:parquet 264206898 / 309302031 / -14.6% 389980890 / 472155646 / -17.4% 0.68 / 0.66 / +3.4%
tpch_q18/datafusion:parquet 396671162 / 401130437 / -1.1% 564002479 / 589414201 / -4.3% 0.70 / 0.68 / +3.3%
tpch_q19/datafusion:parquet 166010467 / 172165074 / -3.6% 277093825 / 351080440 / -21.1% 0.60 / 0.49 / +22.2%
tpch_q20/datafusion:parquet 237821664 / 322987994 / -26.4% 378708995 / 499253072 / -24.1% 0.63 / 0.65 / -2.9%
tpch_q21/datafusion:parquet 298797661 / 387008777 / -22.8% 442722774 / 471582414 / -6.1% 0.67 / 0.82 / -17.8%
tpch_q22/datafusion:parquet 164719010 / 169010599 / -2.5% 276838246 / 364730738 / -24.1% 0.60 / 0.46 / +28.4%
duckdb / vortex-file-compressed / ns (0.932x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 204088526 / 214963228 / -5.1% 272955617 / 267381213 / +2.1% 0.75 / 0.80 / -7.0%
tpch_q02/duckdb:vortex-file-compressed 359954983 / 416908295 / -13.7% 384987262 / 550619744 / -30.1% 🟢 0.93 / 0.76 / +23.5%
tpch_q03/duckdb:vortex-file-compressed 430446309 / 514097567 / -16.3% 443179204 / 470158008 / -5.7% 0.97 / 1.09 / -11.2%
tpch_q04/duckdb:vortex-file-compressed 267537788 / 333652364 / -19.8% 389151905 / 329167953 / +18.2% 0.69 / 1.01 / -32.2%
tpch_q05/duckdb:vortex-file-compressed 377035259 / 499171577 / -24.5% 396940925 / 569043840 / -30.2% 🟢 0.95 / 0.88 / +8.3%
tpch_q06/duckdb:vortex-file-compressed 320986315 / 263697355 / +21.7% 295299704 / 247298106 / +19.4% 1.09 / 1.07 / +1.9%
tpch_q07/duckdb:vortex-file-compressed 476934189 / 446838449 / +6.7% 558050360 / 484546718 / +15.2% 0.85 / 0.92 / -7.3%
tpch_q08/duckdb:vortex-file-compressed 677812393 / 592191150 / +14.5% 943430988 / 605680547 / +55.8% 🔴 0.72 / 0.98 / -26.5%
tpch_q09/duckdb:vortex-file-compressed 570614855 / 661457267 / -13.7% 473971605 / 774930984 / -38.8% 🟢 1.20 / 0.85 / +41.0%
tpch_q10/duckdb:vortex-file-compressed 421735688 / 417655636 / +1.0% 497931226 / 416064724 / +19.7% 0.85 / 1.00 / -15.6%
tpch_q11/duckdb:vortex-file-compressed 130025163 / 140742228 / -7.6% 162954394 / 157211190 / +3.7% 0.80 / 0.90 / -10.9%
tpch_q12/duckdb:vortex-file-compressed 425766013 / 499355286 / -14.7% 513955696 / 494641956 / +3.9% 0.83 / 1.01 / -17.9%
tpch_q13/duckdb:vortex-file-compressed 273995514 / 258100361 / +6.2% 316159109 / 305790664 / +3.4% 0.87 / 0.84 / +2.7%
tpch_q14/duckdb:vortex-file-compressed 230639862 / 236052140 / -2.3% 246465096 / 292425537 / -15.7% 0.94 / 0.81 / +15.9%
tpch_q15/duckdb:vortex-file-compressed 153996358 / 318092471 / -51.6% 🟢 210911533 / 378201611 / -44.2% 🟢 0.73 / 0.84 / -13.2%
tpch_q16/duckdb:vortex-file-compressed 200397461 / 194955600 / +2.8% 202204403 / 263076593 / -23.1% 0.99 / 0.74 / +33.7%
tpch_q17/duckdb:vortex-file-compressed 481841551 / 448879567 / +7.3% 520576191 / 414028802 / +25.7% 0.93 / 1.08 / -14.6%
tpch_q18/duckdb:vortex-file-compressed 335173234 / 339149585 / -1.2% 317830582 / 354576081 / -10.4% 1.05 / 0.96 / +10.3%
tpch_q19/duckdb:vortex-file-compressed 316531309 / 353445158 / -10.4% 345097917 / 362121582 / -4.7% 0.92 / 0.98 / -6.0%
tpch_q20/duckdb:vortex-file-compressed 381190714 / 392017868 / -2.8% 425518016 / 510006584 / -16.6% 0.90 / 0.77 / +16.5%
tpch_q21/duckdb:vortex-file-compressed 597597609 / 594936946 / +0.4% 652024392 / 650153802 / +0.3% 0.92 / 0.92 / +0.2%
tpch_q22/duckdb:vortex-file-compressed 126872793 / 120115377 / +5.6% 167170646 / 137496253 / +21.6% 0.76 / 0.87 / -13.1%
duckdb / parquet / ns (0.941x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 272691199 / 303973833 / -10.3% 299736419 / 382178626 / -21.6% 0.91 / 0.80 / +14.4%
tpch_q02/duckdb:parquet 616491083 / 662041586 / -6.9% 619880445 / 770401531 / -19.5% 0.99 / 0.86 / +15.7%
tpch_q03/duckdb:parquet 709856240 / 803428245 / -11.6% 722238656 / 1123338522 / -35.7% 🟢 0.98 / 0.72 / +37.4%
tpch_q04/duckdb:parquet 467740813 / 565704935 / -17.3% 446926895 / 715418767 / -37.5% 🟢 1.05 / 0.79 / +32.4%
tpch_q05/duckdb:parquet 873840157 / 963745732 / -9.3% 927889586 / 929598281 / -0.2% 0.94 / 1.04 / -9.2%
tpch_q06/duckdb:parquet 291430691 / 328612823 / -11.3% 295456982 / 303961741 / -2.8% 0.99 / 1.08 / -8.8%
tpch_q07/duckdb:parquet 837375388 / 863515401 / -3.0% 836195794 / 872556526 / -4.2% 1.00 / 0.99 / +1.2%
tpch_q08/duckdb:parquet 996733789 / 1144576798 / -12.9% 1130860987 / 1065697940 / +6.1% 0.88 / 1.07 / -17.9%
tpch_q09/duckdb:parquet 978041606 / 1016059567 / -3.7% 917982586 / 1123343074 / -18.3% 1.07 / 0.90 / +17.8%
tpch_q10/duckdb:parquet 921816004 / 945088763 / -2.5% 962134624 / 1033259408 / -6.9% 0.96 / 0.91 / +4.7%
tpch_q11/duckdb:parquet 451498174 / 408769723 / +10.5% 374486204 / 442324684 / -15.3% 1.21 / 0.92 / +30.5%
tpch_q12/duckdb:parquet 525051176 / 602038530 / -12.8% 631475497 / 806588515 / -21.7% 0.83 / 0.75 / +11.4%
tpch_q13/duckdb:parquet 780817142 / 775913946 / +0.6% 812144975 / 860810787 / -5.7% 0.96 / 0.90 / +6.7%
tpch_q14/duckdb:parquet 485792188 / 518154310 / -6.2% 566556922 / 488131585 / +16.1% 0.86 / 1.06 / -19.2%
tpch_q15/duckdb:parquet 332156725 / 372826472 / -10.9% 362162704 / 437666388 / -17.3% 0.92 / 0.85 / +7.7%
tpch_q16/duckdb:parquet 461767680 / 498853366 / -7.4% 491806864 / 498776713 / -1.4% 0.94 / 1.00 / -6.1%
tpch_q17/duckdb:parquet 458594239 / 493412525 / -7.1% 425273179 / 596406670 / -28.7% 1.08 / 0.83 / +30.3%
tpch_q18/duckdb:parquet 579486240 / 583846328 / -0.7% 517896466 / 724325367 / -28.5% 1.12 / 0.81 / +38.8%
tpch_q19/duckdb:parquet 577709550 / 569098082 / +1.5% 575955636 / 612704127 / -6.0% 1.00 / 0.93 / +8.0%
tpch_q20/duckdb:parquet 779986721 / 806860515 / -3.3% 977117714 / 895957510 / +9.1% 0.80 / 0.90 / -11.4%
tpch_q21/duckdb:parquet 703942413 / 682111429 / +3.2% 745530897 / 687493227 / +8.4% 0.94 / 0.99 / -4.8%
tpch_q22/duckdb:parquet 404464267 / 415126482 / -2.6% 399829715 / 400338392 / -0.1% 1.01 / 1.04 / -2.4%

if url.scheme() == "file" {
return Ok((
Arc::new(ObjectStoreFileSystem::local(RUNTIME.handle())),
Arc::new(StdFileSystem::new(RUNTIME.handle())),

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you want this can you make sure this is used everywhere instead of ObjectStoreFileSystem::local

@myrrc myrrc added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 4, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants