Skip to content

Push ScalarFn after Filter/Slice(x) if ScalarFn(x) has a registered kernel - #9766

Open
myrrc wants to merge 6 commits into
developfrom
myrrc/push-binary-into-filter
Open

Push ScalarFn after Filter/Slice(x) if ScalarFn(x) has a registered kernel#9766
myrrc wants to merge 6 commits into
developfrom
myrrc/push-binary-into-filter

Conversation

@myrrc

@myrrc myrrc commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

See clickbench q1: SELECT * FROM hits WHERE ID <> 0.

ID <> 0 is a ScalarFn
(Binary) over Sparse. (Binary, Sparse) pair has a kernel so it should operate on
compressed data. However, FlatReader inserts a Filter after array so we get
ScalarFn(Filter(Sparse)). (Filter, Sparse) canonicalizes the data.

This change implements an optimize rule that turns Fn(Filter(X), consts)
into Filter(Fn(X, consts)) if (Fn, X) has a registered kernel which agrees
to apply. If it's not the case, reordering may produce more rows on which Fn
will operate so we can't always apply this optimization.

Same logic applies to Slice but with one exception: Slice benefits from early application because if you move it up, you'll have to operate on a full ArrayRef which is large. So the second optimizer rule for Slice executes it eagerly.

@myrrc
myrrc marked this pull request as draft September 4, 2026 15:07
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc force-pushed the myrrc/push-binary-into-filter branch from e4023c5 to 5a0e7a5 Compare September 4, 2026 15:08
@myrrc myrrc added the changelog/performance A performance improvement label Sep 4, 2026
@codspeed-hq

codspeed-hq Bot commented Sep 4, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 26.51%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 6 improved benchmarks
✅ 409 untouched benchmarks
⏩ 1990 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_neon[16384] 20.5 µs 12.7 µs +61.21%
Simulation decompress[u8, (4000, 1024)] 45.4 µs 33.4 µs +35.65%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.7 µs +21.2%
Simulation decompress[u64, (4000, 1024)] 85.5 µs 70.6 µs +21.04%
Simulation decompress[u16, (4000, 256)] 58.5 µs 50.9 µs +14.94%
WallTime filtered_sink_i64_neon[NineNullsInTen] 28.5 µs 25.6 µs +11.17%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/push-binary-into-filter (50bc21e) with develop (a997c3f)

Open in CodSpeed

Footnotes

  1. 1990 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc changed the title Push ScalarFn after Filter(x) if ScalarFn(x) has a registered kernel Push ScalarFn after Filter/Slice(x) if ScalarFn(x) has a registered kernel Sep 4, 2026
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc marked this pull request as ready for review September 4, 2026 16:10
@myrrc
myrrc requested a review from robert3005 September 4, 2026 16:10
@myrrc myrrc added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 4, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 4, 2026
@robert3005

Copy link
Copy Markdown
Contributor

this should be a reduce rule, we are just pushing things through

@myrrc

myrrc commented Sep 4, 2026

Copy link
Copy Markdown
Contributor Author

Reduce rules don't have access to "ctx".

@robert3005

Copy link
Copy Markdown
Contributor

Yes, so this is partially missing partially different. ExecutionCtx is for EXECUTION. Reduce rules need same reduce rule registry like we have for execute rules. This essentially hasn't been completely done yet but it's a last step in the whole optimiser migration. I think the reduce rules should get access to session, this then means you have to pass session EVERYWHERE because something like array.slice(...) either doesn't optimise immediately or takes a session. Maybe there's a middle ground.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 5e44d39 random-access-bench 1 Explore Profiling Data
🟢 Done 5e44d39 statpopgen 1 Explore Profiling Data
🟢 Done 5e44d39 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 5e44d39 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 5e44d39 tpch-s3-10 1 Explore Profiling Data
🟢 Done 5e44d39 clickbench-nvme 1 Explore Profiling Data
🟢 Done 5e44d39 fineweb 1 Explore Profiling Data
🟢 Done 5e44d39 tpcds-nvme 1 Explore Profiling Data
🟢 Done 5e44d39 fineweb-s3 1 Explore Profiling Data
🟢 Done 5e44d39 appian-nvme 1 Explore Profiling Data
🟢 Done 5e44d39 polarsignals 1 Explore Profiling Data
🟢 Done 5e44d39 tpch-nvme 1 Explore Profiling Data
🟢 Done 5e44d39 tpch-s3 1 Explore Profiling Data
🟢 Done 5e44d39 compress-bench 1 Explore Profiling Data
🟢 Done 5e44d39 string-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Vortex (geomean): hot 1.013x ➖ · cold 1.028x ➖


datafusion / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45538942 / 45256735 / +0.6% 93705243 / 90871711 / +3.1% 0.49 / 0.50 / -2.4%
polarsignals_q01/datafusion:vortex-file-compressed 50818265 / 51384138 / -1.1% 118300419 / 115788925 / +2.2% 0.43 / 0.44 / -3.2%
polarsignals_q02/datafusion:vortex-file-compressed 37522181 / 35072027 / +7.0% 81756148 / 78769354 / +3.8% 0.46 / 0.45 / +3.1%
polarsignals_q03/datafusion:vortex-file-compressed 53593718 / 52983628 / +1.2% 119692025 / 118714863 / +0.8% 0.45 / 0.45 / +0.3%
polarsignals_q04/datafusion:vortex-file-compressed 9587538 / 9517240 / +0.7% 51741221 / 50452023 / +2.6% 0.19 / 0.19 / -1.8%
polarsignals_q05/datafusion:vortex-file-compressed 11386226 / 11317656 / +0.6% 56898885 / 55178210 / +3.1% 0.20 / 0.21 / -2.4%
polarsignals_q06/datafusion:vortex-file-compressed 21477034 / 21047291 / +2.0% 66242645 / 63170769 / +4.9% 0.32 / 0.33 / -2.7%
polarsignals_q07/datafusion:vortex-file-compressed 10890830 / 10931720 / -0.4% 56530819 / 54039655 / +4.6% 0.19 / 0.20 / -4.8%
polarsignals_q08/datafusion:vortex-file-compressed 100252430 / 100659398 / -0.4% 165304799 / 166475516 / -0.7% 0.61 / 0.60 / +0.3%
polarsignals_q09/datafusion:vortex-file-compressed 9838818 / 9589954 / +2.6% 51522189 / 49775638 / +3.5% 0.19 / 0.19 / -0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 5e44d39b vs base 0d9d5b82


vortex / vortex-file-compressed / ms (0.996x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 35.869448 / 36.129366 / -0.7%
read/clickbench/URL/shard-0/onpair-12 24.31363 / 24.13911 / +0.7%
read/tpch/l_comment/fsst 66.300834 / 66.855188 / -0.8%
read/tpch/l_comment/onpair-12 64.667368 / 65.170268 / -0.8%
write/clickbench/URL/shard-0/fsst 617.130811 / 617.992068 / -0.1%
write/clickbench/URL/shard-0/onpair-12 1711.78561 / 1712.85422 / -0.1%
write/tpch/l_comment/fsst 2114.4432 / 2113.14328 / +0.1%
write/tpch/l_comment/onpair-12 2878.93785 / 2913.71333 / -1.2%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 46.3288099 / 46.3288099 / +0.0%
size/clickbench/URL/shard-0/onpair-12 29.7417587 / 29.7417587 / +0.0%
size/tpch/l_comment/fsst 26.895123 / 26.895123 / +0.0%
size/tpch/l_comment/onpair-12 22.6668097 / 22.6668097 / +0.0%

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Engines: DataFusion No clear signal (-4.3%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.977x ➖ · cold 0.972x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.021x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.983x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6687924 / 6855229 / -2.4% 21849523 / 21410459 / +2.1% 0.31 / 0.32 / -4.4%
fineweb_q01/datafusion:vortex-file-compressed 13311521 / 13226064 / +0.6% 51671464 / 55055424 / -6.1% 0.26 / 0.24 / +7.2%
fineweb_q02/datafusion:vortex-file-compressed 13025886 / 12652117 / +3.0% 53872036 / 56697491 / -5.0% 0.24 / 0.22 / +8.4%
fineweb_q03/datafusion:vortex-file-compressed 19572000 / 19642134 / -0.4% 118961871 / 111264292 / +6.9% 0.16 / 0.18 / -6.8%
fineweb_q04/datafusion:vortex-file-compressed 73113185 / 74517138 / -1.9% 168030618 / 164515714 / +2.1% 0.44 / 0.45 / -3.9%
fineweb_q05/datafusion:vortex-file-compressed 57356876 / 57618894 / -0.5% 144814432 / 136484894 / +6.1% 0.40 / 0.42 / -6.2%
fineweb_q06/datafusion:vortex-file-compressed 18058919 / 19280434 / -6.3% 122207586 / 112955856 / +8.2% 0.15 / 0.17 / -13.4%
fineweb_q07/datafusion:vortex-file-compressed 17916791 / 18027068 / -0.6% 117155123 / 103866373 / +12.8% 🔴 0.15 / 0.17 / -11.9%
fineweb_q08/datafusion:vortex-file-compressed 9289302 / 9933968 / -6.5% 53165797 / 59830123 / -11.1% 🟢 0.17 / 0.17 / +5.2%
datafusion / vortex-compact / ns (0.940x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6840094 / 6813896 / +0.4% 20251054 / 20470238 / -1.1% 0.34 / 0.33 / +1.5%
fineweb_q01/datafusion:vortex-compact 44660230 / 78106082 / -42.8% 🟢 80198999 / 81436616 / -1.5% 0.56 / 0.96 / -41.9%
fineweb_q02/datafusion:vortex-compact 60881639 / 44102862 / +38.0% 🔴 82901339 / 86246486 / -3.9% 0.73 / 0.51 / +43.6%
fineweb_q03/datafusion:vortex-compact 157715998 / 161573630 / -2.4% 242017228 / 241949978 / +0.0% 0.65 / 0.67 / -2.4%
fineweb_q04/datafusion:vortex-compact 174171828 / 192252304 / -9.4% 241309682 / 246054959 / -1.9% 0.72 / 0.78 / -7.6%
fineweb_q05/datafusion:vortex-compact 158557644 / 153720934 / +3.1% 239305629 / 230126722 / +4.0% 0.66 / 0.67 / -0.8%
fineweb_q06/datafusion:vortex-compact 86897245 / 85983759 / +1.1% 162846955 / 162651278 / +0.1% 0.53 / 0.53 / +0.9%
fineweb_q07/datafusion:vortex-compact 87570073 / 89836720 / -2.5% 158516047 / 162981564 / -2.7% 0.55 / 0.55 / +0.2%
fineweb_q08/datafusion:vortex-compact 8108408 / 10098466 / -19.7% 🟢 44504744 / 47367529 / -6.0% 0.18 / 0.21 / -14.5%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9485964 / 9351410 / +1.4% 33955268 / 35023637 / -3.1% 0.28 / 0.27 / +4.6%
fineweb_q01/datafusion:parquet 70959525 / 70001411 / +1.4% 162174303 / 150286771 / +7.9% 0.44 / 0.47 / -6.1%
fineweb_q02/datafusion:parquet 72379026 / 70088991 / +3.3% 162109132 / 154110659 / +5.2% 0.45 / 0.45 / -1.8%
fineweb_q03/datafusion:parquet 69995212 / 69704495 / +0.4% 157614152 / 150227905 / +4.9% 0.44 / 0.46 / -4.3%
fineweb_q04/datafusion:parquet 75822820 / 75789138 / +0.0% 159065124 / 158917110 / +0.1% 0.48 / 0.48 / -0.0%
fineweb_q05/datafusion:parquet 75125117 / 74139000 / +1.3% 164458240 / 153423952 / +7.2% 0.46 / 0.48 / -5.5%
fineweb_q06/datafusion:parquet 70308987 / 71332561 / -1.4% 166113299 / 158458490 / +4.8% 0.42 / 0.45 / -6.0%
fineweb_q07/datafusion:parquet 69802219 / 71063527 / -1.8% 159665036 / 151971032 / +5.1% 0.44 / 0.47 / -6.5%
fineweb_q08/datafusion:parquet 69319984 / 69692256 / -0.5% 158198432 / 149729643 / +5.7% 0.44 / 0.47 / -5.9%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2058319 / 2055354 / +0.1% 7072932 / 5554211 / +27.3% 🔴 0.29 / 0.37 / -21.4%
fineweb_q01/duckdb:vortex-file-compressed 15472798 / 16603208 / -6.8% 42023639 / 43591129 / -3.6% 0.37 / 0.38 / -3.3%
fineweb_q02/duckdb:vortex-file-compressed 19272144 / 18997956 / +1.4% 42662375 / 59339857 / -28.1% 🟢 0.45 / 0.32 / +41.1%
fineweb_q03/duckdb:vortex-file-compressed 23768199 / 21919100 / +8.4% 95102440 / 102625970 / -7.3% 0.25 / 0.21 / +17.0%
fineweb_q04/duckdb:vortex-file-compressed 77487320 / 77880651 / -0.5% 127988738 / 145260231 / -11.9% 🟢 0.61 / 0.54 / +12.9%
fineweb_q05/duckdb:vortex-file-compressed 61024266 / 61793268 / -1.2% 119975793 / 116350943 / +3.1% 0.51 / 0.53 / -4.2%
fineweb_q06/duckdb:vortex-file-compressed 22671014 / 24002606 / -5.5% 104343539 / 109873814 / -5.0% 0.22 / 0.22 / -0.5%
fineweb_q07/duckdb:vortex-file-compressed 23824213 / 22815058 / +4.4% 94865776 / 98399562 / -3.6% 0.25 / 0.23 / +8.3%
fineweb_q08/duckdb:vortex-file-compressed 11021407 / 10244327 / +7.6% 47543678 / 50679738 / -6.2% 0.23 / 0.20 / +14.7%
duckdb / vortex-compact / ns (0.980x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2312794 / 3390198 / -31.8% 🟢 5285567 / 7751013 / -31.8% 🟢 0.44 / 0.44 / +0.0%
fineweb_q01/duckdb:vortex-compact 48648858 / 53312538 / -8.7% 73386932 / 90503232 / -18.9% 🟢 0.66 / 0.59 / +12.5%
fineweb_q02/duckdb:vortex-compact 58936672 / 50699710 / +16.2% 🔴 96111771 / 93451515 / +2.8% 0.61 / 0.54 / +13.0%
fineweb_q03/duckdb:vortex-compact 192683375 / 189799940 / +1.5% 246859046 / 244344104 / +1.0% 0.78 / 0.78 / +0.5%
fineweb_q04/duckdb:vortex-compact 203422692 / 193010589 / +5.4% 255288790 / 251783898 / +1.4% 0.80 / 0.77 / +3.9%
fineweb_q05/duckdb:vortex-compact 186988685 / 186746922 / +0.1% 225463442 / 241297848 / -6.6% 0.83 / 0.77 / +7.2%
fineweb_q06/duckdb:vortex-compact 96974174 / 99545717 / -2.6% 166168397 / 162149406 / +2.5% 0.58 / 0.61 / -4.9%
fineweb_q07/duckdb:vortex-compact 103684650 / 95835118 / +8.2% 161202753 / 157420545 / +2.4% 0.64 / 0.61 / +5.7%
fineweb_q08/duckdb:vortex-compact 10042206 / 9866350 / +1.8% 40502679 / 41005212 / -1.2% 0.25 / 0.24 / +3.0%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21834292 / 21787668 / +0.2% 26450307 / 23821923 / +11.0% 🔴 0.83 / 0.91 / -9.7%
fineweb_q01/duckdb:parquet 45053142 / 45012086 / +0.1% 55499174 / 53435982 / +3.9% 0.81 / 0.84 / -3.6%
fineweb_q02/duckdb:parquet 43774769 / 44377781 / -1.4% 56164682 / 57885187 / -3.0% 0.78 / 0.77 / +1.7%
fineweb_q03/duckdb:parquet 96008968 / 96398354 / -0.4% 175825557 / 190882491 / -7.9% 0.55 / 0.51 / +8.1%
fineweb_q04/duckdb:parquet 151598610 / 152723694 / -0.7% 204572270 / 219289169 / -6.7% 0.74 / 0.70 / +6.4%
fineweb_q05/duckdb:parquet 144352513 / 143371028 / +0.7% 193385012 / 195345694 / -1.0% 0.75 / 0.73 / +1.7%
fineweb_q06/duckdb:parquet 70698853 / 71702352 / -1.4% 125749121 / 128209514 / -1.9% 0.56 / 0.56 / +0.5%
fineweb_q07/duckdb:parquet 72443268 / 72811612 / -0.5% 152072522 / 157769958 / -3.6% 0.48 / 0.46 / +3.2%
fineweb_q08/duckdb:parquet 24594242 / 23905870 / +2.9% 27384346 / 24646785 / +11.1% 🔴 0.90 / 0.97 / -7.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): hot 1.010x ➖ · cold 1.041x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.024x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16442176 / 16409739 / +0.2% 45772401 / 45556038 / +0.5% 0.36 / 0.36 / -0.3%
tpch_q02/datafusion:vortex-file-compressed 17215003 / 17223716 / -0.1% 40150519 / 36789357 / +9.1% 0.43 / 0.47 / -8.4%
tpch_q03/datafusion:vortex-file-compressed 19236704 / 18972872 / +1.4% 49041994 / 46347134 / +5.8% 0.39 / 0.41 / -4.2%
tpch_q04/datafusion:vortex-file-compressed 10483608 / 10303720 / +1.7% 36209099 / 33098417 / +9.4% 0.29 / 0.31 / -7.0%
tpch_q05/datafusion:vortex-file-compressed 36714126 / 36895766 / -0.5% 65591053 / 61833173 / +6.1% 0.56 / 0.60 / -6.2%
tpch_q06/datafusion:vortex-file-compressed 6121294 / 6354071 / -3.7% 32043551 / 29870111 / +7.3% 0.19 / 0.21 / -10.2%
tpch_q07/datafusion:vortex-file-compressed 51099861 / 52243971 / -2.2% 82953535 / 79397731 / +4.5% 0.62 / 0.66 / -6.4%
tpch_q08/datafusion:vortex-file-compressed 51614088 / 51525632 / +0.2% 84563966 / 79029475 / +7.0% 0.61 / 0.65 / -6.4%
tpch_q09/datafusion:vortex-file-compressed 48882947 / 48835492 / +0.1% 77542707 / 78801414 / -1.6% 0.63 / 0.62 / +1.7%
tpch_q10/datafusion:vortex-file-compressed 17320251 / 17039113 / +1.6% 50945374 / 47200078 / +7.9% 0.34 / 0.36 / -5.8%
tpch_q11/datafusion:vortex-file-compressed 14773381 / 14897515 / -0.8% 36151949 / 32775079 / +10.3% 🔴 0.41 / 0.45 / -10.1%
tpch_q12/datafusion:vortex-file-compressed 22717295 / 22810360 / -0.4% 49741422 / 45555416 / +9.2% 0.46 / 0.50 / -8.8%
tpch_q13/datafusion:vortex-file-compressed 19753809 / 20002416 / -1.2% 41044804 / 40182495 / +2.1% 0.48 / 0.50 / -3.3%
tpch_q14/datafusion:vortex-file-compressed 15012165 / 14844407 / +1.1% 41253832 / 38075788 / +8.3% 0.36 / 0.39 / -6.7%
tpch_q15/datafusion:vortex-file-compressed 18341946 / 18400831 / -0.3% 48330826 / 44827365 / +7.8% 0.38 / 0.41 / -7.5%
tpch_q16/datafusion:vortex-file-compressed 18572165 / 18381437 / +1.0% 38608081 / 37355997 / +3.4% 0.48 / 0.49 / -2.2%
tpch_q17/datafusion:vortex-file-compressed 28062278 / 27864771 / +0.7% 60521420 / 54543090 / +11.0% 🔴 0.46 / 0.51 / -9.2%
tpch_q18/datafusion:vortex-file-compressed 36281512 / 36859700 / -1.6% 58951147 / 56072459 / +5.1% 0.62 / 0.66 / -6.4%
tpch_q19/datafusion:vortex-file-compressed 13873662 / 13824230 / +0.4% 41136951 / 38534947 / +6.8% 0.34 / 0.36 / -6.0%
tpch_q20/datafusion:vortex-file-compressed 20708786 / 20469112 / +1.2% 47189183 / 42151102 / +12.0% 🔴 0.44 / 0.49 / -9.6%
tpch_q21/datafusion:vortex-file-compressed 39651074 / 38877463 / +2.0% 65836622 / 64302531 / +2.4% 0.60 / 0.60 / -0.4%
tpch_q22/datafusion:vortex-file-compressed 11143126 / 11100378 / +0.4% 32822222 / 30105869 / +9.0% 0.34 / 0.37 / -7.9%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18260151 / 18018558 / +1.3% 45740991 / 43388154 / +5.4% 0.40 / 0.42 / -3.9%
tpch_q02/datafusion:vortex-compact 19367243 / 19488164 / -0.6% 41472342 / 37686574 / +10.0% 🔴 0.47 / 0.52 / -9.7%
tpch_q03/datafusion:vortex-compact 19552723 / 19857321 / -1.5% 45921971 / 45043094 / +2.0% 0.43 / 0.44 / -3.4%
tpch_q04/datafusion:vortex-compact 11397508 / 11759090 / -3.1% 34309032 / 33344148 / +2.9% 0.33 / 0.35 / -5.8%
tpch_q05/datafusion:vortex-compact 37440864 / 37102020 / +0.9% 65147850 / 61762103 / +5.5% 0.57 / 0.60 / -4.3%
tpch_q06/datafusion:vortex-compact 6924975 / 6709686 / +3.2% 31214268 / 29073609 / +7.4% 0.22 / 0.23 / -3.9%
tpch_q07/datafusion:vortex-compact 50887647 / 51647076 / -1.5% 81203227 / 78265767 / +3.8% 0.63 / 0.66 / -5.0%
tpch_q08/datafusion:vortex-compact 52385009 / 52034459 / +0.7% 86529848 / 79844591 / +8.4% 0.61 / 0.65 / -7.1%
tpch_q09/datafusion:vortex-compact 51018964 / 49908383 / +2.2% 76649800 / 75745682 / +1.2% 0.67 / 0.66 / +1.0%
tpch_q10/datafusion:vortex-compact 19094716 / 18911287 / +1.0% 51287134 / 46799432 / +9.6% 0.37 / 0.40 / -7.9%
tpch_q11/datafusion:vortex-compact 15757505 / 15918272 / -1.0% 35329776 / 33744702 / +4.7% 0.45 / 0.47 / -5.5%
tpch_q12/datafusion:vortex-compact 24283474 / 23907339 / +1.6% 50030354 / 45988392 / +8.8% 0.49 / 0.52 / -6.6%
tpch_q13/datafusion:vortex-compact 20710654 / 20653425 / +0.3% 41021993 / 37674659 / +8.9% 0.50 / 0.55 / -7.9%
tpch_q14/datafusion:vortex-compact 16262085 / 16125570 / +0.8% 41781794 / 40345291 / +3.6% 0.39 / 0.40 / -2.6%
tpch_q15/datafusion:vortex-compact 19590965 / 19785010 / -1.0% 48196380 / 43944141 / +9.7% 0.41 / 0.45 / -9.7%
tpch_q16/datafusion:vortex-compact 18911306 / 18488652 / +2.3% 38741277 / 36694034 / +5.6% 0.49 / 0.50 / -3.1%
tpch_q17/datafusion:vortex-compact 28441930 / 28879053 / -1.5% 60597551 / 55142568 / +9.9% 0.47 / 0.52 / -10.4%
tpch_q18/datafusion:vortex-compact 38202716 / 37928378 / +0.7% 59292791 / 56958864 / +4.1% 0.64 / 0.67 / -3.2%
tpch_q19/datafusion:vortex-compact 18652119 / 18602964 / +0.3% 45114363 / 43054318 / +4.8% 0.41 / 0.43 / -4.3%
tpch_q20/datafusion:vortex-compact 21763509 / 21581208 / +0.8% 47387104 / 44251165 / +7.1% 0.46 / 0.49 / -5.8%
tpch_q21/datafusion:vortex-compact 42333950 / 41406180 / +2.2% 70025609 / 66107955 / +5.9% 0.60 / 0.63 / -3.5%
tpch_q22/datafusion:vortex-compact 11334686 / 11621477 / -2.5% 32845582 / 30009816 / +9.4% 0.35 / 0.39 / -10.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67225288 / 67318953 / -0.1% 86319387 / 83927137 / +2.9% 0.78 / 0.80 / -2.9%
tpch_q02/datafusion:parquet 52436192 / 52480798 / -0.1% 73099376 / 69070512 / +5.8% 0.72 / 0.76 / -5.6%
tpch_q03/datafusion:parquet 72810240 / 72934275 / -0.2% 100179283 / 95549434 / +4.8% 0.73 / 0.76 / -4.8%
tpch_q04/datafusion:parquet 40709488 / 40940516 / -0.6% 64290896 / 58057018 / +10.7% 🔴 0.63 / 0.71 / -10.2%
tpch_q05/datafusion:parquet 87715518 / 88061302 / -0.4% 118874225 / 112672698 / +5.5% 0.74 / 0.78 / -5.6%
tpch_q06/datafusion:parquet 28740985 / 28688835 / +0.2% 50146856 / 47328415 / +6.0% 0.57 / 0.61 / -5.4%
tpch_q07/datafusion:parquet 94832557 / 95534812 / -0.7% 124628423 / 124864613 / -0.2% 0.76 / 0.77 / -0.5%
tpch_q08/datafusion:parquet 97018904 / 95279815 / +1.8% 129986268 / 122995867 / +5.7% 0.75 / 0.77 / -3.7%
tpch_q09/datafusion:parquet 113035011 / 113342751 / -0.3% 147513336 / 140790403 / +4.8% 0.77 / 0.81 / -4.8%
tpch_q10/datafusion:parquet 79971655 / 79883664 / +0.1% 116666717 / 108940369 / +7.1% 0.69 / 0.73 / -6.5%
tpch_q11/datafusion:parquet 39123652 / 38111470 / +2.7% 61361241 / 58856019 / +4.3% 0.64 / 0.65 / -1.5%
tpch_q12/datafusion:parquet 62169591 / 62504662 / -0.5% 89373204 / 90679227 / -1.4% 0.70 / 0.69 / +0.9%
tpch_q13/datafusion:parquet 159802211 / 159147918 / +0.4% 184080542 / 178013791 / +3.4% 0.87 / 0.89 / -2.9%
tpch_q14/datafusion:parquet 40006671 / 40051978 / -0.1% 66746097 / 64655335 / +3.2% 0.60 / 0.62 / -3.2%
tpch_q15/datafusion:parquet 47163210 / 48407853 / -2.6% 71848794 / 66981859 / +7.3% 0.66 / 0.72 / -9.2%
tpch_q16/datafusion:parquet 38547976 / 39108970 / -1.4% 59252754 / 57636328 / +2.8% 0.65 / 0.68 / -4.1%
tpch_q17/datafusion:parquet 116517466 / 116676020 / -0.1% 143309532 / 140066306 / +2.3% 0.81 / 0.83 / -2.4%
tpch_q18/datafusion:parquet 114482680 / 114237774 / +0.2% 138484865 / 135966269 / +1.9% 0.83 / 0.84 / -1.6%
tpch_q19/datafusion:parquet 49687803 / 50036596 / -0.7% 80882203 / 76715410 / +5.4% 0.61 / 0.65 / -5.8%
tpch_q20/datafusion:parquet 58176872 / 60042334 / -3.1% 90024672 / 81763397 / +10.1% 🔴 0.65 / 0.73 / -12.0%
tpch_q21/datafusion:parquet 98095803 / 98234790 / -0.1% 124446518 / 120595934 / +3.2% 0.79 / 0.81 / -3.2%
tpch_q22/datafusion:parquet 41751368 / 41758085 / -0.0% 61648694 / 58111149 / +6.1% 0.68 / 0.72 / -5.8%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11052392 / 12059137 / -8.3% 23872426 / 22696949 / +5.2% 0.46 / 0.53 / -12.9%
tpch_q02/duckdb:vortex-file-compressed 17765307 / 17580907 / +1.0% 27664809 / 25916640 / +6.7% 0.64 / 0.68 / -5.3%
tpch_q03/duckdb:vortex-file-compressed 18994391 / 18441935 / +3.0% 35479047 / 36019600 / -1.5% 0.54 / 0.51 / +4.6%
tpch_q04/duckdb:vortex-file-compressed 17008874 / 16982860 / +0.2% 30011369 / 29225133 / +2.7% 0.57 / 0.58 / -2.5%
tpch_q05/duckdb:vortex-file-compressed 22002239 / 22056853 / -0.2% 36664364 / 38341168 / -4.4% 0.60 / 0.58 / +4.3%
tpch_q06/duckdb:vortex-file-compressed 5489191 / 5522281 / -0.6% 15747600 / 14104437 / +11.6% 🔴 0.35 / 0.39 / -11.0%
tpch_q07/duckdb:vortex-file-compressed 20910145 / 21205437 / -1.4% 43779347 / 36735172 / +19.2% 🔴 0.48 / 0.58 / -17.3%
tpch_q08/duckdb:vortex-file-compressed 23378249 / 23783630 / -1.7% 40143694 / 39432807 / +1.8% 0.58 / 0.60 / -3.4%
tpch_q09/duckdb:vortex-file-compressed 29321182 / 29039999 / +1.0% 54213378 / 52433603 / +3.4% 0.54 / 0.55 / -2.3%
tpch_q10/duckdb:vortex-file-compressed 28685394 / 29599493 / -3.1% 45172283 / 46170717 / -2.2% 0.64 / 0.64 / -0.9%
tpch_q11/duckdb:vortex-file-compressed 8218467 / 8282644 / -0.8% 18551881 / 18846941 / -1.6% 0.44 / 0.44 / +0.8%
tpch_q12/duckdb:vortex-file-compressed 17854746 / 15783904 / +13.1% 🔴 26749039 / 27189661 / -1.6% 0.67 / 0.58 / +15.0%
tpch_q13/duckdb:vortex-file-compressed 22043233 / 22074438 / -0.1% 40558628 / 38488704 / +5.4% 0.54 / 0.57 / -5.2%
tpch_q14/duckdb:vortex-file-compressed 13293165 / 13309754 / -0.1% 25730506 / 24865272 / +3.5% 0.52 / 0.54 / -3.5%
tpch_q15/duckdb:vortex-file-compressed 9975675 / 9556443 / +4.4% 19381198 / 17651665 / +9.8% 0.51 / 0.54 / -4.9%
tpch_q16/duckdb:vortex-file-compressed 18559085 / 18268031 / +1.6% 24344125 / 25523148 / -4.6% 0.76 / 0.72 / +6.5%
tpch_q17/duckdb:vortex-file-compressed 15038511 / 15440094 / -2.6% 34200844 / 31613999 / +8.2% 0.44 / 0.49 / -10.0%
tpch_q18/duckdb:vortex-file-compressed 24893350 / 26072675 / -4.5% 39457217 / 33835951 / +16.6% 🔴 0.63 / 0.77 / -18.1%
tpch_q19/duckdb:vortex-file-compressed 24041270 / 23116091 / +4.0% 35541630 / 37355193 / -4.9% 0.68 / 0.62 / +9.3%
tpch_q20/duckdb:vortex-file-compressed 18045903 / 17506514 / +3.1% 36524643 / 33459765 / +9.2% 0.49 / 0.52 / -5.6%
tpch_q21/duckdb:vortex-file-compressed 66367568 / 66245812 / +0.2% 87595445 / 81645974 / +7.3% 0.76 / 0.81 / -6.6%
tpch_q22/duckdb:vortex-file-compressed 12125417 / 12069802 / +0.5% 20841967 / 23196763 / -10.2% 🟢 0.58 / 0.52 / +11.8%
duckdb / vortex-compact / ns (1.032x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 13727113 / 11964283 / +14.7% 🔴 22893675 / 22656668 / +1.0% 0.60 / 0.53 / +13.5%
tpch_q02/duckdb:vortex-compact 20145854 / 20112182 / +0.2% 27521699 / 28175503 / -2.3% 0.73 / 0.71 / +2.5%
tpch_q03/duckdb:vortex-compact 18840244 / 19097315 / -1.3% 37563863 / 33415821 / +12.4% 🔴 0.50 / 0.57 / -12.2%
tpch_q04/duckdb:vortex-compact 19069098 / 19002830 / +0.3% 31334393 / 29329717 / +6.8% 0.61 / 0.65 / -6.1%
tpch_q05/duckdb:vortex-compact 23084409 / 22529508 / +2.5% 37829238 / 35933534 / +5.3% 0.61 / 0.63 / -2.7%
tpch_q06/duckdb:vortex-compact 6177675 / 6336371 / -2.5% 15912345 / 14683430 / +8.4% 0.39 / 0.43 / -10.0%
tpch_q07/duckdb:vortex-compact 21329643 / 21804321 / -2.2% 41222161 / 40251547 / +2.4% 0.52 / 0.54 / -4.5%
tpch_q08/duckdb:vortex-compact 25375650 / 25968765 / -2.3% 40149066 / 41927559 / -4.2% 0.63 / 0.62 / +2.0%
tpch_q09/duckdb:vortex-compact 29696128 / 30047508 / -1.2% 51756123 / 51142838 / +1.2% 0.57 / 0.59 / -2.3%
tpch_q10/duckdb:vortex-compact 31239762 / 31058131 / +0.6% 46864783 / 48849364 / -4.1% 0.67 / 0.64 / +4.8%
tpch_q11/duckdb:vortex-compact 11248288 / 9139196 / +23.1% 🔴 16648689 / 17064266 / -2.4% 0.68 / 0.54 / +26.1%
tpch_q12/duckdb:vortex-compact 17825070 / 18724217 / -4.8% 27845997 / 28604105 / -2.7% 0.64 / 0.65 / -2.2%
tpch_q13/duckdb:vortex-compact 23386301 / 23391155 / -0.0% 38383582 / 37624738 / +2.0% 0.61 / 0.62 / -2.0%
tpch_q14/duckdb:vortex-compact 14462828 / 14514431 / -0.4% 26605719 / 25009052 / +6.4% 0.54 / 0.58 / -6.3%
tpch_q15/duckdb:vortex-compact 11506101 / 9303901 / +23.7% 🔴 21861317 / 21550969 / +1.4% 0.53 / 0.43 / +21.9%
tpch_q16/duckdb:vortex-compact 20261007 / 20476675 / -1.1% 25462752 / 25935936 / -1.8% 0.80 / 0.79 / +0.8%
tpch_q17/duckdb:vortex-compact 17461456 / 16782218 / +4.0% 31933057 / 31892080 / +0.1% 0.55 / 0.53 / +3.9%
tpch_q18/duckdb:vortex-compact 26237499 / 26341211 / -0.4% 36035047 / 40931050 / -12.0% 🟢 0.73 / 0.64 / +13.1%
tpch_q19/duckdb:vortex-compact 24667769 / 24375022 / +1.2% 38456605 / 37600491 / +2.3% 0.64 / 0.65 / -1.1%
tpch_q20/duckdb:vortex-compact 19793337 / 19078190 / +3.7% 35479781 / 36055136 / -1.6% 0.56 / 0.53 / +5.4%
tpch_q21/duckdb:vortex-compact 70911723 / 68466886 / +3.6% 84206257 / 83076648 / +1.4% 0.84 / 0.82 / +2.2%
tpch_q22/duckdb:vortex-compact 14572275 / 12539551 / +16.2% 🔴 21600055 / 22683444 / -4.8% 0.67 / 0.55 / +22.0%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60267140 / 60037668 / +0.4% 66654524 / 66891290 / -0.4% 0.90 / 0.90 / +0.7%
tpch_q02/duckdb:parquet 34446365 / 34692137 / -0.7% 43046799 / 43425956 / -0.9% 0.80 / 0.80 / +0.2%
tpch_q03/duckdb:parquet 61904146 / 62098514 / -0.3% 73835617 / 73918704 / -0.1% 0.84 / 0.84 / -0.2%
tpch_q04/duckdb:parquet 44817327 / 43159430 / +3.8% 55842122 / 52886419 / +5.6% 0.80 / 0.82 / -1.7%
tpch_q05/duckdb:parquet 60631203 / 60837663 / -0.3% 72791843 / 72381000 / +0.6% 0.83 / 0.84 / -0.9%
tpch_q06/duckdb:parquet 20264455 / 20055270 / +1.0% 24851176 / 24588748 / +1.1% 0.82 / 0.82 / -0.0%
tpch_q07/duckdb:parquet 60556062 / 60775536 / -0.4% 71995241 / 72692169 / -1.0% 0.84 / 0.84 / +0.6%
tpch_q08/duckdb:parquet 73362001 / 73052246 / +0.4% 87204942 / 85912136 / +1.5% 0.84 / 0.85 / -1.1%
tpch_q09/duckdb:parquet 113739286 / 114125056 / -0.3% 127308041 / 128197859 / -0.7% 0.89 / 0.89 / +0.4%
tpch_q10/duckdb:parquet 108505175 / 108090334 / +0.4% 121679286 / 121218346 / +0.4% 0.89 / 0.89 / +0.0%
tpch_q11/duckdb:parquet 19981123 / 20055275 / -0.4% 23649233 / 23870148 / -0.9% 0.84 / 0.84 / +0.6%
tpch_q12/duckdb:parquet 41317752 / 41318465 / -0.0% 48735241 / 48825797 / -0.2% 0.85 / 0.85 / +0.2%
tpch_q13/duckdb:parquet 238977799 / 239496756 / -0.2% 249617470 / 248000242 / +0.7% 0.96 / 0.97 / -0.9%
tpch_q14/duckdb:parquet 43440964 / 43510933 / -0.2% 52278616 / 51638347 / +1.2% 0.83 / 0.84 / -1.4%
tpch_q15/duckdb:parquet 24861066 / 24667670 / +0.8% 31512201 / 30867225 / +2.1% 0.79 / 0.80 / -1.3%
tpch_q16/duckdb:parquet 49831678 / 49889093 / -0.1% 58947249 / 57585070 / +2.4% 0.85 / 0.87 / -2.4%
tpch_q17/duckdb:parquet 44390501 / 44547456 / -0.4% 53867107 / 53588675 / +0.5% 0.82 / 0.83 / -0.9%
tpch_q18/duckdb:parquet 90040343 / 90093627 / -0.1% 101128735 / 100499364 / +0.6% 0.89 / 0.90 / -0.7%
tpch_q19/duckdb:parquet 61200554 / 61043725 / +0.3% 71519428 / 71493259 / +0.0% 0.86 / 0.85 / +0.2%
tpch_q20/duckdb:parquet 58650211 / 58768728 / -0.2% 70335148 / 73724776 / -4.6% 0.83 / 0.80 / +4.6%
tpch_q21/duckdb:parquet 136886122 / 137481909 / -0.4% 147340923 / 151261611 / -2.6% 0.93 / 0.91 / +2.2%
tpch_q22/duckdb:parquet 50507738 / 50505026 / +0.0% 58290861 / 58070899 / +0.4% 0.87 / 0.87 / -0.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Engines: DataFusion No clear signal (-6.1%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.965x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.0% · Median polish -1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.896x ✅, 6↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 217789054 / 227348071 / -4.2% 587254499 / 555116779 / +5.8% 0.37 / 0.41 / -9.4%
clickbench-sorted_q24/datafusion:vortex-file-compressed 13693874 / 13646222 / +0.3% 51217595 / 50223830 / +2.0% 0.27 / 0.27 / -1.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed 12768546 / 13426495 / -4.9% 53246917 / 52456833 / +1.5% 0.24 / 0.26 / -6.3%
clickbench-sorted_q36/datafusion:vortex-file-compressed 25453668 / 28620618 / -11.1% 🟢 68512814 / 71734380 / -4.5% 0.37 / 0.40 / -6.9%
clickbench-sorted_q37/datafusion:vortex-file-compressed 20481196 / 24120933 / -15.1% 🟢 61727787 / 59772136 / +3.3% 0.33 / 0.40 / -17.8%
clickbench-sorted_q38/datafusion:vortex-file-compressed 24984726 / 34029086 / -26.6% 🟢 66703757 / 69780519 / -4.4% 0.37 / 0.49 / -23.2%
clickbench-sorted_q39/datafusion:vortex-file-compressed 84539784 / 87887842 / -3.8% 114642821 / 118760235 / -3.5% 0.74 / 0.74 / -0.4%
clickbench-sorted_q40/datafusion:vortex-file-compressed 14109950 / 16170100 / -12.7% 🟢 46494715 / 48042972 / -3.2% 0.30 / 0.34 / -9.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 13869857 / 15603338 / -11.1% 🟢 45788739 / 47101968 / -2.8% 0.30 / 0.33 / -8.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed 11653585 / 13250180 / -12.0% 🟢 38267556 / 40371425 / -5.2% 0.30 / 0.33 / -7.2%
datafusion / vortex-compact / ns (0.990x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 190055460 / 233586079 / -18.6% 🟢 435856245 / 426845640 / +2.1% 0.44 / 0.55 / -20.3%
clickbench-sorted_q24/datafusion:vortex-compact 23212416 / 22760861 / +2.0% 55069753 / 51990443 / +5.9% 0.42 / 0.44 / -3.7%
clickbench-sorted_q26/datafusion:vortex-compact 23259108 / 23068538 / +0.8% 51043559 / 56433225 / -9.6% 0.46 / 0.41 / +11.5%
clickbench-sorted_q36/datafusion:vortex-compact 25225539 / 25072280 / +0.6% 71008950 / 66736500 / +6.4% 0.36 / 0.38 / -5.4%
clickbench-sorted_q37/datafusion:vortex-compact 21366524 / 21850308 / -2.2% 67228861 / 66351945 / +1.3% 0.32 / 0.33 / -3.5%
clickbench-sorted_q38/datafusion:vortex-compact 21418605 / 20319300 / +5.4% 65201977 / 65256252 / -0.1% 0.33 / 0.31 / +5.5%
clickbench-sorted_q39/datafusion:vortex-compact 43338482 / 45106098 / -3.9% 83504064 / 89750047 / -7.0% 0.52 / 0.50 / +3.3%
clickbench-sorted_q40/datafusion:vortex-compact 15931008 / 15699710 / +1.5% 42730312 / 43344722 / -1.4% 0.37 / 0.36 / +2.9%
clickbench-sorted_q41/datafusion:vortex-compact 14297502 / 13443720 / +6.4% 45597782 / 46167413 / -1.2% 0.31 / 0.29 / +7.7%
clickbench-sorted_q42/datafusion:vortex-compact 11045157 / 10937466 / +1.0% 36310821 / 36005757 / +0.8% 0.30 / 0.30 / +0.1%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 751608648 / 756727673 / -0.7% 929818189 / 929556155 / +0.0% 0.81 / 0.81 / -0.7%
clickbench-sorted_q24/datafusion:parquet 8575658 / 9084684 / -5.6% 71261164 / 71426023 / -0.2% 0.12 / 0.13 / -5.4%
clickbench-sorted_q26/datafusion:parquet 9317862 / 8851102 / +5.3% 72224837 / 73411976 / -1.6% 0.13 / 0.12 / +7.0%
clickbench-sorted_q36/datafusion:parquet 94382040 / 93656846 / +0.8% 165842827 / 166061131 / -0.1% 0.57 / 0.56 / +0.9%
clickbench-sorted_q37/datafusion:parquet 65033259 / 64592077 / +0.7% 130876869 / 131366269 / -0.4% 0.50 / 0.49 / +1.1%
clickbench-sorted_q38/datafusion:parquet 87981044 / 86691605 / +1.5% 158039382 / 159143502 / -0.7% 0.56 / 0.54 / +2.2%
clickbench-sorted_q39/datafusion:parquet 159779304 / 159098290 / +0.4% 230912132 / 231940202 / -0.4% 0.69 / 0.69 / +0.9%
clickbench-sorted_q40/datafusion:parquet 45234466 / 44608606 / +1.4% 111861741 / 111794618 / +0.1% 0.40 / 0.40 / +1.3%
clickbench-sorted_q41/datafusion:parquet 42499158 / 42307928 / +0.5% 110731110 / 109236791 / +1.4% 0.38 / 0.39 / -0.9%
clickbench-sorted_q42/datafusion:parquet 26450059 / 26519657 / -0.3% 88036517 / 90290532 / -2.5% 0.30 / 0.29 / +2.3%
duckdb / vortex-file-compressed / ns (0.949x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 69503508 / 68973825 / +0.8% 92928140 / 81020865 / +14.7% 🔴 0.75 / 0.85 / -12.1%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21666128 / 18418172 / +17.6% 🔴 36158379 / 35570754 / +1.7% 0.60 / 0.52 / +15.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 16251194 / 15871736 / +2.4% 28607509 / 32317936 / -11.5% 🟢 0.57 / 0.49 / +15.7%
clickbench-sorted_q36/duckdb:vortex-file-compressed 39606232 / 43021800 / -7.9% 67836875 / 73667480 / -7.9% 0.58 / 0.58 / -0.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed 35760000 / 37388402 / -4.4% 61027386 / 66667296 / -8.5% 0.59 / 0.56 / +4.5%
clickbench-sorted_q38/duckdb:vortex-file-compressed 39100846 / 47942940 / -18.4% 🟢 66640589 / 70295877 / -5.2% 0.59 / 0.68 / -14.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed 105510148 / 112469554 / -6.2% 135802496 / 139144234 / -2.4% 0.78 / 0.81 / -3.9%
clickbench-sorted_q40/duckdb:vortex-file-compressed 18780615 / 21179458 / -11.3% 🟢 38360466 / 38234361 / +0.3% 0.49 / 0.55 / -11.6%
clickbench-sorted_q41/duckdb:vortex-file-compressed 19475710 / 20942822 / -7.0% 39382258 / 39673345 / -0.7% 0.49 / 0.53 / -6.3%
clickbench-sorted_q42/duckdb:vortex-file-compressed 16180249 / 18415592 / -12.1% 🟢 36344498 / 36710613 / -1.0% 0.45 / 0.50 / -11.3%
duckdb / vortex-compact / ns (1.031x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 71986628 / 69007083 / +4.3% 88875255 / 95953669 / -7.4% 0.81 / 0.72 / +12.6%
clickbench-sorted_q24/duckdb:vortex-compact 26575109 / 22634310 / +17.4% 🔴 35357701 / 32639024 / +8.3% 0.75 / 0.69 / +8.4%
clickbench-sorted_q26/duckdb:vortex-compact 16003326 / 14801373 / +8.1% 28681884 / 31518333 / -9.0% 0.56 / 0.47 / +18.8%
clickbench-sorted_q36/duckdb:vortex-compact 38607201 / 38127541 / +1.3% 74461618 / 76106600 / -2.2% 0.52 / 0.50 / +3.5%
clickbench-sorted_q37/duckdb:vortex-compact 33777402 / 32922498 / +2.6% 66957880 / 67533485 / -0.9% 0.50 / 0.49 / +3.5%
clickbench-sorted_q38/duckdb:vortex-compact 35094624 / 36105814 / -2.8% 67732542 / 67016453 / +1.1% 0.52 / 0.54 / -3.8%
clickbench-sorted_q39/duckdb:vortex-compact 63072759 / 66343776 / -4.9% 108944136 / 105196867 / +3.6% 0.58 / 0.63 / -8.2%
clickbench-sorted_q40/duckdb:vortex-compact 19668596 / 19408992 / +1.3% 44539677 / 38325389 / +16.2% 🔴 0.44 / 0.51 / -12.8%
clickbench-sorted_q41/duckdb:vortex-compact 19665458 / 19355920 / +1.6% 40306882 / 40122728 / +0.5% 0.49 / 0.48 / +1.1%
clickbench-sorted_q42/duckdb:vortex-compact 14855305 / 14294888 / +3.9% 36657814 / 32448580 / +13.0% 🔴 0.41 / 0.44 / -8.0%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 129613963 / 130008342 / -0.3% 157380750 / 140161005 / +12.3% 🔴 0.82 / 0.93 / -11.2%
clickbench-sorted_q24/duckdb:parquet 18760720 / 18138419 / +3.4% 25765589 / 31820097 / -19.0% 🟢 0.73 / 0.57 / +27.7%
clickbench-sorted_q26/duckdb:parquet 13262290 / 12797924 / +3.6% 21480881 / 24184451 / -11.2% 🟢 0.62 / 0.53 / +16.7%
clickbench-sorted_q36/duckdb:parquet 42429767 / 45045384 / -5.8% 59980734 / 63330886 / -5.3% 0.71 / 0.71 / -0.5%
clickbench-sorted_q37/duckdb:parquet 30606018 / 30595030 / +0.0% 49812266 / 49399185 / +0.8% 0.61 / 0.62 / -0.8%
clickbench-sorted_q38/duckdb:parquet 39875170 / 38340534 / +4.0% 60968632 / 55466470 / +9.9% 0.65 / 0.69 / -5.4%
clickbench-sorted_q39/duckdb:parquet 69781238 / 73835293 / -5.5% 83842374 / 86708983 / -3.3% 0.83 / 0.85 / -2.3%
clickbench-sorted_q40/duckdb:parquet 16880360 / 17839205 / -5.4% 35893704 / 35391194 / +1.4% 0.47 / 0.50 / -6.7%
clickbench-sorted_q41/duckdb:parquet 17082064 / 16952646 / +0.8% 34946483 / 34734665 / +0.6% 0.49 / 0.49 / +0.2%
clickbench-sorted_q42/duckdb:parquet 11358480 / 11020426 / +3.1% 22947106 / 22844466 / +0.4% 0.49 / 0.48 / +2.6%

File Size Changes (200 files changed, +0.1% overall, 109↑ 91↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 187.95 MB 192.25 MB +4.30 MB +2.3%
hits_001.vortex 1.0 vortex-compact 137.65 MB 140.47 MB +2.82 MB +2.0%
hits_061.vortex 1.0 vortex-compact 123.43 MB 125.60 MB +2.17 MB +1.8%
hits_000.vortex 1.0 vortex-compact 98.37 MB 99.53 MB +1.16 MB +1.2%
hits_065.vortex 1.0 vortex-file-compressed 158.89 MB 160.77 MB +1.88 MB +1.2%
hits_041.vortex 1.0 vortex-compact 97.90 MB 99.02 MB +1.12 MB +1.1%
hits_004.vortex 1.0 vortex-compact 97.81 MB 98.92 MB +1.11 MB +1.1%
hits_090.vortex 1.0 vortex-file-compressed 191.43 MB 193.40 MB +1.97 MB +1.0%
hits_027.vortex 1.0 vortex-compact 137.94 MB 139.33 MB +1.39 MB +1.0%
hits_023.vortex 1.0 vortex-file-compressed 194.16 MB 195.95 MB +1.78 MB +0.9%
hits_013.vortex 1.0 vortex-compact 124.03 MB 125.08 MB +1.04 MB +0.8%
hits_067.vortex 1.0 vortex-compact 98.40 MB 99.18 MB +799.16 KB +0.8%
hits_007.vortex 1.0 vortex-file-compressed 197.94 MB 199.48 MB +1.53 MB +0.8%
hits_081.vortex 1.0 vortex-file-compressed 198.40 MB 199.90 MB +1.51 MB +0.8%
hits_059.vortex 1.0 vortex-file-compressed 196.81 MB 198.30 MB +1.49 MB +0.8%
hits_010.vortex 1.0 vortex-compact 123.06 MB 123.98 MB +937.27 KB +0.7%
hits_030.vortex 1.0 vortex-compact 97.73 MB 98.40 MB +689.09 KB +0.7%
hits_074.vortex 1.0 vortex-compact 151.99 MB 153.03 MB +1.04 MB +0.7%
hits_076.vortex 1.0 vortex-file-compressed 158.85 MB 159.93 MB +1.08 MB +0.7%
hits_052.vortex 1.0 vortex-compact 98.27 MB 98.87 MB +615.81 KB +0.6%
hits_024.vortex 1.0 vortex-compact 123.85 MB 124.52 MB +689.45 KB +0.5%
hits_029.vortex 1.0 vortex-file-compressed 198.16 MB 199.22 MB +1.05 MB +0.5%
hits_082.vortex 1.0 vortex-compact 105.64 MB 106.16 MB +540.67 KB +0.5%
hits_098.vortex 1.0 vortex-compact 103.53 MB 103.98 MB +464.05 KB +0.4%
hits_089.vortex 1.0 vortex-compact 98.82 MB 99.25 MB +439.01 KB +0.4%
hits_080.vortex 1.0 vortex-compact 96.87 MB 97.26 MB +404.73 KB +0.4%
hits_071.vortex 1.0 vortex-compact 105.71 MB 106.09 MB +398.16 KB +0.4%
hits_040.vortex 1.0 vortex-file-compressed 142.38 MB 142.87 MB +505.02 KB +0.3%
hits_050.vortex 1.0 vortex-compact 125.57 MB 125.97 MB +407.11 KB +0.3%
hits_031.vortex 1.0 vortex-file-compressed 158.54 MB 159.03 MB +500.85 KB +0.3%
hits_075.vortex 1.0 vortex-file-compressed 188.27 MB 188.82 MB +561.81 KB +0.3%
hits_041.vortex 1.0 vortex-file-compressed 130.49 MB 130.85 MB +367.68 KB +0.3%
hits_009.vortex 1.0 vortex-file-compressed 100.62 MB 100.89 MB +277.41 KB +0.3%
hits_043.vortex 1.0 vortex-compact 94.15 MB 94.39 MB +240.66 KB +0.2%
hits_006.vortex 1.0 vortex-compact 94.07 MB 94.28 MB +214.16 KB +0.2%
hits_057.vortex 1.0 vortex-file-compressed 158.95 MB 159.26 MB +319.36 KB +0.2%
hits_011.vortex 1.0 vortex-compact 152.46 MB 152.76 MB +303.92 KB +0.2%
hits_091.vortex 1.0 vortex-compact 112.24 MB 112.45 MB +217.22 KB +0.2%
hits_087.vortex 1.0 vortex-compact 125.38 MB 125.61 MB +227.24 KB +0.2%
hits_066.vortex 1.0 vortex-file-compressed 162.29 MB 162.56 MB +274.28 KB +0.2%
hits_079.vortex 1.0 vortex-compact 128.03 MB 128.23 MB +202.89 KB +0.2%
hits_069.vortex 1.0 vortex-compact 99.49 MB 99.65 MB +156.41 KB +0.2%
hits_011.vortex 1.0 vortex-file-compressed 198.39 MB 198.68 MB +301.44 KB +0.1%
hits_039.vortex 1.0 vortex-compact 123.74 MB 123.92 MB +186.93 KB +0.1%
hits_040.vortex 1.0 vortex-compact 110.01 MB 110.18 MB +166.07 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 198.87 MB 199.14 MB +276.45 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 150.82 MB 151.02 MB +207.40 KB +0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.18 MB 102.31 MB +134.69 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.11 MB 171.32 MB +218.49 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.20 MB 168.41 MB +211.84 KB +0.1%
hits_007.vortex 1.0 vortex-compact 153.43 MB 153.61 MB +179.00 KB +0.1%
hits_016.vortex 1.0 vortex-file-compressed 179.56 MB 179.77 MB +206.77 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 159.91 MB 160.09 MB +179.21 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 189.90 MB 190.11 MB +206.87 KB +0.1%
hits_065.vortex 1.0 vortex-compact 125.74 MB 125.86 MB +130.98 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.48 MB 130.61 MB +133.62 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 171.29 MB 171.45 MB +170.16 KB +0.1%
hits_096.vortex 1.0 vortex-compact 153.13 MB 153.28 MB +151.62 KB +0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.14 MB 130.26 MB +128.27 KB +0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.29 MB 159.44 MB +150.87 KB +0.1%
hits_074.vortex 1.0 vortex-file-compressed 198.40 MB 198.57 MB +178.05 KB +0.1%
hits_084.vortex 1.0 vortex-compact 110.58 MB 110.68 MB +98.30 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.14 MB 139.25 MB +107.37 KB +0.1%
hits_034.vortex 1.0 vortex-compact 133.32 MB 133.41 MB +99.59 KB +0.1%
hits_002.vortex 1.0 vortex-file-compressed 159.98 MB 160.09 MB +105.73 KB +0.1%
hits_042.vortex 1.0 vortex-compact 136.22 MB 136.29 MB +80.58 KB +0.1%
hits_062.vortex 1.0 vortex-compact 132.50 MB 132.57 MB +77.27 KB +0.1%
hits_068.vortex 1.0 vortex-compact 112.39 MB 112.45 MB +64.07 KB +0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.70 MB 130.76 MB +71.02 KB +0.1%
hits_014.vortex 1.0 vortex-compact 133.97 MB 134.04 MB +71.45 KB +0.1%
hits_012.vortex 1.0 vortex-file-compressed 189.84 MB 189.94 MB +100.96 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 191.81 MB 191.91 MB +97.00 KB +0.0%
hits_046.vortex 1.0 vortex-compact 74.93 MB 74.97 MB +37.37 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.70 MB 130.76 MB +61.55 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.07 MB 156.14 MB +72.45 KB +0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.51 MB 130.57 MB +56.00 KB +0.0%
hits_070.vortex 1.0 vortex-compact 153.65 MB 153.71 MB +63.84 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 134.43 MB 134.48 MB +54.52 KB +0.0%
hits_018.vortex 1.0 vortex-file-compressed 198.96 MB 199.03 MB +71.49 KB +0.0%
hits_054.vortex 1.0 vortex-compact 112.12 MB 112.16 MB +39.06 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.64 MB 135.68 MB +43.62 KB +0.0%
hits_048.vortex 1.0 vortex-file-compressed 198.74 MB 198.80 MB +58.65 KB +0.0%
hits_088.vortex 1.0 vortex-file-compressed 171.81 MB 171.86 MB +47.91 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 198.81 MB 198.87 MB +55.18 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.82 MB 145.85 MB +34.04 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.09 MB 146.12 MB +31.45 KB +0.0%
hits_036.vortex 1.0 vortex-compact 133.37 MB 133.40 MB +28.05 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.25 MB 134.28 MB +24.38 KB +0.0%
hits_070.vortex 1.0 vortex-file-compressed 199.16 MB 199.19 MB +30.40 KB +0.0%
hits_022.vortex 1.0 vortex-compact 152.95 MB 152.97 MB +20.43 KB +0.0%
hits_005.vortex 1.0 vortex-compact 115.84 MB 115.86 MB +13.16 KB +0.0%
hits_025.vortex 1.0 vortex-compact 133.44 MB 133.45 MB +11.06 KB +0.0%
hits_072.vortex 1.0 vortex-compact 75.54 MB 75.55 MB +6.22 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.27 MB 154.28 MB +12.39 KB +0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.05 MB 139.07 MB +10.49 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.18 MB 126.19 MB +8.42 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.46 MB 110.47 MB +7.30 KB +0.0%
hits_081.vortex 1.0 vortex-compact 153.72 MB 153.73 MB +9.09 KB +0.0%
hits_008.vortex 1.0 vortex-compact 106.23 MB 106.23 MB +4.15 KB +0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.00 MB 130.00 MB +4.01 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 171.93 MB 171.93 MB +5.11 KB +0.0%
hits_058.vortex 1.0 vortex-compact 111.06 MB 111.06 MB +3.14 KB +0.0%
hits_017.vortex 1.0 vortex-compact 111.77 MB 111.77 MB +2.89 KB +0.0%
hits_044.vortex 1.0 vortex-compact 153.57 MB 153.58 MB +2.62 KB +0.0%
hits_097.vortex 1.0 vortex-compact 140.13 MB 140.13 MB +1.80 KB +0.0%
hits_051.vortex 1.0 vortex-compact 133.98 MB 133.98 MB +1.58 KB +0.0%
hits_032.vortex 1.0 vortex-compact 110.60 MB 110.60 MB +1.25 KB +0.0%
hits_055.vortex 1.0 vortex-file-compressed 199.05 MB 199.05 MB +1.87 KB +0.0%
hits_019.vortex 1.0 vortex-file-compressed 139.68 MB 139.68 MB +472 B +0.0%
hits_035.vortex 1.0 vortex-compact 75.91 MB 75.91 MB 224 B -0.0%
hits_023.vortex 1.0 vortex-compact 142.70 MB 142.70 MB 1.27 KB -0.0%
hits_028.vortex 1.0 vortex-compact 115.66 MB 115.66 MB 2.40 KB -0.0%
hits_095.vortex 1.0 vortex-compact 110.62 MB 110.61 MB 4.21 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.21 MB 3.91 KB -0.0%
hits_099.vortex 1.0 vortex-compact 133.14 MB 133.13 MB 8.99 KB -0.0%
hits_038.vortex 1.0 vortex-compact 139.51 MB 139.50 MB 10.50 KB -0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.56 MB 153.55 MB 13.05 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.76 MB 101.75 MB 8.81 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.49 MB 130.47 MB 12.04 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.68 MB 125.67 MB 11.80 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 166.43 MB 166.41 MB 22.78 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.51 MB 104.50 MB 14.45 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 159.98 MB 159.95 MB 27.23 KB -0.0%
hits_064.vortex 1.0 vortex-compact 140.04 MB 140.02 MB 25.27 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.58 MB 153.55 MB 28.31 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 159.50 MB 159.47 MB 31.20 KB -0.0%
hits_053.vortex 1.0 vortex-compact 138.42 MB 138.39 MB 29.22 KB -0.0%
hits_020.vortex 1.0 vortex-compact 111.64 MB 111.62 MB 28.68 KB -0.0%
hits_044.vortex 1.0 vortex-file-compressed 198.35 MB 198.30 MB 51.79 KB -0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.10 MB 192.05 MB 52.58 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 176.53 MB 176.48 MB 49.74 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.48 MB 153.44 MB 46.12 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.83 MB 125.79 MB 40.93 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 160.61 MB 160.56 MB 52.82 KB -0.0%
hits_085.vortex 1.0 vortex-compact 153.35 MB 153.29 MB 58.77 KB -0.0%
hits_092.vortex 1.0 vortex-compact 153.32 MB 153.26 MB 62.54 KB -0.0%
hits_057.vortex 1.0 vortex-compact 111.75 MB 111.71 MB 45.73 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.09 MB 189.01 MB 83.55 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 171.78 MB 171.69 MB 89.40 KB -0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.19 MB 191.10 MB 100.47 KB -0.1%
hits_029.vortex 1.0 vortex-compact 153.42 MB 153.34 MB 81.16 KB -0.1%
hits_054.vortex 1.0 vortex-file-compressed 146.08 MB 146.00 MB 81.03 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.68 MB 100.62 MB 55.93 KB -0.1%
hits_076.vortex 1.0 vortex-compact 125.43 MB 125.36 MB 71.86 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.66 MB 153.57 MB 90.73 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.44 MB 153.35 MB 90.65 KB -0.1%
hits_060.vortex 1.0 vortex-compact 141.22 MB 141.14 MB 84.76 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 160.82 MB 160.72 MB 102.32 KB -0.1%
hits_015.vortex 1.0 vortex-compact 97.99 MB 97.93 MB 63.90 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 141.79 MB 141.69 MB 95.65 KB -0.1%
hits_049.vortex 1.0 vortex-compact 140.57 MB 140.48 MB 98.46 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 170.76 MB 170.63 MB 134.14 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.80 MB 130.70 MB 104.31 KB -0.1%
hits_086.vortex 1.0 vortex-compact 140.78 MB 140.67 MB 117.84 KB -0.1%
hits_045.vortex 1.0 vortex-compact 106.18 MB 106.09 MB 92.98 KB -0.1%
hits_055.vortex 1.0 vortex-compact 153.35 MB 153.22 MB 135.22 KB -0.1%
hits_094.vortex 1.0 vortex-compact 110.80 MB 110.70 MB 101.70 KB -0.1%
hits_059.vortex 1.0 vortex-compact 152.94 MB 152.79 MB 152.17 KB -0.1%
hits_090.vortex 1.0 vortex-compact 141.38 MB 141.21 MB 165.76 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.45 MB 180.24 MB 214.85 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 159.92 MB 159.74 MB 190.70 KB -0.1%
hits_037.vortex 1.0 vortex-compact 132.47 MB 132.31 MB 163.23 KB -0.1%
hits_066.vortex 1.0 vortex-compact 117.68 MB 117.54 MB 148.02 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.71 MB 130.54 MB 173.79 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 159.63 MB 159.41 MB 228.88 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.01 MB 130.83 MB 189.08 KB -0.1%
hits_056.vortex 1.0 vortex-compact 101.37 MB 101.22 MB 147.80 KB -0.1%
hits_016.vortex 1.0 vortex-compact 127.58 MB 127.39 MB 191.59 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 190.73 MB 190.44 MB 287.95 KB -0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.03 MB 171.78 MB 261.63 KB -0.1%
hits_083.vortex 1.0 vortex-compact 110.06 MB 109.88 MB 185.92 KB -0.2%
hits_088.vortex 1.0 vortex-compact 134.33 MB 134.10 MB 236.00 KB -0.2%
hits_031.vortex 1.0 vortex-compact 111.72 MB 111.50 MB 219.67 KB -0.2%
hits_052.vortex 1.0 vortex-file-compressed 130.21 MB 129.95 MB 267.59 KB -0.2%
hits_094.vortex 1.0 vortex-file-compressed 157.59 MB 157.27 MB 334.58 KB -0.2%
hits_022.vortex 1.0 vortex-file-compressed 198.83 MB 198.41 MB 432.08 KB -0.2%
hits_021.vortex 1.0 vortex-compact 110.60 MB 110.37 MB 243.04 KB -0.2%
hits_096.vortex 1.0 vortex-file-compressed 199.26 MB 198.82 MB 446.62 KB -0.2%
hits_078.vortex 1.0 vortex-compact 98.11 MB 97.88 MB 228.23 KB -0.2%
hits_062.vortex 1.0 vortex-file-compressed 170.38 MB 169.95 MB 437.27 KB -0.3%
hits_099.vortex 1.0 vortex-file-compressed 171.06 MB 170.60 MB 470.30 KB -0.3%
hits_077.vortex 1.0 vortex-compact 134.63 MB 134.20 MB 443.65 KB -0.3%
hits_033.vortex 1.0 vortex-file-compressed 198.68 MB 197.96 MB 741.61 KB -0.4%
hits_019.vortex 1.0 vortex-compact 106.61 MB 106.18 MB 440.51 KB -0.4%
hits_042.vortex 1.0 vortex-file-compressed 201.07 MB 200.22 MB 862.60 KB -0.4%
hits_071.vortex 1.0 vortex-file-compressed 139.44 MB 138.81 MB 654.07 KB -0.5%
hits_098.vortex 1.0 vortex-file-compressed 137.28 MB 136.64 MB 652.92 KB -0.5%
hits_033.vortex 1.0 vortex-compact 153.43 MB 152.58 MB 866.38 KB -0.6%
hits_048.vortex 1.0 vortex-compact 153.45 MB 152.58 MB 885.24 KB -0.6%
hits_093.vortex 1.0 vortex-compact 99.04 MB 98.45 MB 608.69 KB -0.6%
hits_018.vortex 1.0 vortex-compact 153.73 MB 152.73 MB 1018.88 KB -0.6%
hits_053.vortex 1.0 vortex-file-compressed 190.32 MB 188.94 MB 1.37 MB -0.7%
hits_045.vortex 1.0 vortex-file-compressed 139.66 MB 138.63 MB 1.03 MB -0.7%
hits_034.vortex 1.0 vortex-file-compressed 182.55 MB 180.88 MB 1.67 MB -0.9%
hits_075.vortex 1.0 vortex-compact 139.13 MB 137.84 MB 1.28 MB -0.9%
hits_012.vortex 1.0 vortex-compact 139.94 MB 138.51 MB 1.43 MB -1.0%
hits_027.vortex 1.0 vortex-file-compressed 191.19 MB 189.01 MB 2.19 MB -1.1%
hits_026.vortex 1.0 vortex-compact 99.00 MB 97.61 MB 1.40 MB -1.4%
hits_063.vortex 1.0 vortex-compact 99.24 MB 97.84 MB 1.40 MB -1.4%
hits_002.vortex 1.0 vortex-compact 125.57 MB 123.72 MB 1.85 MB -1.5%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (+0.1%)
  • vortex-file-compressed: 15.87 GB → 15.88 GB (+0.1%)

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.4%
Engines: DataFusion No clear signal (-3.1%, environment too noisy confidence) · DuckDB No clear signal (-5.8%, environment too noisy confidence)
Vortex (geomean): hot 0.960x ➖ · cold 0.983x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.953x ➖
Shifts: Parquet (control) +0.4% · Median polish -4.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.927x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 78634671 / 83219178 / -5.5% 142332619 / 135285492 / +5.2% 0.55 / 0.62 / -10.2%
fineweb_q01/datafusion:vortex-file-compressed 532392710 / 667054980 / -20.2% 835050446 / 767616502 / +8.8% 0.64 / 0.87 / -26.6%
fineweb_q02/datafusion:vortex-file-compressed 380318106 / 582195039 / -34.7% 🟢 619150972 / 714148013 / -13.3% 0.61 / 0.82 / -24.7%
fineweb_q03/datafusion:vortex-file-compressed 463945806 / 478455566 / -3.0% 821983979 / 712422358 / +15.4% 0.56 / 0.67 / -16.0%
fineweb_q04/datafusion:vortex-file-compressed 460560777 / 407462402 / +13.0% 559403604 / 459863368 / +21.6% 0.82 / 0.89 / -7.1%
fineweb_q05/datafusion:vortex-file-compressed 435701100 / 447555286 / -2.6% 448640507 / 498088953 / -9.9% 0.97 / 0.90 / +8.1%
fineweb_q06/datafusion:vortex-file-compressed 986883044 / 763312698 / +29.3% 864683169 / 698604442 / +23.8% 1.14 / 1.09 / +4.5%
fineweb_q07/datafusion:vortex-file-compressed 822778912 / 889161266 / -7.5% 916224929 / 807401598 / +13.5% 0.90 / 1.10 / -18.5%
fineweb_q08/datafusion:vortex-file-compressed 213394539 / 265522164 / -19.6% 293145755 / 340073957 / -13.8% 0.73 / 0.78 / -6.8%
datafusion / vortex-compact / ns (0.974x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 37187090 / 49295604 / -24.6% 123756828 / 180295334 / -31.4% 🟢 0.30 / 0.27 / +9.9%
fineweb_q01/datafusion:vortex-compact 494668810 / 371526871 / +33.1% 🔴 883010202 / 666918159 / +32.4% 🔴 0.56 / 0.56 / +0.6%
fineweb_q02/datafusion:vortex-compact 406391036 / 385557449 / +5.4% 495221359 / 484932600 / +2.1% 0.82 / 0.80 / +3.2%
fineweb_q03/datafusion:vortex-compact 540235220 / 832420134 / -35.1% 🟢 722762135 / 989374297 / -26.9% 0.75 / 0.84 / -11.2%
fineweb_q04/datafusion:vortex-compact 460613743 / 578076760 / -20.3% 614682494 / 633323591 / -2.9% 0.75 / 0.91 / -17.9%
fineweb_q05/datafusion:vortex-compact 474448844 / 470573188 / +0.8% 454819398 / 467808772 / -2.8% 1.04 / 1.01 / +3.7%
fineweb_q06/datafusion:vortex-compact 715493058 / 773354622 / -7.5% 707479926 / 772154754 / -8.4% 1.01 / 1.00 / +1.0%
fineweb_q07/datafusion:vortex-compact 466856596 / 550534163 / -15.2% 465274149 / 513764204 / -9.4% 1.00 / 1.07 / -6.4%
fineweb_q08/datafusion:vortex-compact 334815496 / 184536784 / +81.4% 🔴 237414388 / 200143124 / +18.6% 1.41 / 0.92 / +53.0%
datafusion / parquet / ns (0.980x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 485287348 / 451095764 / +7.6% 720665121 / 748689272 / -3.7% 0.67 / 0.60 / +11.8%
fineweb_q01/datafusion:parquet 714436392 / 782586502 / -8.7% 660657717 / 968640518 / -31.8% 🟢 1.08 / 0.81 / +33.8%
fineweb_q02/datafusion:parquet 806428364 / 791858636 / +1.8% 985804837 / 797873874 / +23.6% 0.82 / 0.99 / -17.6%
fineweb_q03/datafusion:parquet 689458840 / 748624482 / -7.9% 729499828 / 884459587 / -17.5% 0.95 / 0.85 / +11.7%
fineweb_q04/datafusion:parquet 744552576 / 772309313 / -3.6% 617885345 / 807913794 / -23.5% 1.21 / 0.96 / +26.1%
fineweb_q05/datafusion:parquet 705374052 / 816994208 / -13.7% 753925693 / 783916779 / -3.8% 0.94 / 1.04 / -10.2%
fineweb_q06/datafusion:parquet 893470596 / 875043550 / +2.1% 861259614 / 780574883 / +10.3% 1.04 / 1.12 / -7.5%
fineweb_q07/datafusion:parquet 713791314 / 764966362 / -6.7% 638532471 / 864812939 / -26.2% 1.12 / 0.88 / +26.4%
fineweb_q08/datafusion:parquet 694043881 / 606339794 / +14.5% 765626623 / 731481659 / +4.7% 0.91 / 0.83 / +9.4%
duckdb / vortex-file-compressed / ns (0.937x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 59399232 / 69239602 / -14.2% 66546420 / 48252875 / +37.9% 🔴 0.89 / 1.43 / -37.8%
fineweb_q01/duckdb:vortex-file-compressed 519500222 / 596255774 / -12.9% 547994366 / 520171820 / +5.3% 0.95 / 1.15 / -17.3%
fineweb_q02/duckdb:vortex-file-compressed 654459241 / 711080182 / -8.0% 687857459 / 1081234700 / -36.4% 🟢 0.95 / 0.66 / +44.7%
fineweb_q03/duckdb:vortex-file-compressed 1395301110 / 1519243273 / -8.2% 1438751624 / 1421604690 / +1.2% 0.97 / 1.07 / -9.3%
fineweb_q04/duckdb:vortex-file-compressed 1440265472 / 1504478073 / -4.3% 1460860443 / 1539971821 / -5.1% 0.99 / 0.98 / +0.9%
fineweb_q05/duckdb:vortex-file-compressed 1341629014 / 1371114090 / -2.2% 1497047332 / 1418881140 / +5.5% 0.90 / 0.97 / -7.3%
fineweb_q06/duckdb:vortex-file-compressed 1526750624 / 1507196142 / +1.3% 1557212123 / 1573723451 / -1.0% 0.98 / 0.96 / +2.4%
fineweb_q07/duckdb:vortex-file-compressed 1341143678 / 1423365735 / -5.8% 1349949577 / 1424820603 / -5.3% 0.99 / 1.00 / -0.6%
fineweb_q08/duckdb:vortex-file-compressed 561853244 / 569939230 / -1.4% 586435328 / 606799339 / -3.4% 0.96 / 0.94 / +2.0%
duckdb / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 81732220 / 69394798 / +17.8% 73508625 / 72990101 / +0.7% 1.11 / 0.95 / +16.9%
fineweb_q01/duckdb:vortex-compact 478311639 / 491231134 / -2.6% 506663862 / 592390827 / -14.5% 0.94 / 0.83 / +13.8%
fineweb_q02/duckdb:vortex-compact 623767936 / 655203308 / -4.8% 606475550 / 645591600 / -6.1% 1.03 / 1.01 / +1.3%
fineweb_q03/duckdb:vortex-compact 1645329543 / 1588277294 / +3.6% 1655393745 / 1708581896 / -3.1% 0.99 / 0.93 / +6.9%
fineweb_q04/duckdb:vortex-compact 1475188593 / 1567614956 / -5.9% 1448858064 / 1691872896 / -14.4% 1.02 / 0.93 / +9.9%
fineweb_q05/duckdb:vortex-compact 1381076905 / 1473641966 / -6.3% 1380497937 / 1400365250 / -1.4% 1.00 / 1.05 / -4.9%
fineweb_q06/duckdb:vortex-compact 1532213402 / 1491945462 / +2.7% 1518041416 / 1441152212 / +5.3% 1.01 / 1.04 / -2.5%
fineweb_q07/duckdb:vortex-compact 1317623083 / 1309675266 / +0.6% 1329960106 / 1335156626 / -0.4% 0.99 / 0.98 / +1.0%
fineweb_q08/duckdb:vortex-compact 524662240 / 528635100 / -0.8% 552375701 / 585639125 / -5.7% 0.95 / 0.90 / +5.2%
duckdb / parquet / ns (1.028x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 519181822 / 568706696 / -8.7% 558940131 / 544969922 / +2.6% 0.93 / 1.04 / -11.0%
fineweb_q01/duckdb:parquet 660166467 / 606903366 / +8.8% 736549038 / 632407977 / +16.5% 0.90 / 0.96 / -6.6%
fineweb_q02/duckdb:parquet 592506868 / 586426950 / +1.0% 562998669 / 623971481 / -9.8% 1.05 / 0.94 / +12.0%
fineweb_q03/duckdb:parquet 1385958462 / 1491832710 / -7.1% 1407673762 / 1377681472 / +2.2% 0.98 / 1.08 / -9.1%
fineweb_q04/duckdb:parquet 802124434 / 789944314 / +1.5% 794641470 / 833594050 / -4.7% 1.01 / 0.95 / +6.5%
fineweb_q05/duckdb:parquet 911296319 / 891070842 / +2.3% 928128544 / 879091486 / +5.6% 0.98 / 1.01 / -3.1%
fineweb_q06/duckdb:parquet 1762133610 / 1717857968 / +2.6% 1629933089 / 1688727724 / -3.5% 1.08 / 1.02 / +6.3%
fineweb_q07/duckdb:parquet 1175206942 / 1043064126 / +12.7% 1100506663 / 1574004619 / -30.1% 🟢 1.07 / 0.66 / +61.1%
fineweb_q08/duckdb:parquet 577484054 / 502064570 / +15.0% 674503749 / 499766005 / +35.0% 🔴 0.86 / 1.00 / -14.8%

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-1.0%, low confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.999x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.993x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 51747571 / 51264805 / +0.9% 73293735 / 76679749 / -4.4% 0.71 / 0.67 / +5.6%
appian_q02/datafusion:vortex-compact 235775265 / 232775399 / +1.3% 259458323 / 265120761 / -2.1% 0.91 / 0.88 / +3.5%
appian_q03/datafusion:vortex-compact 145251338 / 146573496 / -0.9% 183500783 / 180155215 / +1.9% 0.79 / 0.81 / -2.7%
appian_q04/datafusion:vortex-compact 9845194268 / 9897558222 / -0.5% 9829794180 / 9817285096 / +0.1% 1.00 / 1.01 / -0.7%
appian_q05/datafusion:vortex-compact 135755519 / 140052321 / -3.1% 159257156 / 161578377 / -1.4% 0.85 / 0.87 / -1.7%
appian_q06/datafusion:vortex-compact 142291411 / 143310171 / -0.7% 166317042 / 171689436 / -3.1% 0.86 / 0.83 / +2.5%
appian_q07/datafusion:vortex-compact 162386231 / 163993368 / -1.0% 192852368 / 195650536 / -1.4% 0.84 / 0.84 / +0.5%
appian_q08/datafusion:vortex-compact 549495112 / 556986083 / -1.3% 605541513 / 589286840 / +2.8% 0.91 / 0.95 / -4.0%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72462423 / 71868929 / +0.8% 92246217 / 97182765 / -5.1% 0.79 / 0.74 / +6.2%
appian_q02/datafusion:parquet 297950986 / 297363353 / +0.2% 327112590 / 327874551 / -0.2% 0.91 / 0.91 / +0.4%
appian_q03/datafusion:parquet 186352578 / 183941599 / +1.3% 225698079 / 223802973 / +0.8% 0.83 / 0.82 / +0.5%
appian_q04/datafusion:parquet 9942949414 / 9932512635 / +0.1% 9886465107 / 9820773001 / +0.7% 1.01 / 1.01 / -0.6%
appian_q05/datafusion:parquet 192683472 / 190990486 / +0.9% 217956770 / 215390979 / +1.2% 0.88 / 0.89 / -0.3%
appian_q06/datafusion:parquet 168121150 / 167750822 / +0.2% 188945573 / 193276229 / -2.2% 0.89 / 0.87 / +2.5%
appian_q07/datafusion:parquet 205180111 / 206359068 / -0.6% 233286639 / 234959959 / -0.7% 0.88 / 0.88 / +0.1%
appian_q08/datafusion:parquet 664276227 / 665658984 / -0.2% 673250205 / 683960913 / -1.6% 0.99 / 0.97 / +1.4%
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 90252574 / 91617161 / -1.5% 106945938 / 106879506 / +0.1% 0.84 / 0.86 / -1.6%
appian_q02/duckdb:vortex-compact 213308854 / 215400550 / -1.0% 241256844 / 229879129 / +4.9% 0.88 / 0.94 / -5.6%
appian_q03/duckdb:vortex-compact 121595933 / 122504430 / -0.7% 138946609 / 141037483 / -1.5% 0.88 / 0.87 / +0.8%
appian_q04/duckdb:vortex-compact 541043337 / 552516826 / -2.1% 569987692 / 571283288 / -0.2% 0.95 / 0.97 / -1.9%
appian_q05/duckdb:vortex-compact 134429815 / 132469704 / +1.5% 158525615 / 158882636 / -0.2% 0.85 / 0.83 / +1.7%
appian_q06/duckdb:vortex-compact 408746459 / 403284103 / +1.4% 400370207 / 413261471 / -3.1% 1.02 / 0.98 / +4.6%
appian_q07/duckdb:vortex-compact 138452694 / 139034869 / -0.4% 162342162 / 157247400 / +3.2% 0.85 / 0.88 / -3.5%
appian_q08/duckdb:vortex-compact 443458871 / 449376528 / -1.3% 483315817 / 465449853 / +3.8% 0.92 / 0.97 / -5.0%
duckdb / parquet / ns (1.011x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 99883942 / 100166128 / -0.3% 124642710 / 122447296 / +1.8% 0.80 / 0.82 / -2.0%
appian_q02/duckdb:parquet 197338380 / 200441640 / -1.5% 216502529 / 208242400 / +4.0% 0.91 / 0.96 / -5.3%
appian_q03/duckdb:parquet 125570112 / 125756074 / -0.1% 140809141 / 142429793 / -1.1% 0.89 / 0.88 / +1.0%
appian_q04/duckdb:parquet 432885481 / 441786246 / -2.0% 456429945 / 463614218 / -1.5% 0.95 / 0.95 / -0.5%
appian_q05/duckdb:parquet 142868856 / 142720871 / +0.1% 165880948 / 168078030 / -1.3% 0.86 / 0.85 / +1.4%
appian_q06/duckdb:parquet 284559494 / 253512842 / +12.2% 🔴 275467837 / 277935679 / -0.9% 1.03 / 0.91 / +13.3%
appian_q07/duckdb:parquet 154852291 / 154259302 / +0.4% 170882110 / 188673326 / -9.4% 0.91 / 0.82 / +10.8%
appian_q08/duckdb:parquet 380054586 / 376536624 / +0.9% 421591266 / 401720701 / +4.9% 0.90 / 0.94 / -3.8%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.989x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -1.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 8995602 / 9116811 / -1.3% 9495668 / 9445047 / +0.5% 0.95 / 0.97 / -1.9%
statpopgen_q01/duckdb:vortex-file-compressed 10399784 / 10381499 / +0.2% 14800253 / 14846377 / -0.3% 0.70 / 0.70 / +0.5%
statpopgen_q02/duckdb:vortex-file-compressed 377125660 / 375219410 / +0.5% 394214751 / 394187029 / +0.0% 0.96 / 0.95 / +0.5%
statpopgen_q03/duckdb:vortex-file-compressed 889708532 / 899219614 / -1.1% 909702028 / 904148708 / +0.6% 0.98 / 0.99 / -1.7%
statpopgen_q04/duckdb:vortex-file-compressed 893683112 / 895473869 / -0.2% 891787569 / 905406747 / -1.5% 1.00 / 0.99 / +1.3%
statpopgen_q05/duckdb:vortex-file-compressed 422564336 / 421758350 / +0.2% 432309047 / 435552254 / -0.7% 0.98 / 0.97 / +0.9%
statpopgen_q06/duckdb:vortex-file-compressed 1166003017 / 1165452374 / +0.0% 1172885715 / 1169422167 / +0.3% 0.99 / 1.00 / -0.2%
statpopgen_q07/duckdb:vortex-file-compressed 186786621 / 186237306 / +0.3% 208598581 / 210552025 / -0.9% 0.90 / 0.88 / +1.2%
statpopgen_q08/duckdb:vortex-file-compressed 201046826 / 198560462 / +1.3% 225870597 / 210573497 / +7.3% 0.89 / 0.94 / -5.6%
statpopgen_q09/duckdb:vortex-file-compressed 704815674 / 702432737 / +0.3% 750971416 / 759350721 / -1.1% 0.94 / 0.93 / +1.5%
statpopgen_q10/duckdb:vortex-file-compressed 2014292794 / 1991796426 / +1.1% 1981189557 / 1971121065 / +0.5% 1.02 / 1.01 / +0.6%
duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 9048227 / 9044789 / +0.0% 9423507 / 9472689 / -0.5% 0.96 / 0.95 / +0.6%
statpopgen_q01/duckdb:vortex-compact 10313424 / 10264026 / +0.5% 14013353 / 13817324 / +1.4% 0.74 / 0.74 / -0.9%
statpopgen_q02/duckdb:vortex-compact 386965196 / 387710576 / -0.2% 401996249 / 402831004 / -0.2% 0.96 / 0.96 / +0.0%
statpopgen_q03/duckdb:vortex-compact 904043658 / 905631256 / -0.2% 907301908 / 913596787 / -0.7% 1.00 / 0.99 / +0.5%
statpopgen_q04/duckdb:vortex-compact 907537109 / 911898996 / -0.5% 903293018 / 907596716 / -0.5% 1.00 / 1.00 / -0.0%
statpopgen_q05/duckdb:vortex-compact 435756603 / 434855262 / +0.2% 444479535 / 440048529 / +1.0% 0.98 / 0.99 / -0.8%
statpopgen_q06/duckdb:vortex-compact 1179049246 / 1175770090 / +0.3% 1177420019 / 1178342776 / -0.1% 1.00 / 1.00 / +0.4%
statpopgen_q07/duckdb:vortex-compact 316186760 / 316714784 / -0.2% 341076722 / 331733320 / +2.8% 0.93 / 0.95 / -2.9%
statpopgen_q08/duckdb:vortex-compact 331506416 / 334539392 / -0.9% 355759814 / 356102183 / -0.1% 0.93 / 0.94 / -0.8%
statpopgen_q09/duckdb:vortex-compact 708930838 / 722793848 / -1.9% 720304037 / 733351389 / -1.8% 0.98 / 0.99 / -0.1%
statpopgen_q10/duckdb:vortex-compact 2040157870 / 2021423300 / +0.9% 1993185646 / 1992063013 / +0.1% 1.02 / 1.01 / +0.9%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 248130574 / 247427126 / +0.3% 249974452 / 246555991 / +1.4% 0.99 / 1.00 / -1.1%
statpopgen_q01/duckdb:parquet 305875594 / 305069066 / +0.3% 306531206 / 306674969 / -0.0% 1.00 / 0.99 / +0.3%
statpopgen_q02/duckdb:parquet 536956676 / 560641774 / -4.2% 549540774 / 591916159 / -7.2% 0.98 / 0.95 / +3.2%
statpopgen_q03/duckdb:parquet 871320982 / 866422454 / +0.6% 892640355 / 858624677 / +4.0% 0.98 / 1.01 / -3.3%
statpopgen_q04/duckdb:parquet 833652826 / 875778224 / -4.8% 802116867 / 858384632 / -6.6% 1.04 / 1.02 / +1.9%
statpopgen_q05/duckdb:parquet 603731418 / 606649714 / -0.5% 608191668 / 601867847 / +1.1% 0.99 / 1.01 / -1.5%
statpopgen_q06/duckdb:parquet 738236098 / 737980591 / +0.0% 718916203 / 715433789 / +0.5% 1.03 / 1.03 / -0.4%
statpopgen_q07/duckdb:parquet 606949153 / 608455166 / -0.2% 733867157 / 701545456 / +4.6% 0.83 / 0.87 / -4.6%
statpopgen_q08/duckdb:parquet 624691568 / 618238316 / +1.0% 680154669 / 673223147 / +1.0% 0.92 / 0.92 / +0.0%
statpopgen_q09/duckdb:parquet 792718514 / 791546106 / +0.1% 827652043 / 819880653 / +0.9% 0.96 / 0.97 / -0.8%
statpopgen_q10/duckdb:parquet 1452192530 / 1523236240 / -4.7% 1275406989 / 1232165851 / +3.5% 1.14 / 1.24 / -7.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+2.9%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.996x ➖
Parquet (geomean): hot 0.989x ➖ · cold 0.987x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 23864216 / 23429949 / +1.9% 44127294 / 46688460 / -5.5% 0.54 / 0.50 / +7.8%
tpcds_q02/datafusion:vortex-file-compressed 45131838 / 45337451 / -0.5% 64044510 / 63908146 / +0.2% 0.70 / 0.71 / -0.7%
tpcds_q03/datafusion:vortex-file-compressed 11232718 / 11607912 / -3.2% 30175834 / 29988920 / +0.6% 0.37 / 0.39 / -3.8%
tpcds_q04/datafusion:vortex-file-compressed 111029130 / 112954984 / -1.7% 141008410 / 141316707 / -0.2% 0.79 / 0.80 / -1.5%
tpcds_q05/datafusion:vortex-file-compressed 58664194 / 59662481 / -1.7% 82727786 / 83022468 / -0.4% 0.71 / 0.72 / -1.3%
tpcds_q06/datafusion:vortex-file-compressed 23135256 / 23261218 / -0.5% 47057325 / 46333000 / +1.6% 0.49 / 0.50 / -2.1%
tpcds_q07/datafusion:vortex-file-compressed 31358910 / 31936970 / -1.8% 60074644 / 56759641 / +5.8% 0.52 / 0.56 / -7.2%
tpcds_q08/datafusion:vortex-file-compressed 26112386 / 25620247 / +1.9% 46436055 / 48086588 / -3.4% 0.56 / 0.53 / +5.5%
tpcds_q09/datafusion:vortex-file-compressed 17741186 / 17093084 / +3.8% 35192436 / 35248082 / -0.2% 0.50 / 0.48 / +4.0%
tpcds_q10/datafusion:vortex-file-compressed 28999428 / 28773784 / +0.8% 52833080 / 51197038 / +3.2% 0.55 / 0.56 / -2.3%
tpcds_q11/datafusion:vortex-file-compressed 60234596 / 59670452 / +0.9% 84892791 / 86113831 / -1.4% 0.71 / 0.69 / +2.4%
tpcds_q12/datafusion:vortex-file-compressed 16232925 / 16235189 / -0.0% 34499617 / 34618319 / -0.3% 0.47 / 0.47 / +0.3%
tpcds_q13/datafusion:vortex-file-compressed 37505698 / 37650292 / -0.4% 61629004 / 62563286 / -1.5% 0.61 / 0.60 / +1.1%
tpcds_q14/datafusion:vortex-file-compressed 91640778 / 93250933 / -1.7% 123836253 / 117689386 / +5.2% 0.74 / 0.79 / -6.6%
tpcds_q15/datafusion:vortex-file-compressed 24583244 / 24689386 / -0.4% 46091407 / 47582973 / -3.1% 0.53 / 0.52 / +2.8%
tpcds_q16/datafusion:vortex-file-compressed 20849502 / 20718518 / +0.6% 44350044 / 43976626 / +0.8% 0.47 / 0.47 / -0.2%
tpcds_q17/datafusion:vortex-file-compressed 59709632 / 53209291 / +12.2% 🔴 84906349 / 77801768 / +9.1% 0.70 / 0.68 / +2.8%
tpcds_q18/datafusion:vortex-file-compressed 67293293 / 68131808 / -1.2% 92487674 / 97148720 / -4.8% 0.73 / 0.70 / +3.7%
tpcds_q19/datafusion:vortex-file-compressed 18097640 / 18005707 / +0.5% 42818739 / 43178229 / -0.8% 0.42 / 0.42 / +1.4%
tpcds_q20/datafusion:vortex-file-compressed 17264863 / 17185406 / +0.5% 35540495 / 35944526 / -1.1% 0.49 / 0.48 / +1.6%
tpcds_q21/datafusion:vortex-file-compressed 16617180 / 16650772 / -0.2% 41528010 / 42300106 / -1.8% 0.40 / 0.39 / +1.7%
tpcds_q22/datafusion:vortex-file-compressed 49297954 / 49736110 / -0.9% 71000270 / 71931870 / -1.3% 0.69 / 0.69 / +0.4%
tpcds_q23/datafusion:vortex-file-compressed 69810997 / 70746639 / -1.3% 97006333 / 101967144 / -4.9% 0.72 / 0.69 / +3.7%
tpcds_q24/datafusion:vortex-file-compressed 69165538 / 68677922 / +0.7% 94032702 / 94624249 / -0.6% 0.74 / 0.73 / +1.3%
tpcds_q25/datafusion:vortex-file-compressed 53759278 / 47871740 / +12.3% 🔴 75742166 / 77456899 / -2.2% 0.71 / 0.62 / +14.8%
tpcds_q26/datafusion:vortex-file-compressed 30220010 / 30017216 / +0.7% 54282335 / 54470838 / -0.3% 0.56 / 0.55 / +1.0%
tpcds_q27/datafusion:vortex-file-compressed 60574659 / 60334105 / +0.4% 86654983 / 90519294 / -4.3% 0.70 / 0.67 / +4.9%
tpcds_q28/datafusion:vortex-file-compressed 17397564 / 17514468 / -0.7% 40050436 / 38854109 / +3.1% 0.43 / 0.45 / -3.6%
tpcds_q29/datafusion:vortex-file-compressed 61196033 / 59290835 / +3.2% 82481451 / 82340108 / +0.2% 0.74 / 0.72 / +3.0%
tpcds_q30/datafusion:vortex-file-compressed 27522165 / 27581257 / -0.2% 46518574 / 48354421 / -3.8% 0.59 / 0.57 / +3.7%
tpcds_q31/datafusion:vortex-file-compressed 63242359 / 64852630 / -2.5% 91641728 / 94276184 / -2.8% 0.69 / 0.69 / +0.3%
tpcds_q32/datafusion:vortex-file-compressed 14043572 / 13919979 / +0.9% 34017392 / 32806785 / +3.7% 0.41 / 0.42 / -2.7%
tpcds_q33/datafusion:vortex-file-compressed 26238170 / 26671716 / -1.6% 49563491 / 50279933 / -1.4% 0.53 / 0.53 / -0.2%
tpcds_q34/datafusion:vortex-file-compressed 17832138 / 17877730 / -0.3% 38456156 / 40244757 / -4.4% 0.46 / 0.44 / +4.4%
tpcds_q35/datafusion:vortex-file-compressed 35039942 / 33983342 / +3.1% 59581779 / 59746109 / -0.3% 0.59 / 0.57 / +3.4%
tpcds_q36/datafusion:vortex-file-compressed 47339308 / 47805350 / -1.0% 71626159 / 71902397 / -0.4% 0.66 / 0.66 / -0.6%
tpcds_q37/datafusion:vortex-file-compressed 13268396 / 13651399 / -2.8% 36996191 / 38451126 / -3.8% 0.36 / 0.36 / +1.0%
tpcds_q38/datafusion:vortex-file-compressed 30359788 / 30048890 / +1.0% 53819163 / 52424260 / +2.7% 0.56 / 0.57 / -1.6%
tpcds_q39/datafusion:vortex-file-compressed 64899982 / 64435448 / +0.7% 89317642 / 92346135 / -3.3% 0.73 / 0.70 / +4.1%
tpcds_q40/datafusion:vortex-file-compressed 25182713 / 24979494 / +0.8% 46976402 / 47542419 / -1.2% 0.54 / 0.53 / +2.0%
tpcds_q41/datafusion:vortex-file-compressed 16405758 / 16517510 / -0.7% 32146176 / 31982665 / +0.5% 0.51 / 0.52 / -1.2%
tpcds_q42/datafusion:vortex-file-compressed 11004543 / 10888245 / +1.1% 29567674 / 29813540 / -0.8% 0.37 / 0.37 / +1.9%
tpcds_q43/datafusion:vortex-file-compressed 12865166 / 12593572 / +2.2% 34161076 / 33634891 / +1.6% 0.38 / 0.37 / +0.6%
tpcds_q44/datafusion:vortex-file-compressed 26084970 / 26301043 / -0.8% 50294643 / 51559218 / -2.5% 0.52 / 0.51 / +1.7%
tpcds_q45/datafusion:vortex-file-compressed 27684434 / 27932502 / -0.9% 50817011 / 51606897 / -1.5% 0.54 / 0.54 / +0.7%
tpcds_q46/datafusion:vortex-file-compressed 23412641 / 23743270 / -1.4% 48079478 / 46705886 / +2.9% 0.49 / 0.51 / -4.2%
tpcds_q47/datafusion:vortex-file-compressed 77447335 / 76060700 / +1.8% 105443421 / 106515819 / -1.0% 0.73 / 0.71 / +2.9%
tpcds_q48/datafusion:vortex-file-compressed 31758692 / 32215570 / -1.4% 54220406 / 54357758 / -0.3% 0.59 / 0.59 / -1.2%
tpcds_q49/datafusion:vortex-file-compressed 58357282 / 59382648 / -1.7% 84101804 / 85700376 / -1.9% 0.69 / 0.69 / +0.1%
tpcds_q50/datafusion:vortex-file-compressed 32992778 / 32990068 / +0.0% 57380126 / 55942809 / +2.6% 0.57 / 0.59 / -2.5%
tpcds_q51/datafusion:vortex-file-compressed 60200432 / 60805022 / -1.0% 85481622 / 86697297 / -1.4% 0.70 / 0.70 / +0.4%
tpcds_q52/datafusion:vortex-file-compressed 11178325 / 11191658 / -0.1% 30934749 / 30010421 / +3.1% 0.36 / 0.37 / -3.1%
tpcds_q53/datafusion:vortex-file-compressed 18217536 / 18038440 / +1.0% 38406869 / 40092343 / -4.2% 0.47 / 0.45 / +5.4%
tpcds_q54/datafusion:vortex-file-compressed 33769448 / 34569196 / -2.3% 58200362 / 59025932 / -1.4% 0.58 / 0.59 / -0.9%
tpcds_q55/datafusion:vortex-file-compressed 11085306 / 11089688 / -0.0% 29205867 / 27760472 / +5.2% 0.38 / 0.40 / -5.0%
tpcds_q56/datafusion:vortex-file-compressed 26186295 / 25708768 / +1.9% 48055767 / 50117341 / -4.1% 0.54 / 0.51 / +6.2%
tpcds_q57/datafusion:vortex-file-compressed 73738250 / 74107565 / -0.5% 100632114 / 98521077 / +2.1% 0.73 / 0.75 / -2.6%
tpcds_q58/datafusion:vortex-file-compressed 40282630 / 40532396 / -0.6% 68751066 / 67174316 / +2.3% 0.59 / 0.60 / -2.9%
tpcds_q59/datafusion:vortex-file-compressed 31020790 / 30689650 / +1.1% 53744483 / 53644002 / +0.2% 0.58 / 0.57 / +0.9%
tpcds_q60/datafusion:vortex-file-compressed 25703276 / 25689254 / +0.1% 47795978 / 49436945 / -3.3% 0.54 / 0.52 / +3.5%
tpcds_q61/datafusion:vortex-file-compressed 23576032 / 23492373 / +0.4% 49060796 / 49588415 / -1.1% 0.48 / 0.47 / +1.4%
tpcds_q62/datafusion:vortex-file-compressed 17842104 / 17302996 / +3.1% 37547071 / 38095028 / -1.4% 0.48 / 0.45 / +4.6%
tpcds_q63/datafusion:vortex-file-compressed 18226522 / 18447994 / -1.2% 39894689 / 40920272 / -2.5% 0.46 / 0.45 / +1.3%
tpcds_q64/datafusion:vortex-file-compressed 326411936 / 325104354 / +0.4% 350427558 / 355004200 / -1.3% 0.93 / 0.92 / +1.7%
tpcds_q65/datafusion:vortex-file-compressed 75266246 / 74257762 / +1.4% 95846307 / 95820178 / +0.0% 0.79 / 0.77 / +1.3%
tpcds_q66/datafusion:vortex-file-compressed 52810361 / 52576724 / +0.4% 75246380 / 77537581 / -3.0% 0.70 / 0.68 / +3.5%
tpcds_q67/datafusion:vortex-file-compressed 54674120 / 55363486 / -1.2% 84300958 / 83589398 / +0.9% 0.65 / 0.66 / -2.1%
tpcds_q68/datafusion:vortex-file-compressed 23381289 / 22427706 / +4.3% 47360929 / 48914314 / -3.2% 0.49 / 0.46 / +7.7%
tpcds_q69/datafusion:vortex-file-compressed 27689912 / 28447028 / -2.7% 49386618 / 52448718 / -5.8% 0.56 / 0.54 / +3.4%
tpcds_q70/datafusion:vortex-file-compressed 69143172 / 69013958 / +0.2% 92420086 / 93453338 / -1.1% 0.75 / 0.74 / +1.3%
tpcds_q71/datafusion:vortex-file-compressed 18717714 / 19059700 / -1.8% 41763307 / 45456633 / -8.1% 0.45 / 0.42 / +6.9%
tpcds_q72/datafusion:vortex-file-compressed 464297828 / 462034802 / +0.5% 506165825 / 481931532 / +5.0% 0.92 / 0.96 / -4.3%
tpcds_q73/datafusion:vortex-file-compressed 17041874 / 16808700 / +1.4% 38044163 / 40856022 / -6.9% 0.45 / 0.41 / +8.9%
tpcds_q74/datafusion:vortex-file-compressed 44114316 / 43767638 / +0.8% 69269619 / 70644983 / -1.9% 0.64 / 0.62 / +2.8%
tpcds_q75/datafusion:vortex-file-compressed 130949182 / 127394007 / +2.8% 159316415 / 161123239 / -1.1% 0.82 / 0.79 / +4.0%
tpcds_q76/datafusion:vortex-file-compressed 43160273 / 43959856 / -1.8% 62938570 / 64830736 / -2.9% 0.69 / 0.68 / +1.1%
tpcds_q77/datafusion:vortex-file-compressed 33943603 / 34679967 / -2.1% 59656876 / 59630391 / +0.0% 0.57 / 0.58 / -2.2%
tpcds_q78/datafusion:vortex-file-compressed 78105399 / 78374696 / -0.3% 105952758 / 106949682 / -0.9% 0.74 / 0.73 / +0.6%
tpcds_q79/datafusion:vortex-file-compressed 20849865 / 19815929 / +5.2% 40774325 / 42762393 / -4.6% 0.51 / 0.46 / +10.3%
tpcds_q80/datafusion:vortex-file-compressed 75838052 / 75542453 / +0.4% 105229266 / 107261724 / -1.9% 0.72 / 0.70 / +2.3%
tpcds_q81/datafusion:vortex-file-compressed 28038660 / 27653459 / +1.4% 46086305 / 47390108 / -2.8% 0.61 / 0.58 / +4.3%
tpcds_q82/datafusion:vortex-file-compressed 13582668 / 13212620 / +2.8% 38132828 / 38659550 / -1.4% 0.36 / 0.34 / +4.2%
tpcds_q83/datafusion:vortex-file-compressed 36413104 / 36101802 / +0.9% 58382762 / 59985739 / -2.7% 0.62 / 0.60 / +3.6%
tpcds_q84/datafusion:vortex-file-compressed 12440992 / 11954390 / +4.1% 29527782 / 30084519 / -1.9% 0.42 / 0.40 / +6.0%
tpcds_q85/datafusion:vortex-file-compressed 61591455 / 61273860 / +0.5% 87083875 / 89458272 / -2.7% 0.71 / 0.68 / +3.3%
tpcds_q86/datafusion:vortex-file-compressed 16270484 / 16321899 / -0.3% 33659505 / 35064287 / -4.0% 0.48 / 0.47 / +3.8%
tpcds_q87/datafusion:vortex-file-compressed 29391222 / 29342916 / +0.2% 52174041 / 51942989 / +0.4% 0.56 / 0.56 / -0.3%
tpcds_q88/datafusion:vortex-file-compressed 32358006 / 32271311 / +0.3% 63259004 / 61163919 / +3.4% 0.51 / 0.53 / -3.1%
tpcds_q89/datafusion:vortex-file-compressed 20257318 / 20456928 / -1.0% 42403699 / 42501690 / -0.2% 0.48 / 0.48 / -0.7%
tpcds_q90/datafusion:vortex-file-compressed 10272722 / 10469424 / -1.9% 28989530 / 29556752 / -1.9% 0.35 / 0.35 / +0.0%
tpcds_q91/datafusion:vortex-file-compressed 17473379 / 16861434 / +3.6% 40267933 / 40976419 / -1.7% 0.43 / 0.41 / +5.5%
tpcds_q92/datafusion:vortex-file-compressed 13764744 / 13846111 / -0.6% 34137694 / 35058051 / -2.6% 0.40 / 0.39 / +2.1%
tpcds_q93/datafusion:vortex-file-compressed 22177048 / 22586780 / -1.8% 46037996 / 46288604 / -0.5% 0.48 / 0.49 / -1.3%
tpcds_q94/datafusion:vortex-file-compressed 20230527 / 19742244 / +2.5% 42219067 / 42610700 / -0.9% 0.48 / 0.46 / +3.4%
tpcds_q95/datafusion:vortex-file-compressed 45886305 / 46543148 / -1.4% 67821000 / 70061166 / -3.2% 0.68 / 0.66 / +1.8%
tpcds_q96/datafusion:vortex-file-compressed 8128385 / 8321233 / -2.3% 27415835 / 26903134 / +1.9% 0.30 / 0.31 / -4.1%
tpcds_q97/datafusion:vortex-file-compressed 20696604 / 20839288 / -0.7% 43642341 / 44490926 / -1.9% 0.47 / 0.47 / +1.2%
tpcds_q98/datafusion:vortex-file-compressed 16581304 / 16715092 / -0.8% 37496502 / 39130046 / -4.2% 0.44 / 0.43 / +3.5%
tpcds_q99/datafusion:vortex-file-compressed 20170596 / 19985134 / +0.9% 39895698 / 40818761 / -2.3% 0.51 / 0.49 / +3.3%
datafusion / vortex-compact / ns (0.995x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25426198 / 25862971 / -1.7% 44965708 / 45459413 / -1.1% 0.57 / 0.57 / -0.6%
tpcds_q02/datafusion:vortex-compact 47952530 / 47362039 / +1.2% 65371212 / 66230303 / -1.3% 0.73 / 0.72 / +2.6%
tpcds_q03/datafusion:vortex-compact 12050382 / 12808404 / -5.9% 32909836 / 34369239 / -4.2% 0.37 / 0.37 / -1.7%
tpcds_q04/datafusion:vortex-compact 122654637 / 123199440 / -0.4% 152487321 / 157196030 / -3.0% 0.80 / 0.78 / +2.6%
tpcds_q05/datafusion:vortex-compact 60195636 / 60647024 / -0.7% 84720943 / 85275555 / -0.7% 0.71 / 0.71 / -0.1%
tpcds_q06/datafusion:vortex-compact 24631472 / 25523090 / -3.5% 47047955 / 48609385 / -3.2% 0.52 / 0.53 / -0.3%
tpcds_q07/datafusion:vortex-compact 34970188 / 36400872 / -3.9% 58857886 / 57908017 / +1.6% 0.59 / 0.63 / -5.5%
tpcds_q08/datafusion:vortex-compact 30590094 / 28726671 / +6.5% 50118965 / 53126107 / -5.7% 0.61 / 0.54 / +12.9%
tpcds_q09/datafusion:vortex-compact 22070870 / 22199058 / -0.6% 38962175 / 42009165 / -7.3% 0.57 / 0.53 / +7.2%
tpcds_q10/datafusion:vortex-compact 37839042 / 37632414 / +0.5% 60106826 / 62184956 / -3.3% 0.63 / 0.61 / +4.0%
tpcds_q11/datafusion:vortex-compact 69794414 / 68010164 / +2.6% 90085312 / 97696511 / -7.8% 0.77 / 0.70 / +11.3%
tpcds_q12/datafusion:vortex-compact 20332830 / 20637194 / -1.5% 40303221 / 41041257 / -1.8% 0.50 / 0.50 / +0.3%
tpcds_q13/datafusion:vortex-compact 59957123 / 60829060 / -1.4% 96031117 / 83399183 / +15.1% 🔴 0.62 / 0.73 / -14.4%
tpcds_q14/datafusion:vortex-compact 94350926 / 96918304 / -2.6% 122153415 / 122444650 / -0.2% 0.77 / 0.79 / -2.4%
tpcds_q15/datafusion:vortex-compact 26689238 / 27171725 / -1.8% 46826412 / 48306496 / -3.1% 0.57 / 0.56 / +1.3%
tpcds_q16/datafusion:vortex-compact 24441684 / 23593914 / +3.6% 45470853 / 45842967 / -0.8% 0.54 / 0.51 / +4.4%
tpcds_q17/datafusion:vortex-compact 67118415 / 69108862 / -2.9% 94521991 / 82872639 / +14.1% 🔴 0.71 / 0.83 / -14.8%
tpcds_q18/datafusion:vortex-compact 67878820 / 67506560 / +0.6% 89468246 / 93400668 / -4.2% 0.76 / 0.72 / +5.0%
tpcds_q19/datafusion:vortex-compact 21333302 / 23723348 / -10.1% 🟢 45153680 / 44145282 / +2.3% 0.47 / 0.54 / -12.1%
tpcds_q20/datafusion:vortex-compact 21780205 / 21717340 / +0.3% 43459430 / 43789274 / -0.8% 0.50 / 0.50 / +1.1%
tpcds_q21/datafusion:vortex-compact 18282238 / 17885116 / +2.2% 44338511 / 44957922 / -1.4% 0.41 / 0.40 / +3.6%
tpcds_q22/datafusion:vortex-compact 50223420 / 50441576 / -0.4% 74930931 / 74864898 / +0.1% 0.67 / 0.67 / -0.5%
tpcds_q23/datafusion:vortex-compact 74937366 / 74858721 / +0.1% 100558820 / 103955491 / -3.3% 0.75 / 0.72 / +3.5%
tpcds_q24/datafusion:vortex-compact 77360814 / 79201297 / -2.3% 102896145 / 102284932 / +0.6% 0.75 / 0.77 / -2.9%
tpcds_q25/datafusion:vortex-compact 59274232 / 63095053 / -6.1% 89871051 / 91951163 / -2.3% 0.66 / 0.69 / -3.9%
tpcds_q26/datafusion:vortex-compact 32392178 / 32387334 / +0.0% 52724042 / 54974786 / -4.1% 0.61 / 0.59 / +4.3%
tpcds_q27/datafusion:vortex-compact 65732758 / 62000787 / +6.0% 86946078 / 85221015 / +2.0% 0.76 / 0.73 / +3.9%
tpcds_q28/datafusion:vortex-compact 27636504 / 27583400 / +0.2% 50635685 / 52451434 / -3.5% 0.55 / 0.53 / +3.8%
tpcds_q29/datafusion:vortex-compact 61173891 / 62661730 / -2.4% 91006055 / 81584411 / +11.5% 🔴 0.67 / 0.77 / -12.5%
tpcds_q30/datafusion:vortex-compact 30314664 / 30033572 / +0.9% 49201814 / 49541508 / -0.7% 0.62 / 0.61 / +1.6%
tpcds_q31/datafusion:vortex-compact 75762402 / 76687316 / -1.2% 103481711 / 101761476 / +1.7% 0.73 / 0.75 / -2.8%
tpcds_q32/datafusion:vortex-compact 16445802 / 15951396 / +3.1% 36182587 / 35952030 / +0.6% 0.45 / 0.44 / +2.4%
tpcds_q33/datafusion:vortex-compact 27975374 / 27854157 / +0.4% 50298353 / 50353196 / -0.1% 0.56 / 0.55 / +0.5%
tpcds_q34/datafusion:vortex-compact 21168724 / 22620729 / -6.4% 43697590 / 45052901 / -3.0% 0.48 / 0.50 / -3.5%
tpcds_q35/datafusion:vortex-compact 41139476 / 42124054 / -2.3% 67886371 / 65289440 / +4.0% 0.61 / 0.65 / -6.1%
tpcds_q36/datafusion:vortex-compact 50945109 / 49931658 / +2.0% 73967298 / 76277960 / -3.0% 0.69 / 0.65 / +5.2%
tpcds_q37/datafusion:vortex-compact 15649626 / 16291034 / -3.9% 40826985 / 39879954 / +2.4% 0.38 / 0.41 / -6.2%
tpcds_q38/datafusion:vortex-compact 32322966 / 34101118 / -5.2% 58317048 / 57422437 / +1.6% 0.55 / 0.59 / -6.7%
tpcds_q39/datafusion:vortex-compact 66375138 / 64658871 / +2.7% 91513632 / 88361662 / +3.6% 0.73 / 0.73 / -0.9%
tpcds_q40/datafusion:vortex-compact 27518317 / 27589476 / -0.3% 53096814 / 52069874 / +2.0% 0.52 / 0.53 / -2.2%
tpcds_q41/datafusion:vortex-compact 18685071 / 18619226 / +0.4% 34517711 / 34724266 / -0.6% 0.54 / 0.54 / +1.0%
tpcds_q42/datafusion:vortex-compact 12918032 / 11700020 / +10.4% 🔴 34835649 / 35035990 / -0.6% 0.37 / 0.33 / +11.0%
tpcds_q43/datafusion:vortex-compact 16097620 / 15499462 / +3.9% 38246526 / 35900231 / +6.5% 0.42 / 0.43 / -2.5%
tpcds_q44/datafusion:vortex-compact 29336090 / 30573490 / -4.0% 55570093 / 56488110 / -1.6% 0.53 / 0.54 / -2.5%
tpcds_q45/datafusion:vortex-compact 30619592 / 30222766 / +1.3% 50369681 / 51165873 / -1.6% 0.61 / 0.59 / +2.9%
tpcds_q46/datafusion:vortex-compact 27510348 / 30130148 / -8.7% 52264508 / 50488665 / +3.5% 0.53 / 0.60 / -11.8%
tpcds_q47/datafusion:vortex-compact 86364322 / 87263900 / -1.0% 115720264 / 116110460 / -0.3% 0.75 / 0.75 / -0.7%
tpcds_q48/datafusion:vortex-compact 50759782 / 50752556 / +0.0% 71523979 / 71179228 / +0.5% 0.71 / 0.71 / -0.5%
tpcds_q49/datafusion:vortex-compact 64655579 / 64084630 / +0.9% 89049320 / 91028407 / -2.2% 0.73 / 0.70 / +3.1%
tpcds_q50/datafusion:vortex-compact 36382776 / 35638579 / +2.1% 60978242 / 57153094 / +6.7% 0.60 / 0.62 / -4.3%
tpcds_q51/datafusion:vortex-compact 61979879 / 63071043 / -1.7% 85515254 / 85407491 / +0.1% 0.72 / 0.74 / -1.9%
tpcds_q52/datafusion:vortex-compact 12487096 / 12246726 / +2.0% 33279536 / 34116093 / -2.5% 0.38 / 0.36 / +4.5%
tpcds_q53/datafusion:vortex-compact 22236416 / 23150516 / -3.9% 44731777 / 45596514 / -1.9% 0.50 / 0.51 / -2.1%
tpcds_q54/datafusion:vortex-compact 38701432 / 39569012 / -2.2% 65347948 / 66012618 / -1.0% 0.59 / 0.60 / -1.2%
tpcds_q55/datafusion:vortex-compact 12922274 / 12590719 / +2.6% 32267282 / 32838239 / -1.7% 0.40 / 0.38 / +4.4%
tpcds_q56/datafusion:vortex-compact 28635777 / 28582108 / +0.2% 53947853 / 53766655 / +0.3% 0.53 / 0.53 / -0.1%
tpcds_q57/datafusion:vortex-compact 77784713 / 80488286 / -3.4% 103770398 / 107584919 / -3.5% 0.75 / 0.75 / +0.2%
tpcds_q58/datafusion:vortex-compact 46005613 / 45911188 / +0.2% 72248737 / 71081163 / +1.6% 0.64 / 0.65 / -1.4%
tpcds_q59/datafusion:vortex-compact 38026798 / 38968732 / -2.4% 58828424 / 58290590 / +0.9% 0.65 / 0.67 / -3.3%
tpcds_q60/datafusion:vortex-compact 27768118 / 26877842 / +3.3% 51368059 / 52545057 / -2.2% 0.54 / 0.51 / +5.7%
tpcds_q61/datafusion:vortex-compact 27216056 / 27124771 / +0.3% 50372323 / 52284156 / -3.7% 0.54 / 0.52 / +4.1%
tpcds_q62/datafusion:vortex-compact 17799390 / 17609828 / +1.1% 36618693 / 36953179 / -0.9% 0.49 / 0.48 / +2.0%
tpcds_q63/datafusion:vortex-compact 22870594 / 22661370 / +0.9% 45984743 / 44078623 / +4.3% 0.50 / 0.51 / -3.3%
tpcds_q64/datafusion:vortex-compact 446091387 / 446607522 / -0.1% 451660744 / 456519956 / -1.1% 0.99 / 0.98 / +1.0%
tpcds_q65/datafusion:vortex-compact 81304042 / 81780954 / -0.6% 102748659 / 101594585 / +1.1% 0.79 / 0.80 / -1.7%
tpcds_q66/datafusion:vortex-compact 53879014 / 53656021 / +0.4% 77624975 / 78119769 / -0.6% 0.69 / 0.69 / +1.1%
tpcds_q67/datafusion:vortex-compact 58274101 / 59022706 / -1.3% 88498943 / 89224424 / -0.8% 0.66 / 0.66 / -0.5%
tpcds_q68/datafusion:vortex-compact 27984907 / 27533932 / +1.6% 52872128 / 53786747 / -1.7% 0.53 / 0.51 / +3.4%
tpcds_q69/datafusion:vortex-compact 35896760 / 36437233 / -1.5% 57526268 / 59741247 / -3.7% 0.62 / 0.61 / +2.3%
tpcds_q70/datafusion:vortex-compact 73850638 / 74566734 / -1.0% 95288107 / 95971343 / -0.7% 0.78 / 0.78 / -0.3%
tpcds_q71/datafusion:vortex-compact 20290582 / 21237880 / -4.5% 43616717 / 43420792 / +0.5% 0.47 / 0.49 / -4.9%
tpcds_q72/datafusion:vortex-compact 472428668 / 449431632 / +5.1% 477506796 / 471159485 / +1.3% 0.99 / 0.95 / +3.7%
tpcds_q73/datafusion:vortex-compact 20301832 / 19707591 / +3.0% 46683761 / 42917672 / +8.8% 0.43 / 0.46 / -5.3%
tpcds_q74/datafusion:vortex-compact 50559326 / 49601640 / +1.9% 73958304 / 74086409 / -0.2% 0.68 / 0.67 / +2.1%
tpcds_q75/datafusion:vortex-compact 135977906 / 134829292 / +0.9% 165558958 / 161657003 / +2.4% 0.82 / 0.83 / -1.5%
tpcds_q76/datafusion:vortex-compact 39392525 / 39569732 / -0.4% 62731792 / 62344313 / +0.6% 0.63 / 0.63 / -1.1%
tpcds_q77/datafusion:vortex-compact 37378314 / 38843978 / -3.8% 62776676 / 63123436 / -0.5% 0.60 / 0.62 / -3.2%
tpcds_q78/datafusion:vortex-compact 84935070 / 85318342 / -0.4% 112042915 / 113049221 / -0.9% 0.76 / 0.75 / +0.4%
tpcds_q79/datafusion:vortex-compact 24529243 / 24417112 / +0.5% 45914704 / 50995583 / -10.0% 0.53 / 0.48 / +11.6%
tpcds_q80/datafusion:vortex-compact 78399760 / 78448186 / -0.1% 109252618 / 108116501 / +1.1% 0.72 / 0.73 / -1.1%
tpcds_q81/datafusion:vortex-compact 29290538 / 29127815 / +0.6% 46676144 / 48443207 / -3.6% 0.63 / 0.60 / +4.4%
tpcds_q82/datafusion:vortex-compact 15765523 / 15566303 / +1.3% 43889416 / 41020562 / +7.0% 0.36 / 0.38 / -5.3%
tpcds_q83/datafusion:vortex-compact 36795534 / 37070898 / -0.7% 58407606 / 57224926 / +2.1% 0.63 / 0.65 / -2.8%
tpcds_q84/datafusion:vortex-compact 12560549 / 13160632 / -4.6% 30287587 / 30670352 / -1.2% 0.41 / 0.43 / -3.4%
tpcds_q85/datafusion:vortex-compact 107898274 / 107575118 / +0.3% 131735964 / 131624135 / +0.1% 0.82 / 0.82 / +0.2%
tpcds_q86/datafusion:vortex-compact 16198627 / 16006091 / +1.2% 36001734 / 37581500 / -4.2% 0.45 / 0.43 / +5.6%
tpcds_q87/datafusion:vortex-compact 34009938 / 32413157 / +4.9% 56481310 / 55679067 / +1.4% 0.60 / 0.58 / +3.4%
tpcds_q88/datafusion:vortex-compact 41392403 / 40747393 / +1.6% 71875407 / 69074100 / +4.1% 0.58 / 0.59 / -2.4%
tpcds_q89/datafusion:vortex-compact 24977132 / 25188786 / -0.8% 46543842 / 47797940 / -2.6% 0.54 / 0.53 / +1.8%
tpcds_q90/datafusion:vortex-compact 11279113 / 11185662 / +0.8% 29024630 / 31582777 / -8.1% 0.39 / 0.35 / +9.7%
tpcds_q91/datafusion:vortex-compact 27136950 / 27536838 / -1.5% 48821714 / 50137810 / -2.6% 0.56 / 0.55 / +1.2%
tpcds_q92/datafusion:vortex-compact 14976063 / 15711968 / -4.7% 34360392 / 35835867 / -4.1% 0.44 / 0.44 / -0.6%
tpcds_q93/datafusion:vortex-compact 24039833 / 24783868 / -3.0% 45769675 / 46112659 / -0.7% 0.53 / 0.54 / -2.3%
tpcds_q94/datafusion:vortex-compact 21495432 / 21524981 / -0.1% 42483430 / 43566649 / -2.5% 0.51 / 0.49 / +2.4%
tpcds_q95/datafusion:vortex-compact 49218936 / 49683622 / -0.9% 70032775 / 70829820 / -1.1% 0.70 / 0.70 / +0.2%
tpcds_q96/datafusion:vortex-compact 10472300 / 10749852 / -2.6% 28435342 / 29541205 / -3.7% 0.37 / 0.36 / +1.2%
tpcds_q97/datafusion:vortex-compact 24019840 / 24170749 / -0.6% 46151551 / 45040746 / +2.5% 0.52 / 0.54 / -3.0%
tpcds_q98/datafusion:vortex-compact 21508888 / 22067864 / -2.5% 44340890 / 44969788 / -1.4% 0.49 / 0.49 / -1.2%
tpcds_q99/datafusion:vortex-compact 20861572 / 20954948 / -0.4% 40611762 / 43482085 / -6.6% 0.51 / 0.48 / +6.6%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29976381 / 28987918 / +3.4% 49418667 / 49025318 / +0.8% 0.61 / 0.59 / +2.6%
tpcds_q02/datafusion:parquet 45069313 / 44795304 / +0.6% 63488381 / 63663046 / -0.3% 0.71 / 0.70 / +0.9%
tpcds_q03/datafusion:parquet 18944062 / 18866644 / +0.4% 32561131 / 35588645 / -8.5% 0.58 / 0.53 / +9.7%
tpcds_q04/datafusion:parquet 193518711 / 193782385 / -0.1% 224666718 / 224753756 / -0.0% 0.86 / 0.86 / -0.1%
tpcds_q05/datafusion:parquet 69810195 / 69998474 / -0.3% 92267911 / 94998636 / -2.9% 0.76 / 0.74 / +2.7%
tpcds_q06/datafusion:parquet 34061930 / 34867021 / -2.3% 52999031 / 53576066 / -1.1% 0.64 / 0.65 / -1.2%
tpcds_q07/datafusion:parquet 45048848 / 47543374 / -5.2% 67696336 / 72279426 / -6.3% 0.67 / 0.66 / +1.2%
tpcds_q08/datafusion:parquet 38956013 / 39183054 / -0.6% 53611639 / 59650810 / -10.1% 🟢 0.73 / 0.66 / +10.6%
tpcds_q09/datafusion:parquet 28128089 / 30586532 / -8.0% 39766402 / 41073199 / -3.2% 0.71 / 0.74 / -5.0%
tpcds_q10/datafusion:parquet 49120306 / 49821833 / -1.4% 61860267 / 68579753 / -9.8% 0.79 / 0.73 / +9.3%
tpcds_q11/datafusion:parquet 94257444 / 92939276 / +1.4% 117435771 / 115771939 / +1.4% 0.80 / 0.80 / -0.0%
tpcds_q12/datafusion:parquet 23875204 / 24014876 / -0.6% 37564347 / 38865093 / -3.3% 0.64 / 0.62 / +2.9%
tpcds_q13/datafusion:parquet 44331451 / 44179480 / +0.3% 70682131 / 67468496 / +4.8% 0.63 / 0.65 / -4.2%
tpcds_q14/datafusion:parquet 135458990 / 136055902 / -0.4% 150760579 / 154346174 / -2.3% 0.90 / 0.88 / +1.9%
tpcds_q15/datafusion:parquet 30456127 / 30497374 / -0.1% 50297894 / 50753929 / -0.9% 0.61 / 0.60 / +0.8%
tpcds_q16/datafusion:parquet 37079156 / 37184814 / -0.3% 57127759 / 58003801 / -1.5% 0.65 / 0.64 / +1.2%
tpcds_q17/datafusion:parquet 74763220 / 76168674 / -1.8% 101419448 / 99687477 / +1.7% 0.74 / 0.76 / -3.5%
tpcds_q18/datafusion:parquet 57171540 / 57778056 / -1.0% 75651266 / 81954928 / -7.7% 0.76 / 0.70 / +7.2%
tpcds_q19/datafusion:parquet 31754926 / 31991104 / -0.7% 55513899 / 51848462 / +7.1% 0.57 / 0.62 / -7.3%
tpcds_q20/datafusion:parquet 25289794 / 25601777 / -1.2% 41135364 / 39744499 / +3.5% 0.61 / 0.64 / -4.6%
tpcds_q21/datafusion:parquet 20322344 / 20108062 / +1.1% 35151251 / 36823952 / -4.5% 0.58 / 0.55 / +5.9%
tpcds_q22/datafusion:parquet 77620166 / 77949588 / -0.4% 92553544 / 92597447 / -0.0% 0.84 / 0.84 / -0.4%
tpcds_q23/datafusion:parquet 117054340 / 115920109 / +1.0% 136034964 / 139907897 / -2.8% 0.86 / 0.83 / +3.9%
tpcds_q24/datafusion:parquet 89986867 / 90288606 / -0.3% 118669532 / 118044998 / +0.5% 0.76 / 0.76 / -0.9%
tpcds_q25/datafusion:parquet 75675544 / 74399068 / +1.7% 100885077 / 105173961 / -4.1% 0.75 / 0.71 / +6.0%
tpcds_q26/datafusion:parquet 41287085 / 41321094 / -0.1% 62874396 / 60896851 / +3.2% 0.66 / 0.68 / -3.2%
tpcds_q27/datafusion:parquet 76088570 / 74624265 / +2.0% 106879675 / 102469391 / +4.3% 0.71 / 0.73 / -2.2%
tpcds_q28/datafusion:parquet 26967696 / 26893734 / +0.3% 45669445 / 46123583 / -1.0% 0.59 / 0.58 / +1.3%
tpcds_q29/datafusion:parquet 74339746 / 74678466 / -0.5% 103211418 / 107165140 / -3.7% 0.72 / 0.70 / +3.4%
tpcds_q30/datafusion:parquet 46542156 / 46854902 / -0.7% 65934837 / 68475483 / -3.7% 0.71 / 0.68 / +3.2%
tpcds_q31/datafusion:parquet 88238838 / 90567408 / -2.6% 109447301 / 110881398 / -1.3% 0.81 / 0.82 / -1.3%
tpcds_q32/datafusion:parquet 25533133 / 25630921 / -0.4% 43003758 / 43055427 / -0.1% 0.59 / 0.60 / -0.3%
tpcds_q33/datafusion:parquet 40673528 / 40186146 / +1.2% 56290575 / 53489770 / +5.2% 0.72 / 0.75 / -3.8%
tpcds_q34/datafusion:parquet 23471110 / 23609594 / -0.6% 39003673 / 39637281 / -1.6% 0.60 / 0.60 / +1.0%
tpcds_q35/datafusion:parquet 53527782 / 55199726 / -3.0% 73902785 / 72301050 / +2.2% 0.72 / 0.76 / -5.1%
tpcds_q36/datafusion:parquet 51505562 / 52901283 / -2.6% 74695334 / 75764103 / -1.4% 0.69 / 0.70 / -1.2%
tpcds_q37/datafusion:parquet 25907776 / 26020118 / -0.4% 42853036 / 42307760 / +1.3% 0.60 / 0.62 / -1.7%
tpcds_q38/datafusion:parquet 44465920 / 44501856 / -0.1% 63719187 / 66398127 / -4.0% 0.70 / 0.67 / +4.1%
tpcds_q39/datafusion:parquet 70728768 / 71494912 / -1.1% 91125750 / 91405031 / -0.3% 0.78 / 0.78 / -0.8%
tpcds_q40/datafusion:parquet 28269514 / 28619632 / -1.2% 51099925 / 50584322 / +1.0% 0.55 / 0.57 / -2.2%
tpcds_q41/datafusion:parquet 19867518 / 20164463 / -1.5% 34754672 / 34036457 / +2.1% 0.57 / 0.59 / -3.5%
tpcds_q42/datafusion:parquet 18032450 / 17984296 / +0.3% 34691663 / 33225089 / +4.4% 0.52 / 0.54 / -4.0%
tpcds_q43/datafusion:parquet 19137874 / 19496703 / -1.8% 34790971 / 34611388 / +0.5% 0.55 / 0.56 / -2.3%
tpcds_q44/datafusion:parquet 34236124 / 33297390 / +2.8% 53727835 / 53585020 / +0.3% 0.64 / 0.62 / +2.5%
tpcds_q45/datafusion:parquet 37568471 / 38113870 / -1.4% 56603234 / 56593538 / +0.0% 0.66 / 0.67 / -1.4%
tpcds_q46/datafusion:parquet 29737445 / 29302150 / +1.5% 52958902 / 50014598 / +5.9% 0.56 / 0.59 / -4.2%
tpcds_q47/datafusion:parquet 97539656 / 97156830 / +0.4% 121635532 / 122978133 / -1.1% 0.80 / 0.79 / +1.5%
tpcds_q48/datafusion:parquet 40676700 / 41000735 / -0.8% 61771844 / 64948185 / -4.9% 0.66 / 0.63 / +4.3%
tpcds_q49/datafusion:parquet 72025078 / 71198921 / +1.2% 97248210 / 95001390 / +2.4% 0.74 / 0.75 / -1.2%
tpcds_q50/datafusion:parquet 47632175 / 47587125 / +0.1% 70255860 / 69397940 / +1.2% 0.68 / 0.69 / -1.1%
tpcds_q51/datafusion:parquet 70952067 / 71595534 / -0.9% 93882410 / 95082226 / -1.3% 0.76 / 0.75 / +0.4%
tpcds_q52/datafusion:parquet 18476856 / 18328348 / +0.8% 34252759 / 33446618 / +2.4% 0.54 / 0.55 / -1.6%
tpcds_q53/datafusion:parquet 23045090 / 23045740 / -0.0% 42294737 / 41550550 / +1.8% 0.54 / 0.55 / -1.8%
tpcds_q54/datafusion:parquet 53449190 / 54606058 / -2.1% 73955660 / 74513808 / -0.7% 0.72 / 0.73 / -1.4%
tpcds_q55/datafusion:parquet 18068054 / 18242842 / -1.0% 33970017 / 33605366 / +1.1% 0.53 / 0.54 / -2.0%
tpcds_q56/datafusion:parquet 45661074 / 45217319 / +1.0% 62520615 / 63757855 / -1.9% 0.73 / 0.71 / +3.0%
tpcds_q57/datafusion:parquet 99897670 / 101260688 / -1.3% 119614293 / 119120921 / +0.4% 0.84 / 0.85 / -1.8%
tpcds_q58/datafusion:parquet 63866830 / 64211676 / -0.5% 83120695 / 84713287 / -1.9% 0.77 / 0.76 / +1.4%
tpcds_q59/datafusion:parquet 45489578 / 47190814 / -3.6% 65219285 / 65170098 / +0.1% 0.70 / 0.72 / -3.7%
tpcds_q60/datafusion:parquet 44441004 / 46150632 / -3.7% 62967318 / 61917800 / +1.7% 0.71 / 0.75 / -5.3%
tpcds_q61/datafusion:parquet 37574682 / 37701527 / -0.3% 59095244 / 60173442 / -1.8% 0.64 / 0.63 / +1.5%
tpcds_q62/datafusion:parquet 25106010 / 25342907 / -0.9% 40629768 / 40234258 / +1.0% 0.62 / 0.63 / -1.9%
tpcds_q63/datafusion:parquet 21821300 / 22135066 / -1.4% 42300833 / 41406185 / +2.2% 0.52 / 0.53 / -3.5%
tpcds_q64/datafusion:parquet 206997590 / 200672502 / +3.2% 234511435 / 238434684 / -1.6% 0.88 / 0.84 / +4.9%
tpcds_q65/datafusion:parquet 36740256 / 36483377 / +0.7% 59688052 / 54383825 / +9.8% 0.62 / 0.67 / -8.2%
tpcds_q66/datafusion:parquet 61600220 / 62117599 / -0.8% 79011545 / 78421352 / +0.8% 0.78 / 0.79 / -1.6%
tpcds_q67/datafusion:parquet 69026349 / 68917182 / +0.2% 96412149 / 96569207 / -0.2% 0.72 / 0.71 / +0.3%
tpcds_q68/datafusion:parquet 28743900 / 28978609 / -0.8% 52400396 / 51328299 / +2.1% 0.55 / 0.56 / -2.8%
tpcds_q69/datafusion:parquet 50960323 / 49898886 / +2.1% 68308274 / 70323482 / -2.9% 0.75 / 0.71 / +5.1%
tpcds_q70/datafusion:parquet 36011508 / 36482276 / -1.3% 58246205 / 58458546 / -0.4% 0.62 / 0.62 / -0.9%
tpcds_q71/datafusion:parquet 26858134 / 28689195 / -6.4% 44496703 / 45926747 / -3.1% 0.60 / 0.62 / -3.4%
tpcds_q72/datafusion:parquet 557838288 / 553737150 / +0.7% 580166882 / 573073766 / +1.2% 0.96 / 0.97 / -0.5%
tpcds_q73/datafusion:parquet 22905015 / 22805680 / +0.4% 39052064 / 40324998 / -3.2% 0.59 / 0.57 / +3.7%
tpcds_q74/datafusion:parquet 67625613 / 70148106 / -3.6% 88166381 / 88884601 / -0.8% 0.77 / 0.79 / -2.8%
tpcds_q75/datafusion:parquet 145593432 / 143821436 / +1.2% 176273830 / 169855270 / +3.8% 0.83 / 0.85 / -2.5%
tpcds_q76/datafusion:parquet 53743984 / 52544263 / +2.3% 71987801 / 75477724 / -4.6% 0.75 / 0.70 / +7.2%
tpcds_q77/datafusion:parquet 55240216 / 55181910 / +0.1% 73006734 / 76710582 / -4.8% 0.76 / 0.72 / +5.2%
tpcds_q78/datafusion:parquet 90802958 / 91366297 / -0.6% 120647416 / 122432356 / -1.5% 0.75 / 0.75 / +0.9%
tpcds_q79/datafusion:parquet 25941450 / 25951690 / -0.0% 46350061 / 46504296 / -0.3% 0.56 / 0.56 / +0.3%
tpcds_q80/datafusion:parquet 78210186 / 78737704 / -0.7% 114473708 / 111330712 / +2.8% 0.68 / 0.71 / -3.4%
tpcds_q81/datafusion:parquet 42588246 / 42563128 / +0.1% 59079963 / 65431929 / -9.7% 0.72 / 0.65 / +10.8%
tpcds_q82/datafusion:parquet 26317013 / 26374769 / -0.2% 45234241 / 42439374 / +6.6% 0.58 / 0.62 / -6.4%
tpcds_q83/datafusion:parquet 57377567 / 57451456 / -0.1% 76827902 / 76882236 / -0.1% 0.75 / 0.75 / -0.1%
tpcds_q84/datafusion:parquet 30457568 / 30764009 / -1.0% 47326048 / 46750412 / +1.2% 0.64 / 0.66 / -2.2%
tpcds_q85/datafusion:parquet 81897988 / 82222736 / -0.4% 109360391 / 109456527 / -0.1% 0.75 / 0.75 / -0.3%
tpcds_q86/datafusion:parquet 20219089 / 20383262 / -0.8% 35291192 / 36981560 / -4.6% 0.57 / 0.55 / +3.9%
tpcds_q87/datafusion:parquet 44654187 / 45859258 / -2.6% 63880470 / 63104391 / +1.2% 0.70 / 0.73 / -3.8%
tpcds_q88/datafusion:parquet 47850360 / 48511674 / -1.4% 67223404 / 63457116 / +5.9% 0.71 / 0.76 / -6.9%
tpcds_q89/datafusion:parquet 25559153 / 25669168 / -0.4% 43873084 / 45581937 / -3.7% 0.58 / 0.56 / +3.4%
tpcds_q90/datafusion:parquet 19248430 / 19604007 / -1.8% 33547801 / 35153289 / -4.6% 0.57 / 0.56 / +2.9%
tpcds_q91/datafusion:parquet 36954282 / 36956944 / -0.0% 55964874 / 56241178 / -0.5% 0.66 / 0.66 / +0.5%
tpcds_q92/datafusion:parquet 26310378 / 26159846 / +0.6% 41936821 / 44165946 / -5.0% 0.63 / 0.59 / +5.9%
tpcds_q93/datafusion:parquet 26212630 / 25904538 / +1.2% 49992994 / 51218556 / -2.4% 0.52 / 0.51 / +3.7%
tpcds_q94/datafusion:parquet 34685442 / 34365680 / +0.9% 52439945 / 52351899 / +0.2% 0.66 / 0.66 / +0.8%
tpcds_q95/datafusion:parquet 65386142 / 64454278 / +1.4% 79613339 / 81451157 / -2.3% 0.82 / 0.79 / +3.8%
tpcds_q96/datafusion:parquet 16651593 / 16407040 / +1.5% 31324063 / 31200035 / +0.4% 0.53 / 0.53 / +1.1%
tpcds_q97/datafusion:parquet 35401941 / 35661313 / -0.7% 50740487 / 52809512 / -3.9% 0.70 / 0.68 / +3.3%
tpcds_q98/datafusion:parquet 24747296 / 25136228 / -1.5% 40028283 / 42064519 / -4.8% 0.62 / 0.60 / +3.5%
tpcds_q99/datafusion:parquet 30446556 / 30205996 / +0.8% 43429171 / 45114857 / -3.7% 0.70 / 0.67 / +4.7%
duckdb / vortex-file-compressed / ns (0.997x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15345163 / 15475686 / -0.8% 27519238 / 27241558 / +1.0% 0.56 / 0.57 / -1.8%
tpcds_q02/duckdb:vortex-file-compressed 15320882 / 15773784 / -2.9% 21356495 / 22218440 / -3.9% 0.72 / 0.71 / +1.0%
tpcds_q03/duckdb:vortex-file-compressed 14710224 / 14460216 / +1.7% 23156971 / 20400327 / +13.5% 🔴 0.64 / 0.71 / -10.4%
tpcds_q04/duckdb:vortex-file-compressed 50923597 / 51298740 / -0.7% 63569156 / 61593557 / +3.2% 0.80 / 0.83 / -3.8%
tpcds_q05/duckdb:vortex-file-compressed 19290200 / 19525454 / -1.2% 26429681 / 28566661 / -7.5% 0.73 / 0.68 / +6.8%
tpcds_q06/duckdb:vortex-file-compressed 27407278 / 27657598 / -0.9% 40855834 / 42065686 / -2.9% 0.67 / 0.66 / +2.0%
tpcds_q07/duckdb:vortex-file-compressed 15752281 / 16862201 / -6.6% 28590538 / 28257117 / +1.2% 0.55 / 0.60 / -7.7%
tpcds_q08/duckdb:vortex-file-compressed 23507388 / 23794682 / -1.2% 33270837 / 34063300 / -2.3% 0.71 / 0.70 / +1.1%
tpcds_q09/duckdb:vortex-file-compressed 10092773 / 10179184 / -0.8% 18272717 / 19597278 / -6.8% 0.55 / 0.52 / +6.3%
tpcds_q10/duckdb:vortex-file-compressed 31101132 / 30731092 / +1.2% 43585059 / 43905348 / -0.7% 0.71 / 0.70 / +1.9%
tpcds_q11/duckdb:vortex-file-compressed 41039274 / 40827396 / +0.5% 52618421 / 53463846 / -1.6% 0.78 / 0.76 / +2.1%
tpcds_q12/duckdb:vortex-file-compressed 10823286 / 10906565 / -0.8% 17665286 / 18008431 / -1.9% 0.61 / 0.61 / +1.2%
tpcds_q13/duckdb:vortex-file-compressed 22518974 / 22183268 / +1.5% 36125263 / 35783376 / +1.0% 0.62 / 0.62 / +0.6%
tpcds_q14/duckdb:vortex-file-compressed 57878000 / 59170370 / -2.2% 71728130 / 69790732 / +2.8% 0.81 / 0.85 / -4.8%
tpcds_q15/duckdb:vortex-file-compressed 22366318 / 22492943 / -0.6% 27963991 / 27979889 / -0.1% 0.80 / 0.80 / -0.5%
tpcds_q16/duckdb:vortex-file-compressed 19065085 / 18869543 / +1.0% 29060432 / 29058140 / +0.0% 0.66 / 0.65 / +1.0%
tpcds_q17/duckdb:vortex-file-compressed 31699728 / 32304167 / -1.9% 46778548 / 47036771 / -0.5% 0.68 / 0.69 / -1.3%
tpcds_q18/duckdb:vortex-file-compressed 29826128 / 29681824 / +0.5% 39140242 / 40510179 / -3.4% 0.76 / 0.73 / +4.0%
tpcds_q19/duckdb:vortex-file-compressed 24715009 / 25028756 / -1.3% 37080280 / 36220482 / +2.4% 0.67 / 0.69 / -3.5%
tpcds_q20/duckdb:vortex-file-compressed 10998839 / 11116114 / -1.1% 16924322 / 16769672 / +0.9% 0.65 / 0.66 / -2.0%
tpcds_q21/duckdb:vortex-file-compressed 10886392 / 10794578 / +0.9% 20596971 / 22639304 / -9.0% 0.53 / 0.48 / +10.9%
tpcds_q22/duckdb:vortex-file-compressed 29349632 / 31483413 / -6.8% 41826462 / 44044465 / -5.0% 0.70 / 0.71 / -1.8%
tpcds_q23/duckdb:vortex-file-compressed 34954186 / 37012175 / -5.6% 48962045 / 49315043 / -0.7% 0.71 / 0.75 / -4.9%
tpcds_q24/duckdb:vortex-file-compressed 29976022 / 28764016 / +4.2% 41824131 / 41876185 / -0.1% 0.72 / 0.69 / +4.3%
tpcds_q25/duckdb:vortex-file-compressed 27229318 / 27202795 / +0.1% 40693295 / 40423902 / +0.7% 0.67 / 0.67 / -0.6%
tpcds_q26/duckdb:vortex-file-compressed 14691260 / 16428410 / -10.6% 🟢 21278561 / 21650553 / -1.7% 0.69 / 0.76 / -9.0%
tpcds_q27/duckdb:vortex-file-compressed 16819780 / 17252022 / -2.5% 31298619 / 29498803 / +6.1% 0.54 / 0.58 / -8.1%
tpcds_q28/duckdb:vortex-file-compressed 7806241 / 8142668 / -4.1% 12088437 / 12434629 / -2.8% 0.65 / 0.65 / -1.4%
tpcds_q29/duckdb:vortex-file-compressed 30313822 / 30765046 / -1.5% 46535388 / 46206981 / +0.7% 0.65 / 0.67 / -2.2%
tpcds_q30/duckdb:vortex-file-compressed 20044108 / 20288030 / -1.2% 32150015 / 32848718 / -2.1% 0.62 / 0.62 / +0.9%
tpcds_q31/duckdb:vortex-file-compressed 20869495 / 20046203 / +4.1% 29692117 / 30114501 / -1.4% 0.70 / 0.67 / +5.6%
tpcds_q32/duckdb:vortex-file-compressed 11212323 / 11170148 / +0.4% 20366763 / 18921670 / +7.6% 0.55 / 0.59 / -6.7%
tpcds_q33/duckdb:vortex-file-compressed 17730362 / 17926550 / -1.1% 32011933 / 28941630 / +10.6% 🔴 0.55 / 0.62 / -10.6%
tpcds_q34/duckdb:vortex-file-compressed 13390306 / 13837064 / -3.2% 20906946 / 20994100 / -0.4% 0.64 / 0.66 / -2.8%
tpcds_q35/duckdb:vortex-file-compressed 49086800 / 49266188 / -0.4% 62538152 / 62535276 / +0.0% 0.78 / 0.79 / -0.4%
tpcds_q36/duckdb:vortex-file-compressed 15265796 / 14959220 / +2.0% 32286364 / 28155230 / +14.7% 🔴 0.47 / 0.53 / -11.0%
tpcds_q37/duckdb:vortex-file-compressed 14070482 / 14093651 / -0.2% 22242426 / 22297449 / -0.2% 0.63 / 0.63 / +0.1%
tpcds_q38/duckdb:vortex-file-compressed 22408305 / 22576764 / -0.7% 28489500 / 29141873 / -2.2% 0.79 / 0.77 / +1.5%
tpcds_q39/duckdb:vortex-file-compressed 18622085 / 18889874 / -1.4% 27500225 / 30858647 / -10.9% 🟢 0.68 / 0.61 / +10.6%
tpcds_q40/duckdb:vortex-file-compressed 14334688 / 13729878 / +4.4% 19391841 / 20086282 / -3.5% 0.74 / 0.68 / +8.1%
tpcds_q41/duckdb:vortex-file-compressed 6631820 / 6515988 / +1.8% 11016747 / 9779939 / +12.6% 🔴 0.60 / 0.67 / -9.6%
tpcds_q42/duckdb:vortex-file-compressed 8811190 / 8528800 / +3.3% 18987252 / 18647717 / +1.8% 0.46 / 0.46 / +1.5%
tpcds_q43/duckdb:vortex-file-compressed 10128191 / 10175872 / -0.5% 21766517 / 19595376 / +11.1% 🔴 0.47 / 0.52 / -10.4%
tpcds_q44/duckdb:vortex-file-compressed 13888502 / 14104298 / -1.5% 24366842 / 24497472 / -0.5% 0.57 / 0.58 / -1.0%
tpcds_q45/duckdb:vortex-file-compressed 23794963 / 24277007 / -2.0% 30192091 / 30556168 / -1.2% 0.79 / 0.79 / -0.8%
tpcds_q46/duckdb:vortex-file-compressed 17466416 / 17031058 / +2.6% 28767533 / 30915580 / -6.9% 0.61 / 0.55 / +10.2%
tpcds_q47/duckdb:vortex-file-compressed 30551692 / 30869000 / -1.0% 40835577 / 42997549 / -5.0% 0.75 / 0.72 / +4.2%
tpcds_q48/duckdb:vortex-file-compressed 21980914 / 21031603 / +4.5% 32135562 / 31999299 / +0.4% 0.68 / 0.66 / +4.1%
tpcds_q49/duckdb:vortex-file-compressed 18278734 / 18057570 / +1.2% 32225755 / 32152026 / +0.2% 0.57 / 0.56 / +1.0%
tpcds_q50/duckdb:vortex-file-compressed 17028500 / 17513744 / -2.8% 29641778 / 29890306 / -0.8% 0.57 / 0.59 / -2.0%
tpcds_q51/duckdb:vortex-file-compressed 52276072 / 52429646 / -0.3% 64384214 / 90540436 / -28.9% 🟢 0.81 / 0.58 / +40.2%
tpcds_q52/duckdb:vortex-file-compressed 8742722 / 8991262 / -2.8% 20531980 / 23538388 / -12.8% 🟢 0.43 / 0.38 / +11.5%
tpcds_q53/duckdb:vortex-file-compressed 14454905 / 14509638 / -0.4% 24429821 / 25192055 / -3.0% 0.59 / 0.58 / +2.7%
tpcds_q54/duckdb:vortex-file-compressed 21116636 / 21084340 / +0.2% 30021666 / 32604163 / -7.9% 0.70 / 0.65 / +8.8%
tpcds_q55/duckdb:vortex-file-compressed 8407472 / 8925458 / -5.8% 21020749 / 18918115 / +11.1% 🔴 0.40 / 0.47 / -15.2%
tpcds_q56/duckdb:vortex-file-compressed 17453347 / 17546396 / -0.5% 32477267 / 29725909 / +9.3% 0.54 / 0.59 / -9.0%
tpcds_q57/duckdb:vortex-file-compressed 24914540 / 24871564 / +0.2% 32393935 / 33819937 / -4.2% 0.77 / 0.74 / +4.6%
tpcds_q58/duckdb:vortex-file-compressed 18530677 / 18371994 / +0.9% 27409839 / 29213672 / -6.2% 0.68 / 0.63 / +7.5%
tpcds_q59/duckdb:vortex-file-compressed 18415038 / 18763894 / -1.9% 26623042 / 26736637 / -0.4% 0.69 / 0.70 / -1.4%
tpcds_q60/duckdb:vortex-file-compressed 18381514 / 17763734 / +3.5% 29823341 / 33619988 / -11.3% 🟢 0.62 / 0.53 / +16.7%
tpcds_q61/duckdb:vortex-file-compressed 21048859 / 21033728 / +0.1% 33270994 / 33817003 / -1.6% 0.63 / 0.62 / +1.7%
tpcds_q62/duckdb:vortex-file-compressed 10504614 / 10778524 / -2.5% 16838040 / 19890827 / -15.3% 🟢 0.62 / 0.54 / +15.1%
tpcds_q63/duckdb:vortex-file-compressed 13647475 / 13484652 / +1.2% 22975114 / 24845915 / -7.5% 0.59 / 0.54 / +9.4%
tpcds_q64/duckdb:vortex-file-compressed 63552946 / 64126260 / -0.9% 82801787 / 79192180 / +4.6% 0.77 / 0.81 / -5.2%
tpcds_q65/duckdb:vortex-file-compressed 13513214 / 13388240 / +0.9% 22416767 / 22429286 / -0.1% 0.60 / 0.60 / +1.0%
tpcds_q66/duckdb:vortex-file-compressed 23880871 / 23631422 / +1.1% 38716588 / 31337453 / +23.5% 🔴 0.62 / 0.75 / -18.2%
tpcds_q67/duckdb:vortex-file-compressed 64994386 / 65409496 / -0.6% 84235659 / 85467983 / -1.4% 0.77 / 0.77 / +0.8%
tpcds_q68/duckdb:vortex-file-compressed 16542530 / 16990156 / -2.6% 33877230 / 35201524 / -3.8% 0.49 / 0.48 / +1.2%
tpcds_q69/duckdb:vortex-file-compressed 31947872 / 32410488 / -1.4% 44480390 / 44740100 / -0.6% 0.72 / 0.72 / -0.9%
tpcds_q70/duckdb:vortex-file-compressed 19432705 / 20357391 / -4.5% 30459353 / 32053870 / -5.0% 0.64 / 0.64 / +0.5%
tpcds_q71/duckdb:vortex-file-compressed 13740194 / 13313046 / +3.2% 25637103 / 26370456 / -2.8% 0.54 / 0.50 / +6.2%
tpcds_q72/duckdb:vortex-file-compressed 63942295 / 63857720 / +0.1% 80056153 / 82303015 / -2.7% 0.80 / 0.78 / +2.9%
tpcds_q73/duckdb:vortex-file-compressed 13017922 / 13713760 / -5.1% 20415109 / 21103509 / -3.3% 0.64 / 0.65 / -1.9%
tpcds_q74/duckdb:vortex-file-compressed 28010578 / 28690480 / -2.4% 38996445 / 39212550 / -0.6% 0.72 / 0.73 / -1.8%
tpcds_q75/duckdb:vortex-file-compressed 29113640 / 28781715 / +1.2% 39731830 / 40401871 / -1.7% 0.73 / 0.71 / +2.9%
tpcds_q76/duckdb:vortex-file-compressed 13192682 / 13046850 / +1.1% 25857438 / 27174252 / -4.8% 0.51 / 0.48 / +6.3%
tpcds_q77/duckdb:vortex-file-compressed 16134794 / 16929074 / -4.7% 25284143 / 29413786 / -14.0% 🟢 0.64 / 0.58 / +10.9%
tpcds_q78/duckdb:vortex-file-compressed 38059521 / 38163776 / -0.3% 53752060 / 49891214 / +7.7% 0.71 / 0.76 / -7.4%
tpcds_q79/duckdb:vortex-file-compressed 14752585 / 14561142 / +1.3% 25443012 / 25250653 / +0.8% 0.58 / 0.58 / +0.5%
tpcds_q80/duckdb:vortex-file-compressed 28121985 / 28252756 / -0.5% 44410886 / 45325770 / -2.0% 0.63 / 0.62 / +1.6%
tpcds_q81/duckdb:vortex-file-compressed 23374410 / 23364051 / +0.0% 34218715 / 31403835 / +9.0% 0.68 / 0.74 / -8.2%
tpcds_q82/duckdb:vortex-file-compressed 32531506 / 32234972 / +0.9% 39983553 / 42198573 / -5.2% 0.81 / 0.76 / +6.5%
tpcds_q83/duckdb:vortex-file-compressed 21038628 / 22015370 / -4.4% 25551389 / 26387518 / -3.2% 0.82 / 0.83 / -1.3%
tpcds_q84/duckdb:vortex-file-compressed 19005276 / 13752236 / +38.2% 🔴 23280667 / 20869987 / +11.6% 🔴 0.82 / 0.66 / +23.9%
tpcds_q85/duckdb:vortex-file-compressed 32909953 / 33380353 / -1.4% 42540243 / 43236588 / -1.6% 0.77 / 0.77 / +0.2%
tpcds_q86/duckdb:vortex-file-compressed 10997704 / 12526770 / -12.2% 🟢 21271689 / 18390401 / +15.7% 🔴 0.52 / 0.68 / -24.1%
tpcds_q87/duckdb:vortex-file-compressed 24002978 / 24080628 / -0.3% 31910766 / 30876277 / +3.4% 0.75 / 0.78 / -3.6%
tpcds_q88/duckdb:vortex-file-compressed 36425039 / 36934838 / -1.4% 48850746 / 53329823 / -8.4% 0.75 / 0.69 / +7.7%
tpcds_q89/duckdb:vortex-file-compressed 13970511 / 13880562 / +0.6% 26269027 / 23362882 / +12.4% 🔴 0.53 / 0.59 / -10.5%
tpcds_q90/duckdb:vortex-file-compressed 8728328 / 8335870 / +4.7% 13466588 / 13676665 / -1.5% 0.65 / 0.61 / +6.3%
tpcds_q91/duckdb:vortex-file-compressed 17438013 / 17360874 / +0.4% 23930084 / 23960714 / -0.1% 0.73 / 0.72 / +0.6%
tpcds_q92/duckdb:vortex-file-compressed 14966688 / 14579873 / +2.7% 23632510 / 23118228 / +2.2% 0.63 / 0.63 / +0.4%
tpcds_q93/duckdb:vortex-file-compressed 16717633 / 16606854 / +0.7% 23778143 / 24782013 / -4.1% 0.70 / 0.67 / +4.9%
tpcds_q94/duckdb:vortex-file-compressed 17541750 / 17632218 / -0.5% 32755928 / 28827484 / +13.6% 🔴 0.54 / 0.61 / -12.4%
tpcds_q95/duckdb:vortex-file-compressed 71902372 / 72440544 / -0.7% 80294538 / 80451689 / -0.2% 0.90 / 0.90 / -0.5%
tpcds_q96/duckdb:vortex-file-compressed 8604362 / 8456214 / +1.8% 15590080 / 18729145 / -16.8% 🟢 0.55 / 0.45 / +22.2%
tpcds_q97/duckdb:vortex-file-compressed 23120520 / 23602034 / -2.0% 31369708 / 32519106 / -3.5% 0.74 / 0.73 / +1.5%
tpcds_q98/duckdb:vortex-file-compressed 14355805 / 13836952 / +3.7% 22908998 / 23372983 / -2.0% 0.63 / 0.59 / +5.9%
tpcds_q99/duckdb:vortex-file-compressed 14718543 / 14457250 / +1.8% 23060785 / 21009186 / +9.8% 0.64 / 0.69 / -7.2%
duckdb / vortex-compact / ns (1.026x ➖, 2↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16732172 / 16680862 / +0.3% 25173202 / 24543687 / +2.6% 0.66 / 0.68 / -2.2%
tpcds_q02/duckdb:vortex-compact 16056718 / 16557114 / -3.0% 21247682 / 23105464 / -8.0% 0.76 / 0.72 / +5.5%
tpcds_q03/duckdb:vortex-compact 22714131 / 22032740 / +3.1% 31848863 / 35663578 / -10.7% 🟢 0.71 / 0.62 / +15.4%
tpcds_q04/duckdb:vortex-compact 54042538 / 54383620 / -0.6% 66097268 / 68022734 / -2.8% 0.82 / 0.80 / +2.3%
tpcds_q05/duckdb:vortex-compact 23064716 / 24785349 / -6.9% 36912398 / 34594175 / +6.7% 0.62 / 0.72 / -12.8%
tpcds_q06/duckdb:vortex-compact 35200104 / 32793946 / +7.3% 45952691 / 47292304 / -2.8% 0.77 / 0.69 / +10.5%
tpcds_q07/duckdb:vortex-compact 29376188 / 28587816 / +2.8% 39770456 / 40927474 / -2.8% 0.74 / 0.70 / +5.7%
tpcds_q08/duckdb:vortex-compact 42757136 / 49448866 / -13.5% 🟢 51161186 / 57991491 / -11.8% 🟢 0.84 / 0.85 / -2.0%
tpcds_q09/duckdb:vortex-compact 12001058 / 12367744 / -3.0% 19267666 / 20673061 / -6.8% 0.62 / 0.60 / +4.1%
tpcds_q10/duckdb:vortex-compact 49024436 / 46688131 / +5.0% 62240436 / 57943599 / +7.4% 0.79 / 0.81 / -2.2%
tpcds_q11/duckdb:vortex-compact 46878288 / 46155210 / +1.6% 59001522 / 59660248 / -1.1% 0.79 / 0.77 / +2.7%
tpcds_q12/duckdb:vortex-compact 13587784 / 13896090 / -2.2% 19433004 / 19444278 / -0.1% 0.70 / 0.71 / -2.2%
tpcds_q13/duckdb:vortex-compact 39151938 / 36818666 / +6.3% 50702249 / 49957118 / +1.5% 0.77 / 0.74 / +4.8%
tpcds_q14/duckdb:vortex-compact 67199712 / 67757440 / -0.8% 80167594 / 81334412 / -1.4% 0.84 / 0.83 / +0.6%
tpcds_q15/duckdb:vortex-compact 26755006 / 26792110 / -0.1% 31315821 / 31629951 / -1.0% 0.85 / 0.85 / +0.9%
tpcds_q16/duckdb:vortex-compact 26651540 / 25421991 / +4.8% 37731855 / 34403934 / +9.7% 0.71 / 0.74 / -4.4%
tpcds_q17/duckdb:vortex-compact 48069888 / 45775280 / +5.0% 61739002 / 58814881 / +5.0% 0.78 / 0.78 / +0.0%
tpcds_q18/duckdb:vortex-compact 37266702 / 36914992 / +1.0% 45745526 / 45311234 / +1.0% 0.81 / 0.81 / -0.0%
tpcds_q19/duckdb:vortex-compact 39390994 / 36830728 / +7.0% 50488600 / 44561767 / +13.3% 🔴 0.78 / 0.83 / -5.6%
tpcds_q20/duckdb:vortex-compact 14297366 / 14359091 / -0.4% 19317347 / 19605781 / -1.5% 0.74 / 0.73 / +1.1%
tpcds_q21/duckdb:vortex-compact 12281758 / 14369562 / -14.5% 🟢 20844207 / 20122085 / +3.6% 0.59 / 0.71 / -17.5%
tpcds_q22/duckdb:vortex-compact 30690160 / 30376276 / +1.0% 41459234 / 42211080 / -1.8% 0.74 / 0.72 / +2.9%
tpcds_q23/duckdb:vortex-compact 44942538 / 43042832 / +4.4% 54117207 / 53668545 / +0.8% 0.83 / 0.80 / +3.5%
tpcds_q24/duckdb:vortex-compact 41450608 / 40562701 / +2.2% 50935759 / 49556841 / +2.8% 0.81 / 0.82 / -0.6%
tpcds_q25/duckdb:vortex-compact 44304147 / 44059318 / +0.6% 57015499 / 54669259 / +4.3% 0.78 / 0.81 / -3.6%
tpcds_q26/duckdb:vortex-compact 25585723 / 25598436 / -0.0% 31355970 / 31200174 / +0.5% 0.82 / 0.82 / -0.5%
tpcds_q27/duckdb:vortex-compact 34386714 / 33275808 / +3.3% 45370197 / 41955911 / +8.1% 0.76 / 0.79 / -4.4%
tpcds_q28/duckdb:vortex-compact 11218094 / 10884540 / +3.1% 16099015 / 17768563 / -9.4% 0.70 / 0.61 / +13.8%
tpcds_q29/duckdb:vortex-compact 47943062 / 45380014 / +5.6% 61205537 / 59475169 / +2.9% 0.78 / 0.76 / +2.7%
tpcds_q30/duckdb:vortex-compact 22766906 / 23812081 / -4.4% 31179785 / 31324717 / -0.5% 0.73 / 0.76 / -3.9%
tpcds_q31/duckdb:vortex-compact 25607458 / 24222346 / +5.7% 32436551 / 31392984 / +3.3% 0.79 / 0.77 / +2.3%
tpcds_q32/duckdb:vortex-compact 14305750 / 14615383 / -2.1% 20587474 / 22549267 / -8.7% 0.69 / 0.65 / +7.2%
tpcds_q33/duckdb:vortex-compact 25361975 / 23506860 / +7.9% 37114190 / 34920588 / +6.3% 0.68 / 0.67 / +1.5%
tpcds_q34/duckdb:vortex-compact 24925966 / 22501654 / +10.8% 🔴 31383067 / 30691161 / +2.3% 0.79 / 0.73 / +8.3%
tpcds_q35/duckdb:vortex-compact 65859642 / 62992006 / +4.6% 77776985 / 74834912 / +3.9% 0.85 / 0.84 / +0.6%
tpcds_q36/duckdb:vortex-compact 23680688 / 22185954 / +6.7% 36673374 / 36561419 / +0.3% 0.65 / 0.61 / +6.4%
tpcds_q37/duckdb:vortex-compact 15357574 / 15541638 / -1.2% 24133074 / 23919342 / +0.9% 0.64 / 0.65 / -2.1%
tpcds_q38/duckdb:vortex-compact 28136800 / 26993914 / +4.2% 33733432 / 33559826 / +0.5% 0.83 / 0.80 / +3.7%
tpcds_q39/duckdb:vortex-compact 20905402 / 20384387 / +2.6% 30142215 / 29244496 / +3.1% 0.69 / 0.70 / -0.5%
tpcds_q40/duckdb:vortex-compact 15791442 / 16481888 / -4.2% 20978866 / 21861209 / -4.0% 0.75 / 0.75 / -0.2%
tpcds_q41/duckdb:vortex-compact 7587548 / 7684812 / -1.3% 12336162 / 12477806 / -1.1% 0.62 / 0.62 / -0.1%
tpcds_q42/duckdb:vortex-compact 12450280 / 11880614 / +4.8% 23408339 / 21666062 / +8.0% 0.53 / 0.55 / -3.0%
tpcds_q43/duckdb:vortex-compact 18324183 / 16719464 / +9.6% 24746960 / 23969351 / +3.2% 0.74 / 0.70 / +6.2%
tpcds_q44/duckdb:vortex-compact 20329420 / 19094802 / +6.5% 30724314 / 33724250 / -8.9% 0.66 / 0.57 / +16.9%
tpcds_q45/duckdb:vortex-compact 28161387 / 27520061 / +2.3% 33389374 / 32847874 / +1.6% 0.84 / 0.84 / +0.7%
tpcds_q46/duckdb:vortex-compact 32658574 / 29732680 / +9.8% 42795383 / 41584831 / +2.9% 0.76 / 0.71 / +6.7%
tpcds_q47/duckdb:vortex-compact 37610156 / 36886588 / +2.0% 46762287 / 48222673 / -3.0% 0.80 / 0.76 / +5.1%
tpcds_q48/duckdb:vortex-compact 36329010 / 35302080 / +2.9% 53945156 / 53726367 / +0.4% 0.67 / 0.66 / +2.5%
tpcds_q49/duckdb:vortex-compact 25650592 / 24518492 / +4.6% 38645476 / 37360998 / +3.4% 0.66 / 0.66 / +1.1%
tpcds_q50/duckdb:vortex-compact 31123764 / 28068480 / +10.9% 🔴 39575061 / 36642033 / +8.0% 0.79 / 0.77 / +2.7%
tpcds_q51/duckdb:vortex-compact 53784852 / 53357597 / +0.8% 62957804 / 65012883 / -3.2% 0.85 / 0.82 / +4.1%
tpcds_q52/duckdb:vortex-compact 12690848 / 11952086 / +6.2% 22310931 / 22019039 / +1.3% 0.57 / 0.54 / +4.8%
tpcds_q53/duckdb:vortex-compact 24311671 / 22368873 / +8.7% 33269142 / 30265111 / +9.9% 0.73 / 0.74 / -1.1%
tpcds_q54/duckdb:vortex-compact 27046477 / 26355038 / +2.6% 35879056 / 36405927 / -1.4% 0.75 / 0.72 / +4.1%
tpcds_q55/duckdb:vortex-compact 12629581 / 12193555 / +3.6% 22990083 / 22240912 / +3.4% 0.55 / 0.55 / +0.2%
tpcds_q56/duckdb:vortex-compact 25563030 / 23751874 / +7.6% 37877707 / 34270522 / +10.5% 🔴 0.67 / 0.69 / -2.6%
tpcds_q57/duckdb:vortex-compact 28884447 / 28013773 / +3.1% 33692650 / 34742490 / -3.0% 0.86 / 0.81 / +6.3%
tpcds_q58/duckdb:vortex-compact 22705701 / 22711871 / -0.0% 34984996 / 33089736 / +5.7% 0.65 / 0.69 / -5.4%
tpcds_q59/duckdb:vortex-compact 23772439 / 24193314 / -1.7% 29868498 / 30252044 / -1.3% 0.80 / 0.80 / -0.5%
tpcds_q60/duckdb:vortex-compact 26279582 / 25891802 / +1.5% 38381700 / 38016453 / +1.0% 0.68 / 0.68 / +0.5%
tpcds_q61/duckdb:vortex-compact 35505030 / 33947811 / +4.6% 48645707 / 49365992 / -1.5% 0.73 / 0.69 / +6.1%
tpcds_q62/duckdb:vortex-compact 11764014 / 11826534 / -0.5% 19680626 / 17308593 / +13.7% 🔴 0.60 / 0.68 / -12.5%
tpcds_q63/duckdb:vortex-compact 23760650 / 20905590 / +13.7% 🔴 30833381 / 29352000 / +5.0% 0.77 / 0.71 / +8.2%
tpcds_q64/duckdb:vortex-compact 90105748 / 87040626 / +3.5% 120077832 / 99892300 / +20.2% 🔴 0.75 / 0.87 / -13.9%
tpcds_q65/duckdb:vortex-compact 20027374 / 18457308 / +8.5% 26558028 / 27045910 / -1.8% 0.75 / 0.68 / +10.5%
tpcds_q66/duckdb:vortex-compact 26569788 / 25733967 / +3.2% 35743888 / 37725193 / -5.3% 0.74 / 0.68 / +9.0%
tpcds_q67/duckdb:vortex-compact 73817542 / 72272704 / +2.1% 89264606 / 86911912 / +2.7% 0.83 / 0.83 / -0.6%
tpcds_q68/duckdb:vortex-compact 32298166 / 29636324 / +9.0% 41213160 / 42762503 / -3.6% 0.78 / 0.69 / +13.1%
tpcds_q69/duckdb:vortex-compact 50041362 / 47607556 / +5.1% 60538348 / 59130165 / +2.4% 0.83 / 0.81 / +2.7%
tpcds_q70/duckdb:vortex-compact 34907992 / 31643486 / +10.3% 🔴 51384975 / 44759999 / +14.8% 🔴 0.68 / 0.71 / -3.9%
tpcds_q71/duckdb:vortex-compact 21560935 / 19668274 / +9.6% 31036623 / 29112265 / +6.6% 0.69 / 0.68 / +2.8%
tpcds_q72/duckdb:vortex-compact 70882818 / 70686245 / +0.3% 107942662 / 86827431 / +24.3% 🔴 0.66 / 0.81 / -19.3%
tpcds_q73/duckdb:vortex-compact 24283863 / 21959919 / +10.6% 🔴 31746631 / 32603887 / -2.6% 0.76 / 0.67 / +13.6%
tpcds_q74/duckdb:vortex-compact 33807270 / 32155742 / +5.1% 42780671 / 41533672 / +3.0% 0.79 / 0.77 / +2.1%
tpcds_q75/duckdb:vortex-compact 33806673 / 33200307 / +1.8% 45034322 / 49304980 / -8.7% 0.75 / 0.67 / +11.5%
tpcds_q76/duckdb:vortex-compact 17721402 / 16213736 / +9.3% 26320892 / 27258942 / -3.4% 0.67 / 0.59 / +13.2%
tpcds_q77/duckdb:vortex-compact 25234625 / 23042564 / +9.5% 32382211 / 31188273 / +3.8% 0.78 / 0.74 / +5.5%
tpcds_q78/duckdb:vortex-compact 42096655 / 42854728 / -1.8% 51966524 / 54189182 / -4.1% 0.81 / 0.79 / +2.4%
tpcds_q79/duckdb:vortex-compact 39418098 / 38549928 / +2.3% 46591509 / 46802830 / -0.5% 0.85 / 0.82 / +2.7%
tpcds_q80/duckdb:vortex-compact 38501424 / 37362226 / +3.0% 51987140 / 52877890 / -1.7% 0.74 / 0.71 / +4.8%
tpcds_q81/duckdb:vortex-compact 24545967 / 24522690 / +0.1% 33921849 / 34894370 / -2.8% 0.72 / 0.70 / +3.0%
tpcds_q82/duckdb:vortex-compact 36161538 / 37543096 / -3.7% 44634574 / 42718578 / +4.5% 0.81 / 0.88 / -7.8%
tpcds_q83/duckdb:vortex-compact 28493052 / 28660690 / -0.6% 32145827 / 33535487 / -4.1% 0.89 / 0.85 / +3.7%
tpcds_q84/duckdb:vortex-compact 15056498 / 14959110 / +0.7% 22342421 / 27684757 / -19.3% 🟢 0.67 / 0.54 / +24.7%
tpcds_q85/duckdb:vortex-compact 42554674 / 42250846 / +0.7% 51691386 / 51874920 / -0.4% 0.82 / 0.81 / +1.1%
tpcds_q86/duckdb:vortex-compact 12177284 / 13477014 / -9.6% 18190857 / 20847602 / -12.7% 🟢 0.67 / 0.65 / +3.6%
tpcds_q87/duckdb:vortex-compact 30849384 / 28659317 / +7.6% 36374234 / 35395951 / +2.8% 0.85 / 0.81 / +4.7%
tpcds_q88/duckdb:vortex-compact 70693124 / 68315190 / +3.5% 79744285 / 83765649 / -4.8% 0.89 / 0.82 / +8.7%
tpcds_q89/duckdb:vortex-compact 24285511 / 22831354 / +6.4% 33671681 / 32673469 / +3.1% 0.72 / 0.70 / +3.2%
tpcds_q90/duckdb:vortex-compact 12932168 / 11832737 / +9.3% 17847500 / 17895050 / -0.3% 0.72 / 0.66 / +9.6%
tpcds_q91/duckdb:vortex-compact 33408812 / 33399521 / +0.0% 40296092 / 40682082 / -0.9% 0.83 / 0.82 / +1.0%
tpcds_q92/duckdb:vortex-compact 20739438 / 21053496 / -1.5% 27564621 / 27994117 / -1.5% 0.75 / 0.75 / +0.0%
tpcds_q93/duckdb:vortex-compact 19001069 / 18362040 / +3.5% 26361943 / 26701094 / -1.3% 0.72 / 0.69 / +4.8%
tpcds_q94/duckdb:vortex-compact 23237052 / 22452372 / +3.5% 31296463 / 34286396 / -8.7% 0.74 / 0.65 / +13.4%
tpcds_q95/duckdb:vortex-compact 79375061 / 78005674 / +1.8% 86582119 / 86559006 / +0.0% 0.92 / 0.90 / +1.7%
tpcds_q96/duckdb:vortex-compact 18057014 / 18371736 / -1.7% 25057240 / 24486556 / +2.3% 0.72 / 0.75 / -4.0%
tpcds_q97/duckdb:vortex-compact 25309422 / 25710728 / -1.6% 33433330 / 33469219 / -0.1% 0.76 / 0.77 / -1.5%
tpcds_q98/duckdb:vortex-compact 19367888 / 18503641 / +4.7% 28544868 / 28358489 / +0.7% 0.68 / 0.65 / +4.0%
tpcds_q99/duckdb:vortex-compact 17659798 / 17338592 / +1.9% 23342390 / 24693319 / -5.5% 0.76 / 0.70 / +7.7%
duckdb / parquet / ns (0.983x ➖, 7↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23423336 / 26086549 / -10.2% 🟢 34265292 / 31488962 / +8.8% 0.68 / 0.83 / -17.5%
tpcds_q02/duckdb:parquet 15185732 / 18422276 / -17.6% 🟢 19492709 / 20565941 / -5.2% 0.78 / 0.90 / -13.0%
tpcds_q03/duckdb:parquet 8838226 / 8824058 / +0.2% 15202471 / 15249933 / -0.3% 0.58 / 0.58 / +0.5%
tpcds_q04/duckdb:parquet 127907435 / 128875281 / -0.8% 132803512 / 132639831 / +0.1% 0.96 / 0.97 / -0.9%
tpcds_q05/duckdb:parquet 21142879 / 21584331 / -2.0% 30496004 / 26076454 / +16.9% 🔴 0.69 / 0.83 / -16.2%
tpcds_q06/duckdb:parquet 29667786 / 26370620 / +12.5% 🔴 40143035 / 38332562 / +4.7% 0.74 / 0.69 / +7.4%
tpcds_q07/duckdb:parquet 15144952 / 15436742 / -1.9% 26943349 / 26124116 / +3.1% 0.56 / 0.59 / -4.9%
tpcds_q08/duckdb:parquet 28583969 / 25744937 / +11.0% 🔴 35799137 / 32981412 / +8.5% 0.80 / 0.78 / +2.3%
tpcds_q09/duckdb:parquet 18649130 / 18498186 / +0.8% 24469807 / 22910776 / +6.8% 0.76 / 0.81 / -5.6%
tpcds_q10/duckdb:parquet 27569974 / 27916485 / -1.2% 39961001 / 41065662 / -2.7% 0.69 / 0.68 / +1.5%
tpcds_q11/duckdb:parquet 71306782 / 71716660 / -0.6% 76268074 / 77177951 / -1.2% 0.93 / 0.93 / +0.6%
tpcds_q12/duckdb:parquet 12773652 / 12615334 / +1.3% 17108386 / 17594683 / -2.8% 0.75 / 0.72 / +4.1%
tpcds_q13/duckdb:parquet 23766942 / 23982902 / -0.9% 31846006 / 31403990 / +1.4% 0.75 / 0.76 / -2.3%
tpcds_q14/duckdb:parquet 60763938 / 61479190 / -1.2% 67360373 / 68810935 / -2.1% 0.90 / 0.89 / +1.0%
tpcds_q15/duckdb:parquet 25068831 / 25014872 / +0.2% 30423634 / 30677506 / -0.8% 0.82 / 0.82 / +1.1%
tpcds_q16/duckdb:parquet 19798346 / 20062354 / -1.3% 28241581 / 28786301 / -1.9% 0.70 / 0.70 / +0.6%
tpcds_q17/duckdb:parquet 32146256 / 32589594 / -1.4% 40767593 / 41397440 / -1.5% 0.79 / 0.79 / +0.2%
tpcds_q18/duckdb:parquet 38812270 / 39468561 / -1.7% 54660471 / 50173834 / +8.9% 0.71 / 0.79 / -9.7%
tpcds_q19/duckdb:parquet 24245833 / 27396553 / -11.5% 🟢 32112247 / 34929070 / -8.1% 0.76 / 0.78 / -3.7%
tpcds_q20/duckdb:parquet 13283445 / 13811515 / -3.8% 17831059 / 18269820 / -2.4% 0.74 / 0.76 / -1.5%
tpcds_q21/duckdb:parquet 9395786 / 9662859 / -2.8% 13356185 / 16813178 / -20.6% 🟢 0.70 / 0.57 / +22.4%
tpcds_q22/duckdb:parquet 36974070 / 35395714 / +4.5% 42124642 / 40864060 / +3.1% 0.88 / 0.87 / +1.3%
tpcds_q23/duckdb:parquet 40667510 / 40699312 / -0.1% 47878040 / 53794895 / -11.0% 🟢 0.85 / 0.76 / +12.3%
tpcds_q24/duckdb:parquet 33358020 / 36758159 / -9.3% 43903132 / 46420448 / -5.4% 0.76 / 0.79 / -4.0%
tpcds_q25/duckdb:parquet 29925594 / 30289173 / -1.2% 39878390 / 41232049 / -3.3% 0.75 / 0.73 / +2.2%
tpcds_q26/duckdb:parquet 31163084 / 31230552 / -0.2% 38298677 / 38581331 / -0.7% 0.81 / 0.81 / +0.5%
tpcds_q27/duckdb:parquet 32892992 / 32239532 / +2.0% 41275464 / 41809427 / -1.3% 0.80 / 0.77 / +3.3%
tpcds_q28/duckdb:parquet 17136550 / 17328412 / -1.1% 19871621 / 21721205 / -8.5% 0.86 / 0.80 / +8.1%
tpcds_q29/duckdb:parquet 30509548 / 30923118 / -1.3% 39906277 / 39788512 / +0.3% 0.76 / 0.78 / -1.6%
tpcds_q30/duckdb:parquet 32792906 / 32609802 / +0.6% 41772938 / 42344732 / -1.4% 0.79 / 0.77 / +1.9%
tpcds_q31/duckdb:parquet 20162126 / 20753334 / -2.8% 25178727 / 25997936 / -3.2% 0.80 / 0.80 / +0.3%
tpcds_q32/duckdb:parquet 11147374 / 11235305 / -0.8% 17140063 / 17418160 / -1.6% 0.65 / 0.65 / +0.8%
tpcds_q33/duckdb:parquet 15702619 / 15986914 / -1.8% 22663005 / 23317689 / -2.8% 0.69 / 0.69 / +1.1%
tpcds_q34/duckdb:parquet 16060964 / 16311110 / -1.5% 22452448 / 22278932 / +0.8% 0.72 / 0.73 / -2.3%
tpcds_q35/duckdb:parquet 47032016 / 47275184 / -0.5% 56134034 / 59252309 / -5.3% 0.84 / 0.80 / +5.0%
tpcds_q36/duckdb:parquet 15089762 / 15259769 / -1.1% 26435939 / 26076084 / +1.4% 0.57 / 0.59 / -2.5%
tpcds_q37/duckdb:parquet 11464520 / 11896144 / -3.6% 18255453 / 19024529 / -4.0% 0.63 / 0.63 / +0.4%
tpcds_q38/duckdb:parquet 26253986 / 26510919 / -1.0% 29883787 / 30344091 / -1.5% 0.88 / 0.87 / +0.6%
tpcds_q39/duckdb:parquet 24712570 / 24550942 / +0.7% 27689099 / 28586651 / -3.1% 0.89 / 0.86 / +3.9%
tpcds_q40/duckdb:parquet 15846262 / 15907338 / -0.4% 21078614 / 21278221 / -0.9% 0.75 / 0.75 / +0.6%
tpcds_q41/duckdb:parquet 7710964 / 9008902 / -14.4% 🟢 12774567 / 13789080 / -7.4% 0.60 / 0.65 / -7.6%
tpcds_q42/duckdb:parquet 8364232 / 8467146 / -1.2% 15175511 / 14844176 / +2.2% 0.55 / 0.57 / -3.4%
tpcds_q43/duckdb:parquet 10557799 / 10693692 / -1.3% 15359853 / 15848213 / -3.1% 0.69 / 0.67 / +1.9%
tpcds_q44/duckdb:parquet 16143549 / 16214974 / -0.4% 22067725 / 22528000 / -2.0% 0.73 / 0.72 / +1.6%
tpcds_q45/duckdb:parquet 23309104 / 23330030 / -0.1% 29451753 / 29813528 / -1.2% 0.79 / 0.78 / +1.1%
tpcds_q46/duckdb:parquet 35941530 / 36160312 / -0.6% 47902596 / 45508046 / +5.3% 0.75 / 0.79 / -5.6%
tpcds_q47/duckdb:parquet 31895608 / 31560550 / +1.1% 37942861 / 44383648 / -14.5% 🟢 0.84 / 0.71 / +18.2%
tpcds_q48/duckdb:parquet 21159362 / 21185234 / -0.1% 28757698 / 28940095 / -0.6% 0.74 / 0.73 / +0.5%
tpcds_q49/duckdb:parquet 18912315 / 19175618 / -1.4% 30749891 / 31770418 / -3.2% 0.62 / 0.60 / +1.9%
tpcds_q50/duckdb:parquet 17612114 / 17688256 / -0.4% 26529750 / 25575961 / +3.7% 0.66 / 0.69 / -4.0%
tpcds_q51/duckdb:parquet 53694294 / 55511779 / -3.3% 59930543 / 63747596 / -6.0% 0.90 / 0.87 / +2.9%
tpcds_q52/duckdb:parquet 8584490 / 8646397 / -0.7% 15069478 / 15113615 / -0.3% 0.57 / 0.57 / -0.4%
tpcds_q53/duckdb:parquet 11542664 / 11625529 / -0.7% 17008908 / 17209515 / -1.2% 0.68 / 0.68 / +0.5%
tpcds_q54/duckdb:parquet 20377475 / 20570423 / -0.9% 29609920 / 30449251 / -2.8% 0.69 / 0.68 / +1.9%
tpcds_q55/duckdb:parquet 8530087 / 8628068 / -1.1% 15105606 / 15345048 / -1.6% 0.56 / 0.56 / +0.4%
tpcds_q56/duckdb:parquet 16223000 / 16453030 / -1.4% 23184893 / 24525225 / -5.5% 0.70 / 0.67 / +4.3%
tpcds_q57/duckdb:parquet 28749717 / 30331738 / -5.2% 34441514 / 37868294 / -9.0% 0.83 / 0.80 / +4.2%
tpcds_q58/duckdb:parquet 18352658 / 18613792 / -1.4% 28149662 / 25861168 / +8.8% 0.65 / 0.72 / -9.4%
tpcds_q59/duckdb:parquet 20001503 / 20175728 / -0.9% 25264471 / 27686301 / -8.7% 0.79 / 0.73 / +8.6%
tpcds_q60/duckdb:parquet 16903720 / 17005809 / -0.6% 24616211 / 24622738 / -0.0% 0.69 / 0.69 / -0.6%
tpcds_q61/duckdb:parquet 21399442 / 21826070 / -2.0% 29618795 / 29812270 / -0.6% 0.72 / 0.73 / -1.3%
tpcds_q62/duckdb:parquet 10632778 / 10812406 / -1.7% 14493858 / 14869637 / -2.5% 0.73 / 0.73 / +0.9%
tpcds_q63/duckdb:parquet 10792106 / 11099155 / -2.8% 16449926 / 16946982 / -2.9% 0.66 / 0.65 / +0.2%
tpcds_q64/duckdb:parquet 53783498 / 52910638 / +1.6% 66259142 / 71847320 / -7.8% 0.81 / 0.74 / +10.2%
tpcds_q65/duckdb:parquet 14416974 / 16246062 / -11.3% 🟢 21196932 / 21639532 / -2.0% 0.68 / 0.75 / -9.4%
tpcds_q66/duckdb:parquet 24533216 / 24796846 / -1.1% 30867500 / 33075199 / -6.7% 0.79 / 0.75 / +6.0%
tpcds_q67/duckdb:parquet 76518210 / 77537234 / -1.3% 86724759 / 91270293 / -5.0% 0.88 / 0.85 / +3.9%
tpcds_q68/duckdb:parquet 29149892 / 29708812 / -1.9% 41448284 / 41253751 / +0.5% 0.70 / 0.72 / -2.3%
tpcds_q69/duckdb:parquet 28755630 / 29001706 / -0.8% 39506029 / 40622867 / -2.7% 0.73 / 0.71 / +2.0%
tpcds_q70/duckdb:parquet 15975733 / 16205581 / -1.4% 24388690 / 25051577 / -2.6% 0.66 / 0.65 / +1.3%
tpcds_q71/duckdb:parquet 14702455 / 14997454 / -2.0% 20363623 / 21133808 / -3.6% 0.72 / 0.71 / +1.7%
tpcds_q72/duckdb:parquet 83489402 / 81860027 / +2.0% 87605483 / 87242207 / +0.4% 0.95 / 0.94 / +1.6%
tpcds_q73/duckdb:parquet 13417372 / 13712738 / -2.2% 19180134 / 19550670 / -1.9% 0.70 / 0.70 / -0.3%
tpcds_q74/duckdb:parquet 100437433 / 101187948 / -0.7% 106547829 / 107491784 / -0.9% 0.94 / 0.94 / +0.1%
tpcds_q75/duckdb:parquet 39873192 / 40230990 / -0.9% 51135963 / 51748233 / -1.2% 0.78 / 0.78 / +0.3%
tpcds_q76/duckdb:parquet 13351962 / 13548526 / -1.5% 21005937 / 21414824 / -1.9% 0.64 / 0.63 / +0.5%
tpcds_q77/duckdb:parquet 17150526 / 17069922 / +0.5% 27630973 / 25677131 / +7.6% 0.62 / 0.66 / -6.6%
tpcds_q78/duckdb:parquet 47862680 / 48417702 / -1.1% 53914486 / 54292609 / -0.7% 0.89 / 0.89 / -0.5%
tpcds_q79/duckdb:parquet 20546926 / 20537328 / +0.0% 28441093 / 32265306 / -11.9% 🟢 0.72 / 0.64 / +13.5%
tpcds_q80/duckdb:parquet 31243534 / 31316240 / -0.2% 40665385 / 40783214 / -0.3% 0.77 / 0.77 / +0.1%
tpcds_q81/duckdb:parquet 29464280 / 29730454 / -0.9% 38443014 / 39866173 / -3.6% 0.77 / 0.75 / +2.8%
tpcds_q82/duckdb:parquet 12463022 / 13085042 / -4.8% 18447156 / 20417752 / -9.7% 0.68 / 0.64 / +5.4%
tpcds_q83/duckdb:parquet 15720192 / 15978906 / -1.6% 20738377 / 20716176 / +0.1% 0.76 / 0.77 / -1.7%
tpcds_q84/duckdb:parquet 17478596 / 17676272 / -1.1% 23260393 / 23976194 / -3.0% 0.75 / 0.74 / +1.9%
tpcds_q85/duckdb:parquet 34361036 / 36715953 / -6.4% 46027341 / 49002749 / -6.1% 0.75 / 0.75 / -0.4%
tpcds_q86/duckdb:parquet 10797606 / 11213308 / -3.7% 15673787 / 15837581 / -1.0% 0.69 / 0.71 / -2.7%
tpcds_q87/duckdb:parquet 28306632 / 28525946 / -0.8% 35303570 / 32389673 / +9.0% 0.80 / 0.88 / -9.0%
tpcds_q88/duckdb:parquet 27163938 / 27163299 / +0.0% 33704443 / 33990861 / -0.8% 0.81 / 0.80 / +0.9%
tpcds_q89/duckdb:parquet 12491756 / 12848241 / -2.8% 18741895 / 18961702 / -1.2% 0.67 / 0.68 / -1.6%
tpcds_q90/duckdb:parquet 6865728 / 8527346 / -19.5% 🟢 10911913 / 11120032 / -1.9% 0.63 / 0.77 / -18.0%
tpcds_q91/duckdb:parquet 20776190 / 20988590 / -1.0% 28583189 / 29125843 / -1.9% 0.73 / 0.72 / +0.9%
tpcds_q92/duckdb:parquet 13233290 / 11675098 / +13.3% 🔴 17901193 / 18338808 / -2.4% 0.74 / 0.64 / +16.1%
tpcds_q93/duckdb:parquet 21142254 / 21568442 / -2.0% 29600097 / 29780726 / -0.6% 0.71 / 0.72 / -1.4%
tpcds_q94/duckdb:parquet 15524452 / 17827406 / -12.9% 🟢 25393474 / 26103923 / -2.7% 0.61 / 0.68 / -10.5%
tpcds_q95/duckdb:parquet 90132008 / 90185078 / -0.1% 96539871 / 98292110 / -1.8% 0.93 / 0.92 / +1.8%
tpcds_q96/duckdb:parquet 6952284 / 6939136 / +0.2% 10630167 / 10893918 / -2.4% 0.65 / 0.64 / +2.7%
tpcds_q97/duckdb:parquet 26039129 / 26164807 / -0.5% 32041410 / 32350987 / -1.0% 0.81 / 0.81 / +0.5%
tpcds_q98/duckdb:parquet 14847888 / 15137248 / -1.9% 25573253 / 25429786 / +0.6% 0.58 / 0.60 / -2.5%
tpcds_q99/duckdb:parquet 17179881 / 17281479 / -0.6% 20860814 / 21302097 / -2.1% 0.82 / 0.81 / +1.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1239998 / 1233656 / +0.5% 22068227 / 23000622 / -4.1% 0.06 / 0.05 / +4.8%
clickbench_q01/datafusion:vortex-file-compressed 6580798 / 7184475 / -8.4% 32214645 / 37407941 / -13.9% 🟢 0.20 / 0.19 / +6.4%
clickbench_q02/datafusion:vortex-file-compressed 13253622 / 13086329 / +1.3% 45338477 / 40578007 / +11.7% 🔴 0.29 / 0.32 / -9.4%
clickbench_q03/datafusion:vortex-file-compressed 12915828 / 12270690 / +5.3% 58248364 / 54904242 / +6.1% 0.22 / 0.22 / -0.8%
clickbench_q04/datafusion:vortex-file-compressed 54378014 / 53716926 / +1.2% 93795655 / 87941897 / +6.7% 0.58 / 0.61 / -5.1%
clickbench_q05/datafusion:vortex-file-compressed 77478141 / 77038695 / +0.6% 117495741 / 116844425 / +0.6% 0.66 / 0.66 / +0.0%
clickbench_q06/datafusion:vortex-file-compressed 1208492 / 1221518 / -1.1% 22262020 / 22412412 / -0.7% 0.05 / 0.05 / -0.4%
clickbench_q07/datafusion:vortex-file-compressed 13322444 / 13522628 / -1.5% 38886730 / 40420827 / -3.8% 0.34 / 0.33 / +2.4%
clickbench_q08/datafusion:vortex-file-compressed 79363114 / 79459448 / -0.1% 122536393 / 120661527 / +1.6% 0.65 / 0.66 / -1.6%
clickbench_q09/datafusion:vortex-file-compressed 174511125 / 172427892 / +1.2% 212113008 / 203302631 / +4.3% 0.82 / 0.85 / -3.0%
clickbench_q10/datafusion:vortex-file-compressed 40336802 / 40982218 / -1.6% 74396995 / 75980413 / -2.1% 0.54 / 0.54 / +0.5%
clickbench_q11/datafusion:vortex-file-compressed 51970787 / 51619276 / +0.7% 81930562 / 83436329 / -1.8% 0.63 / 0.62 / +2.5%
clickbench_q12/datafusion:vortex-file-compressed 76591383 / 76721746 / -0.2% 125837298 / 120561027 / +4.4% 0.61 / 0.64 / -4.4%
clickbench_q13/datafusion:vortex-file-compressed 122334488 / 125468364 / -2.5% 178205638 / 186264554 / -4.3% 0.69 / 0.67 / +1.9%
clickbench_q14/datafusion:vortex-file-compressed 90898531 / 86322944 / +5.3% 129006567 / 131578311 / -2.0% 0.70 / 0.66 / +7.4%
clickbench_q15/datafusion:vortex-file-compressed 62187231 / 63446922 / -2.0% 97444119 / 94878603 / +2.7% 0.64 / 0.67 / -4.6%
clickbench_q16/datafusion:vortex-file-compressed 152980323 / 157263532 / -2.7% 216976922 / 205868639 / +5.4% 0.71 / 0.76 / -7.7%
clickbench_q17/datafusion:vortex-file-compressed 151886470 / 155693590 / -2.4% 208582757 / 207289801 / +0.6% 0.73 / 0.75 / -3.0%
clickbench_q18/datafusion:vortex-file-compressed 301731948 / 304101347 / -0.8% 371509029 / 382545023 / -2.9% 0.81 / 0.79 / +2.2%
clickbench_q19/datafusion:vortex-file-compressed 8438560 / 8519120 / -0.9% 50729474 / 48807643 / +3.9% 0.17 / 0.17 / -4.7%
clickbench_q20/datafusion:vortex-file-compressed 67394212 / 67417235 / -0.0% 231309456 / 232873108 / -0.7% 0.29 / 0.29 / +0.6%
clickbench_q21/datafusion:vortex-file-compressed 97156623 / 97860004 / -0.7% 267833830 / 264488113 / +1.3% 0.36 / 0.37 / -2.0%
clickbench_q22/datafusion:vortex-file-compressed 120609042 / 119742476 / +0.7% 351072239 / 344257301 / +2.0% 0.34 / 0.35 / -1.2%
clickbench_q23/datafusion:vortex-file-compressed 363193720 / 343171944 / +5.8% 655132789 / 639081146 / +2.5% 0.55 / 0.54 / +3.2%
clickbench_q24/datafusion:vortex-file-compressed 21382026 / 20982799 / +1.9% 69728398 / 66096541 / +5.5% 0.31 / 0.32 / -3.4%
clickbench_q25/datafusion:vortex-file-compressed 26710796 / 25503363 / +4.7% 63939203 / 61931509 / +3.2% 0.42 / 0.41 / +1.4%
clickbench_q26/datafusion:vortex-file-compressed 20964350 / 20573242 / +1.9% 67524075 / 65105765 / +3.7% 0.31 / 0.32 / -1.7%
clickbench_q27/datafusion:vortex-file-compressed 103536983 / 102923609 / +0.6% 252161842 / 250100663 / +0.8% 0.41 / 0.41 / -0.2%
clickbench_q28/datafusion:vortex-file-compressed 573126074 / 569523326 / +0.6% 613881229 / 619705447 / -0.9% 0.93 / 0.92 / +1.6%
clickbench_q29/datafusion:vortex-file-compressed 24323952 / 24332324 / -0.0% 53910963 / 50909477 / +5.9% 0.45 / 0.48 / -5.6%
clickbench_q30/datafusion:vortex-file-compressed 83188520 / 86465302 / -3.8% 123362297 / 125890947 / -2.0% 0.67 / 0.69 / -1.8%
clickbench_q31/datafusion:vortex-file-compressed 85101420 / 82869092 / +2.7% 158659611 / 155621860 / +2.0% 0.54 / 0.53 / +0.7%
clickbench_q32/datafusion:vortex-file-compressed 296695237 / 297265016 / -0.2% 375447701 / 371023707 / +1.2% 0.79 / 0.80 / -1.4%
clickbench_q33/datafusion:vortex-file-compressed 338067172 / 335124310 / +0.9% 420066644 / 412939506 / +1.7% 0.80 / 0.81 / -0.8%
clickbench_q34/datafusion:vortex-file-compressed 336636926 / 331761066 / +1.5% 418029094 / 418338723 / -0.1% 0.81 / 0.79 / +1.5%
clickbench_q35/datafusion:vortex-file-compressed 58544727 / 57952895 / +1.0% 91198163 / 91393702 / -0.2% 0.64 / 0.63 / +1.2%
clickbench_q36/datafusion:vortex-file-compressed 38076267 / 37405614 / +1.8% 69808278 / 70314257 / -0.7% 0.55 / 0.53 / +2.5%
clickbench_q37/datafusion:vortex-file-compressed 22194898 / 22124402 / +0.3% 50093101 / 53214900 / -5.9% 0.44 / 0.42 / +6.6%
clickbench_q38/datafusion:vortex-file-compressed 12392702 / 12216365 / +1.4% 43485005 / 42587901 / +2.1% 0.28 / 0.29 / -0.6%
clickbench_q39/datafusion:vortex-file-compressed 79378514 / 80167786 / -1.0% 114483173 / 115134773 / -0.6% 0.69 / 0.70 / -0.4%
clickbench_q40/datafusion:vortex-file-compressed 11231606 / 11270484 / -0.3% 39878998 / 41159881 / -3.1% 0.28 / 0.27 / +2.9%
clickbench_q41/datafusion:vortex-file-compressed 10754906 / 10740178 / +0.1% 37845841 / 38304047 / -1.2% 0.28 / 0.28 / +1.3%
clickbench_q42/datafusion:vortex-file-compressed 11303219 / 11420029 / -1.0% 38252858 / 38543191 / -0.8% 0.30 / 0.30 / -0.3%
datafusion / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1234016 / 1254572 / -1.6% 21754736 / 21048197 / +3.4% 0.06 / 0.06 / -4.8%
clickbench_q01/datafusion:vortex-compact 7051351 / 7236020 / -2.6% 34654329 / 34661522 / -0.0% 0.20 / 0.21 / -2.5%
clickbench_q02/datafusion:vortex-compact 21165347 / 20344830 / +4.0% 45199984 / 43956319 / +2.8% 0.47 / 0.46 / +1.2%
clickbench_q03/datafusion:vortex-compact 13603894 / 14208226 / -4.3% 40648916 / 40358292 / +0.7% 0.33 / 0.35 / -4.9%
clickbench_q04/datafusion:vortex-compact 55184154 / 56327228 / -2.0% 83956014 / 85781268 / -2.1% 0.66 / 0.66 / +0.1%
clickbench_q05/datafusion:vortex-compact 85642522 / 85249848 / +0.5% 118654108 / 122937427 / -3.5% 0.72 / 0.69 / +4.1%
clickbench_q06/datafusion:vortex-compact 1266582 / 1251342 / +1.2% 21904152 / 21597828 / +1.4% 0.06 / 0.06 / -0.2%
clickbench_q07/datafusion:vortex-compact 12551446 / 12569538 / -0.1% 39512193 / 36837353 / +7.3% 0.32 / 0.34 / -6.9%
clickbench_q08/datafusion:vortex-compact 88162240 / 85637212 / +2.9% 125526457 / 121840685 / +3.0% 0.70 / 0.70 / -0.1%
clickbench_q09/datafusion:vortex-compact 186381984 / 191868716 / -2.9% 223604818 / 215869948 / +3.6% 0.83 / 0.89 / -6.2%
clickbench_q10/datafusion:vortex-compact 43735786 / 43047486 / +1.6% 71798783 / 72195832 / -0.5% 0.61 / 0.60 / +2.2%
clickbench_q11/datafusion:vortex-compact 55835272 / 56523787 / -1.2% 86407988 / 88851564 / -2.8% 0.65 / 0.64 / +1.6%
clickbench_q12/datafusion:vortex-compact 84230860 / 84939750 / -0.8% 122488889 / 133989367 / -8.6% 0.69 / 0.63 / +8.5%
clickbench_q13/datafusion:vortex-compact 135487151 / 137051460 / -1.1% 189906169 / 180154237 / +5.4% 0.71 / 0.76 / -6.2%
clickbench_q14/datafusion:vortex-compact 93260534 / 94938192 / -1.8% 137891678 / 140941894 / -2.2% 0.68 / 0.67 / +0.4%
clickbench_q15/datafusion:vortex-compact 63984845 / 63147186 / +1.3% 94854411 / 97255054 / -2.5% 0.67 / 0.65 / +3.9%
clickbench_q16/datafusion:vortex-compact 164235072 / 167885800 / -2.2% 209950082 / 206146340 / +1.8% 0.78 / 0.81 / -3.9%
clickbench_q17/datafusion:vortex-compact 163607222 / 164103516 / -0.3% 214307231 / 215293066 / -0.5% 0.76 / 0.76 / +0.2%
clickbench_q18/datafusion:vortex-compact 301959851 / 301375666 / +0.2% 357175841 / 360447771 / -0.9% 0.85 / 0.84 / +1.1%
clickbench_q19/datafusion:vortex-compact 10189344 / 10690166 / -4.7% 39832552 / 40226217 / -1.0% 0.26 / 0.27 / -3.7%
clickbench_q20/datafusion:vortex-compact 73610802 / 71710422 / +2.7% 192621883 / 199232061 / -3.3% 0.38 / 0.36 / +6.2%
clickbench_q21/datafusion:vortex-compact 119357638 / 118597633 / +0.6% 230914343 / 229392631 / +0.7% 0.52 / 0.52 / -0.0%
clickbench_q22/datafusion:vortex-compact 186155016 / 185587172 / +0.3% 274158848 / 273776460 / +0.1% 0.68 / 0.68 / +0.2%
clickbench_q23/datafusion:vortex-compact 536858826 / 545710917 / -1.6% 640731382 / 709707448 / -9.7% 0.84 / 0.77 / +9.0%
clickbench_q24/datafusion:vortex-compact 28767256 / 29618114 / -2.9% 62556780 / 65318284 / -4.2% 0.46 / 0.45 / +1.4%
clickbench_q25/datafusion:vortex-compact 35464412 / 36428382 / -2.6% 72022474 / 72269656 / -0.3% 0.49 / 0.50 / -2.3%
clickbench_q26/datafusion:vortex-compact 28281808 / 29322304 / -3.5% 63354858 / 64585935 / -1.9% 0.45 / 0.45 / -1.7%
clickbench_q27/datafusion:vortex-compact 102928480 / 104071582 / -1.1% 207331729 / 214049540 / -3.1% 0.50 / 0.49 / +2.1%
clickbench_q28/datafusion:vortex-compact 592649964 / 586117943 / +1.1% 617013881 / 615929806 / +0.2% 0.96 / 0.95 / +0.9%
clickbench_q29/datafusion:vortex-compact 31011414 / 30714948 / +1.0% 56020973 / 56452799 / -0.8% 0.55 / 0.54 / +1.7%
clickbench_q30/datafusion:vortex-compact 90528077 / 94254614 / -4.0% 139481078 / 131857810 / +5.8% 0.65 / 0.71 / -9.2%
clickbench_q31/datafusion:vortex-compact 100931531 / 99596736 / +1.3% 156285341 / 159265604 / -1.9% 0.65 / 0.63 / +3.3%
clickbench_q32/datafusion:vortex-compact 307883964 / 298310470 / +3.2% 372328072 / 380473235 / -2.1% 0.83 / 0.78 / +5.5%
clickbench_q33/datafusion:vortex-compact 340169167 / 346973568 / -2.0% 419651085 / 407131143 / +3.1% 0.81 / 0.85 / -4.9%
clickbench_q34/datafusion:vortex-compact 338662800 / 344852314 / -1.8% 417702729 / 426628079 / -2.1% 0.81 / 0.81 / +0.3%
clickbench_q35/datafusion:vortex-compact 64245104 / 62790503 / +2.3% 94053087 / 93547989 / +0.5% 0.68 / 0.67 / +1.8%
clickbench_q36/datafusion:vortex-compact 38231136 / 38303308 / -0.2% 68707853 / 69000374 / -0.4% 0.56 / 0.56 / +0.2%
clickbench_q37/datafusion:vortex-compact 22648524 / 22208316 / +2.0% 50069695 / 49021363 / +2.1% 0.45 / 0.45 / -0.2%
clickbench_q38/datafusion:vortex-compact 12895913 / 12863382 / +0.3% 42724238 / 40806127 / +4.7% 0.30 / 0.32 / -4.2%
clickbench_q39/datafusion:vortex-compact 79343992 / 79488068 / -0.2% 113710374 / 112255063 / +1.3% 0.70 / 0.71 / -1.5%
clickbench_q40/datafusion:vortex-compact 12208178 / 12064468 / +1.2% 39196206 / 39207104 / -0.0% 0.31 / 0.31 / +1.2%
clickbench_q41/datafusion:vortex-compact 12878409 / 12788044 / +0.7% 39134356 / 38639712 / +1.3% 0.33 / 0.33 / -0.6%
clickbench_q42/datafusion:vortex-compact 11329168 / 11128560 / +1.8% 37289159 / 38676874 / -3.6% 0.30 / 0.29 / +5.6%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1250698 / 1272604 / -1.7% 49259235 / 50867155 / -3.2% 0.03 / 0.03 / +1.5%
clickbench_q01/datafusion:parquet 16116808 / 16170728 / -0.3% 67890123 / 69615961 / -2.5% 0.24 / 0.23 / +2.2%
clickbench_q02/datafusion:parquet 19504191 / 19043335 / +2.4% 83805770 / 84491248 / -0.8% 0.23 / 0.23 / +3.3%
clickbench_q03/datafusion:parquet 17970854 / 16660458 / +7.9% 83132425 / 83143202 / -0.0% 0.22 / 0.20 / +7.9%
clickbench_q04/datafusion:parquet 60873202 / 59721841 / +1.9% 130664342 / 126893845 / +3.0% 0.47 / 0.47 / -1.0%
clickbench_q05/datafusion:parquet 87447756 / 86435508 / +1.2% 154850719 / 158606331 / -2.4% 0.56 / 0.54 / +3.6%
clickbench_q06/datafusion:parquet 1303828 / 1276298 / +2.2% 49723577 / 50399257 / -1.3% 0.03 / 0.03 / +3.5%
clickbench_q07/datafusion:parquet 17269764 / 16911449 / +2.1% 70125933 / 69938354 / +0.3% 0.25 / 0.24 / +1.8%
clickbench_q08/datafusion:parquet 86122233 / 84748727 / +1.6% 163506806 / 166943893 / -2.1% 0.53 / 0.51 / +3.8%
clickbench_q09/datafusion:parquet 191383301 / 188634814 / +1.5% 261348406 / 272190323 / -4.0% 0.73 / 0.69 / +5.7%
clickbench_q10/datafusion:parquet 34954210 / 35683302 / -2.0% 105360985 / 104405719 / +0.9% 0.33 / 0.34 / -2.9%
clickbench_q11/datafusion:parquet 41461764 / 41500447 / -0.1% 111235007 / 114404758 / -2.8% 0.37 / 0.36 / +2.8%
clickbench_q12/datafusion:parquet 95058384 / 94044806 / +1.1% 162098660 / 161854311 / +0.2% 0.59 / 0.58 / +0.9%
clickbench_q13/datafusion:parquet 142479743 / 144087109 / -1.1% 225518638 / 223507944 / +0.9% 0.63 / 0.64 / -2.0%
clickbench_q14/datafusion:parquet 99981484 / 100054464 / -0.1% 173850523 / 173085369 / +0.4% 0.58 / 0.58 / -0.5%
clickbench_q15/datafusion:parquet 69384584 / 68744746 / +0.9% 129007017 / 132964488 / -3.0% 0.54 / 0.52 / +4.0%
clickbench_q16/datafusion:parquet 154074544 / 154167952 / -0.1% 230865223 / 234895427 / -1.7% 0.67 / 0.66 / +1.7%
clickbench_q17/datafusion:parquet 153714402 / 153410012 / +0.2% 234893705 / 236098754 / -0.5% 0.65 / 0.65 / +0.7%
clickbench_q18/datafusion:parquet 306364136 / 309234194 / -0.9% 412591514 / 407669540 / +1.2% 0.74 / 0.76 / -2.1%
clickbench_q19/datafusion:parquet 19784540 / 19982378 / -1.0% 78020753 / 80173161 / -2.7% 0.25 / 0.25 / +1.7%
clickbench_q20/datafusion:parquet 169773504 / 169967938 / -0.1% 282672456 / 297386000 / -4.9% 0.60 / 0.57 / +5.1%
clickbench_q21/datafusion:parquet 163944356 / 163330862 / +0.4% 296546285 / 310914902 / -4.6% 0.55 / 0.53 / +5.2%
clickbench_q22/datafusion:parquet 247735299 / 245516630 / +0.9% 426958111 / 449687421 / -5.1% 0.58 / 0.55 / +6.3%
clickbench_q23/datafusion:parquet 960044782 / 958278553 / +0.2% 1164466371 / 1188941503 / -2.1% 0.82 / 0.81 / +2.3%
clickbench_q24/datafusion:parquet 29897616 / 30444788 / -1.8% 88917783 / 93332356 / -4.7% 0.34 / 0.33 / +3.1%
clickbench_q25/datafusion:parquet 35180871 / 36060018 / -2.4% 103300958 / 106864129 / -3.3% 0.34 / 0.34 / +0.9%
clickbench_q26/datafusion:parquet 30138856 / 30688560 / -1.8% 91492347 / 93236768 / -1.9% 0.33 / 0.33 / +0.1%
clickbench_q27/datafusion:parquet 181219595 / 183064472 / -1.0% 285119435 / 293186774 / -2.8% 0.64 / 0.62 / +1.8%
clickbench_q28/datafusion:parquet 616069343 / 621512421 / -0.9% 701321012 / 701446704 / -0.0% 0.88 / 0.89 / -0.9%
clickbench_q29/datafusion:parquet 28309759 / 28288912 / +0.1% 92924968 / 93549615 / -0.7% 0.30 / 0.30 / +0.7%
clickbench_q30/datafusion:parquet 88949317 / 88196856 / +0.9% 172140878 / 171035128 / +0.6% 0.52 / 0.52 / +0.2%
clickbench_q31/datafusion:parquet 98090244 / 98462938 / -0.4% 198453463 / 201086184 / -1.3% 0.49 / 0.49 / +0.9%
clickbench_q32/datafusion:parquet 325875234 / 316380253 / +3.0% 420917890 / 410847365 / +2.5% 0.77 / 0.77 / +0.5%
clickbench_q33/datafusion:parquet 369348933 / 369147800 / +0.1% 458615970 / 460541467 / -0.4% 0.81 / 0.80 / +0.5%
clickbench_q34/datafusion:parquet 368068939 / 369880716 / -0.5% 464555286 / 462367295 / +0.5% 0.79 / 0.80 / -1.0%
clickbench_q35/datafusion:parquet 64166067 / 64097474 / +0.1% 125590173 / 123014520 / +2.1% 0.51 / 0.52 / -1.9%
clickbench_q36/datafusion:parquet 73666668 / 73670360 / -0.0% 137475182 / 137592074 / -0.1% 0.54 / 0.54 / +0.1%
clickbench_q37/datafusion:parquet 36066175 / 36112660 / -0.1% 92778816 / 93231217 / -0.5% 0.39 / 0.39 / +0.4%
clickbench_q38/datafusion:parquet 47381681 / 47295826 / +0.2% 109591152 / 109296445 / +0.3% 0.43 / 0.43 / -0.1%
clickbench_q39/datafusion:parquet 143634621 / 143754217 / -0.1% 210354313 / 213935725 / -1.7% 0.68 / 0.67 / +1.6%
clickbench_q40/datafusion:parquet 20500311 / 20442865 / +0.3% 78933531 / 82202088 / -4.0% 0.26 / 0.25 / +4.4%
clickbench_q41/datafusion:parquet 19278028 / 19277771 / +0.0% 77076822 / 78055115 / -1.3% 0.25 / 0.25 / +1.3%
clickbench_q42/datafusion:parquet 19801724 / 19671886 / +0.7% 76216647 / 75944988 / +0.4% 0.26 / 0.26 / +0.3%
duckdb / vortex-file-compressed / ns (0.996x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1562148 / 1509096 / +3.5% 25862524 / 27625090 / -6.4% 0.06 / 0.05 / +10.6%
clickbench_q01/duckdb:vortex-file-compressed 13844109 / 13464482 / +2.8% 25316069 / 26419410 / -4.2% 0.55 / 0.51 / +7.3%
clickbench_q02/duckdb:vortex-file-compressed 13659120 / 13892150 / -1.7% 38835919 / 31950187 / +21.6% 🔴 0.35 / 0.43 / -19.1%
clickbench_q03/duckdb:vortex-file-compressed 17783233 / 18088619 / -1.7% 51665886 / 49203476 / +5.0% 0.34 / 0.37 / -6.4%
clickbench_q04/duckdb:vortex-file-compressed 68056972 / 73476107 / -7.4% 102907866 / 102066365 / +0.8% 0.66 / 0.72 / -8.1%
clickbench_q05/duckdb:vortex-file-compressed 69341501 / 69635718 / -0.4% 97460240 / 93121603 / +4.7% 0.71 / 0.75 / -4.9%
clickbench_q06/duckdb:vortex-file-compressed 1812163 / 1829944 / -1.0% 30135076 / 28185532 / +6.9% 0.06 / 0.06 / -7.4%
clickbench_q07/duckdb:vortex-file-compressed 13161615 / 14240246 / -7.6% 31292769 / 36788450 / -14.9% 🟢 0.42 / 0.39 / +8.7%
clickbench_q08/duckdb:vortex-file-compressed 84952000 / 87217291 / -2.6% 125585467 / 128602338 / -2.3% 0.68 / 0.68 / -0.3%
clickbench_q09/duckdb:vortex-file-compressed 109544534 / 109269436 / +0.3% 154922777 / 154588016 / +0.2% 0.71 / 0.71 / +0.0%
clickbench_q10/duckdb:vortex-file-compressed 44665826 / 42959354 / +4.0% 77749444 / 77760134 / -0.0% 0.57 / 0.55 / +4.0%
clickbench_q11/duckdb:vortex-file-compressed 56635993 / 54689370 / +3.6% 89907955 / 88849603 / +1.2% 0.63 / 0.62 / +2.3%
clickbench_q12/duckdb:vortex-file-compressed 74613790 / 77039560 / -3.1% 107363153 / 104616739 / +2.6% 0.69 / 0.74 / -5.6%
clickbench_q13/duckdb:vortex-file-compressed 146205202 / 139440459 / +4.9% 185345251 / 185016695 / +0.2% 0.79 / 0.75 / +4.7%
clickbench_q14/duckdb:vortex-file-compressed 83089571 / 84017678 / -1.1% 114680056 / 117474666 / -2.4% 0.72 / 0.72 / +1.3%
clickbench_q15/duckdb:vortex-file-compressed 92138717 / 92845351 / -0.8% 130222125 / 132649786 / -1.8% 0.71 / 0.70 / +1.1%
clickbench_q16/duckdb:vortex-file-compressed 169000278 / 160984416 / +5.0% 219396134 / 210994089 / +4.0% 0.77 / 0.76 / +1.0%
clickbench_q17/duckdb:vortex-file-compressed 164473916 / 175832446 / -6.5% 211444782 / 210397137 / +0.5% 0.78 / 0.84 / -6.9%
clickbench_q18/duckdb:vortex-file-compressed 325331001 / 325087378 / +0.1% 408839732 / 369841241 / +10.5% 🔴 0.80 / 0.88 / -9.5%
clickbench_q19/duckdb:vortex-file-compressed 16042390 / 18274648 / -12.2% 🟢 44651752 / 40278678 / +10.9% 🔴 0.36 / 0.45 / -20.8%
clickbench_q20/duckdb:vortex-file-compressed 125444272 / 126923478 / -1.2% 208714980 / 201218203 / +3.7% 0.60 / 0.63 / -4.7%
clickbench_q21/duckdb:vortex-file-compressed 180285054 / 177940363 / +1.3% 323576542 / 329687782 / -1.9% 0.56 / 0.54 / +3.2%
clickbench_q22/duckdb:vortex-file-compressed 285754460 / 284905574 / +0.3% 543333847 / 546218049 / -0.5% 0.53 / 0.52 / +0.8%
clickbench_q23/duckdb:vortex-file-compressed 68949404 / 70703268 / -2.5% 112197495 / 112645375 / -0.4% 0.61 / 0.63 / -2.1%
clickbench_q24/duckdb:vortex-file-compressed 25208970 / 28431411 / -11.3% 🟢 41102989 / 42439953 / -3.2% 0.61 / 0.67 / -8.5%
clickbench_q25/duckdb:vortex-file-compressed 36697016 / 35055166 / +4.7% 55488256 / 56221141 / -1.3% 0.66 / 0.62 / +6.1%
clickbench_q26/duckdb:vortex-file-compressed 21452442 / 21752807 / -1.4% 35540578 / 33660704 / +5.6% 0.60 / 0.65 / -6.6%
clickbench_q27/duckdb:vortex-file-compressed 171332467 / 169976231 / +0.8% 285553571 / 280581565 / +1.8% 0.60 / 0.61 / -1.0%
clickbench_q28/duckdb:vortex-file-compressed 663891524 / 598157309 / +11.0% 🔴 689079051 / 697318142 / -1.2% 0.96 / 0.86 / +12.3%
clickbench_q29/duckdb:vortex-file-compressed 18141975 / 17508377 / +3.6% 44043032 / 41377565 / +6.4% 0.41 / 0.42 / -2.7%
clickbench_q30/duckdb:vortex-file-compressed 92230686 / 90332903 / +2.1% 133917345 / 132522102 / +1.1% 0.69 / 0.68 / +1.0%
clickbench_q31/duckdb:vortex-file-compressed 142208351 / 141452146 / +0.5% 225112637 / 204515921 / +10.1% 🔴 0.63 / 0.69 / -8.7%
clickbench_q32/duckdb:vortex-file-compressed 440725155 / 441623448 / -0.2% 490121684 / 497647957 / -1.5% 0.90 / 0.89 / +1.3%
clickbench_q33/duckdb:vortex-file-compressed 406716344 / 409689706 / -0.7% 522152459 / 531976781 / -1.8% 0.78 / 0.77 / +1.1%
clickbench_q34/duckdb:vortex-file-compressed 419740330 / 429882664 / -2.4% 556691656 / 551476439 / +0.9% 0.75 / 0.78 / -3.3%
clickbench_q35/duckdb:vortex-file-compressed 104640100 / 101626964 / +3.0% 138651615 / 135201330 / +2.6% 0.75 / 0.75 / +0.4%
clickbench_q36/duckdb:vortex-file-compressed 17793160 / 18161344 / -2.0% 33157405 / 34831888 / -4.8% 0.54 / 0.52 / +2.9%
clickbench_q37/duckdb:vortex-file-compressed 12452472 / 12693739 / -1.9% 27652417 / 27564186 / +0.3% 0.45 / 0.46 / -2.2%
clickbench_q38/duckdb:vortex-file-compressed 14948688 / 15130682 / -1.2% 30470582 / 34308025 / -11.2% 🟢 0.49 / 0.44 / +11.2%
clickbench_q39/duckdb:vortex-file-compressed 27455212 / 26002960 / +5.6% 43143240 / 42570139 / +1.3% 0.64 / 0.61 / +4.2%
clickbench_q40/duckdb:vortex-file-compressed 11740820 / 11877015 / -1.1% 26500057 / 27227842 / -2.7% 0.44 / 0.44 / +1.6%
clickbench_q41/duckdb:vortex-file-compressed 12843080 / 12482251 / +2.9% 27337455 / 28442944 / -3.9% 0.47 / 0.44 / +7.1%
clickbench_q42/duckdb:vortex-file-compressed 12734499 / 12831828 / -0.8% 27981363 / 31434621 / -11.0% 🟢 0.46 / 0.41 / +11.5%
duckdb / vortex-compact / ns (1.007x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1529485 / 1571759 / -2.7% 24753412 / 22420675 / +10.4% 🔴 0.06 / 0.07 / -11.9%
clickbench_q01/duckdb:vortex-compact 13598858 / 12722970 / +6.9% 25891559 / 30243137 / -14.4% 🟢 0.53 / 0.42 / +24.8%
clickbench_q02/duckdb:vortex-compact 21739900 / 19925198 / +9.1% 43290294 / 39885744 / +8.5% 0.50 / 0.50 / +0.5%
clickbench_q03/duckdb:vortex-compact 19876994 / 20670204 / -3.8% 46614907 / 47179284 / -1.2% 0.43 / 0.44 / -2.7%
clickbench_q04/duckdb:vortex-compact 71973892 / 72155592 / -0.3% 109414286 / 107295763 / +2.0% 0.66 / 0.67 / -2.2%
clickbench_q05/duckdb:vortex-compact 75458721 / 76055791 / -0.8% 102643252 / 103354053 / -0.7% 0.74 / 0.74 / -0.1%
clickbench_q06/duckdb:vortex-compact 1815190 / 1840389 / -1.4% 28260979 / 27779385 / +1.7% 0.06 / 0.07 / -3.0%
clickbench_q07/duckdb:vortex-compact 15973544 / 16564036 / -3.6% 31555484 / 34101235 / -7.5% 0.51 / 0.49 / +4.2%
clickbench_q08/duckdb:vortex-compact 104915966 / 96853556 / +8.3% 133091832 / 140954647 / -5.6% 0.79 / 0.69 / +14.7%
clickbench_q09/duckdb:vortex-compact 138515722 / 139262784 / -0.5% 178306775 / 182509745 / -2.3% 0.78 / 0.76 / +1.8%
clickbench_q10/duckdb:vortex-compact 56140817 / 52475414 / +7.0% 88995143 / 89853797 / -1.0% 0.63 / 0.58 / +8.0%
clickbench_q11/duckdb:vortex-compact 66961120 / 68455716 / -2.2% 104433374 / 105220764 / -0.7% 0.64 / 0.65 / -1.4%
clickbench_q12/duckdb:vortex-compact 89021101 / 87261155 / +2.0% 120436519 / 127232490 / -5.3% 0.74 / 0.69 / +7.8%
clickbench_q13/duckdb:vortex-compact 161396026 / 170628508 / -5.4% 207249492 / 209517837 / -1.1% 0.78 / 0.81 / -4.4%
clickbench_q14/duckdb:vortex-compact 96358061 / 99937374 / -3.6% 129426859 / 138587797 / -6.6% 0.74 / 0.72 / +3.2%
clickbench_q15/duckdb:vortex-compact 95615711 / 95313836 / +0.3% 135852458 / 135896299 / -0.0% 0.70 / 0.70 / +0.3%
clickbench_q16/duckdb:vortex-compact 178370472 / 192305872 / -7.2% 237646285 / 230821219 / +3.0% 0.75 / 0.83 / -9.9%
clickbench_q17/duckdb:vortex-compact 186184133 / 181904982 / +2.4% 235509682 / 222191254 / +6.0% 0.79 / 0.82 / -3.4%
clickbench_q18/duckdb:vortex-compact 326975336 / 332590794 / -1.7% 419923050 / 421870442 / -0.5% 0.78 / 0.79 / -1.2%
clickbench_q19/duckdb:vortex-compact 16053432 / 16591398 / -3.2% 37477082 / 38591175 / -2.9% 0.43 / 0.43 / -0.4%
clickbench_q20/duckdb:vortex-compact 109675064 / 112530268 / -2.5% 182519533 / 179022684 / +2.0% 0.60 / 0.63 / -4.4%
clickbench_q21/duckdb:vortex-compact 191480284 / 184227260 / +3.9% 373404375 / 365133074 / +2.3% 0.51 / 0.50 / +1.6%
clickbench_q22/duckdb:vortex-compact 389194863 / 389468198 / -0.1% 670919876 / 665903574 / +0.8% 0.58 / 0.58 / -0.8%
clickbench_q23/duckdb:vortex-compact 95981670 / 97469739 / -1.5% 124586667 / 137629426 / -9.5% 0.77 / 0.71 / +8.8%
clickbench_q24/duckdb:vortex-compact 29889682 / 31805573 / -6.0% 44217690 / 43191740 / +2.4% 0.68 / 0.74 / -8.2%
clickbench_q25/duckdb:vortex-compact 47560771 / 47198843 / +0.8% 72137934 / 68672102 / +5.0% 0.66 / 0.69 / -4.1%
clickbench_q26/duckdb:vortex-compact 24266118 / 23004254 / +5.5% 34998438 / 36364522 / -3.8% 0.69 / 0.63 / +9.6%
clickbench_q27/duckdb:vortex-compact 209124660 / 200028453 / +4.5% 359035859 / 345779139 / +3.8% 0.58 / 0.58 / +0.7%
clickbench_q28/duckdb:vortex-compact 593099787 / 597878460 / -0.8% 747828184 / 728554246 / +2.6% 0.79 / 0.82 / -3.4%
clickbench_q29/duckdb:vortex-compact 23447398 / 23110604 / +1.5% 44919395 / 47201820 / -4.8% 0.52 / 0.49 / +6.6%
clickbench_q30/duckdb:vortex-compact 110298078 / 113985982 / -3.2% 155892976 / 156294276 / -0.3% 0.71 / 0.73 / -3.0%
clickbench_q31/duckdb:vortex-compact 173545080 / 174517928 / -0.6% 258723649 / 234999201 / +10.1% 🔴 0.67 / 0.74 / -9.7%
clickbench_q32/duckdb:vortex-compact 455036374 / 452656438 / +0.5% 521524662 / 503084917 / +3.7% 0.87 / 0.90 / -3.0%
clickbench_q33/duckdb:vortex-compact 405811168 / 391542741 / +3.6% 536386666 / 545998984 / -1.8% 0.76 / 0.72 / +5.5%
clickbench_q34/duckdb:vortex-compact 418785887 / 429250004 / -2.4% 580278510 / 585696002 / -0.9% 0.72 / 0.73 / -1.5%
clickbench_q35/duckdb:vortex-compact 108367922 / 108112901 / +0.2% 136769248 / 137724803 / -0.7% 0.79 / 0.78 / +0.9%
clickbench_q36/duckdb:vortex-compact 17317742 / 17658568 / -1.9% 34625665 / 33370114 / +3.8% 0.50 / 0.53 / -5.5%
clickbench_q37/duckdb:vortex-compact 15099070 / 14469644 / +4.3% 27593000 / 27520771 / +0.3% 0.55 / 0.53 / +4.1%
clickbench_q38/duckdb:vortex-compact 14315228 / 13858392 / +3.3% 33630558 / 29542091 / +13.8% 🔴 0.43 / 0.47 / -9.3%
clickbench_q39/duckdb:vortex-compact 27174442 / 26535401 / +2.4% 44160663 / 46681203 / -5.4% 0.62 / 0.57 / +8.3%
clickbench_q40/duckdb:vortex-compact 12514808 / 13230482 / -5.4% 28341196 / 30031489 / -5.6% 0.44 / 0.44 / +0.2%
clickbench_q41/duckdb:vortex-compact 14026378 / 12943238 / +8.4% 27815357 / 30451157 / -8.7% 0.50 / 0.43 / +18.6%
clickbench_q42/duckdb:vortex-compact 14627847 / 12188189 / +20.0% 🔴 27860544 / 27301798 / +2.0% 0.53 / 0.45 / +17.6%
duckdb / parquet / ns (1.006x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9466952 / 7941526 / +19.2% 🔴 19313544 / 21080122 / -8.4% 0.49 / 0.38 / +30.1%
clickbench_q01/duckdb:parquet 10661412 / 9959718 / +7.0% 21575811 / 22299824 / -3.2% 0.49 / 0.45 / +10.6%
clickbench_q02/duckdb:parquet 17812388 / 15347282 / +16.1% 🔴 34852804 / 31017796 / +12.4% 🔴 0.51 / 0.49 / +3.3%
clickbench_q03/duckdb:parquet 16014750 / 15891807 / +0.8% 54239907 / 54731564 / -0.9% 0.30 / 0.29 / +1.7%
clickbench_q04/duckdb:parquet 71084362 / 69835300 / +1.8% 93129888 / 97168696 / -4.2% 0.76 / 0.72 / +6.2%
clickbench_q05/duckdb:parquet 85048088 / 83270610 / +2.1% 117381367 / 120088942 / -2.3% 0.72 / 0.69 / +4.5%
clickbench_q06/duckdb:parquet 14395722 / 15931818 / -9.6% 23309221 / 23572406 / -1.1% 0.62 / 0.68 / -8.6%
clickbench_q07/duckdb:parquet 11722538 / 11256834 / +4.1% 22156213 / 24905103 / -11.0% 🟢 0.53 / 0.45 / +17.1%
clickbench_q08/duckdb:parquet 86009986 / 87550076 / -1.8% 134443911 / 135322061 / -0.6% 0.64 / 0.65 / -1.1%
clickbench_q09/duckdb:parquet 120702502 / 114436131 / +5.5% 162414836 / 157011202 / +3.4% 0.74 / 0.73 / +2.0%
clickbench_q10/duckdb:parquet 34250212 / 34552586 / -0.9% 70500540 / 69224091 / +1.8% 0.49 / 0.50 / -2.7%
clickbench_q11/duckdb:parquet 36457314 / 36020724 / +1.2% 78766537 / 79723612 / -1.2% 0.46 / 0.45 / +2.4%
clickbench_q12/duckdb:parquet 90288225 / 91819895 / -1.7% 130725266 / 137769158 / -5.1% 0.69 / 0.67 / +3.6%
clickbench_q13/duckdb:parquet 145274454 / 149159576 / -2.6% 207191661 / 212910439 / -2.7% 0.70 / 0.70 / +0.1%
clickbench_q14/duckdb:parquet 98275626 / 96926640 / +1.4% 149631241 / 150194680 / -0.4% 0.66 / 0.65 / +1.8%
clickbench_q15/duckdb:parquet 91625454 / 95599947 / -4.2% 121111363 / 126986437 / -4.6% 0.76 / 0.75 / +0.5%
clickbench_q16/duckdb:parquet 172387222 / 169489665 / +1.7% 228245901 / 226832204 / +0.6% 0.76 / 0.75 / +1.1%
clickbench_q17/duckdb:parquet 177280299 / 178804599 / -0.9% 228335766 / 246270190 / -7.3% 0.78 / 0.73 / +6.9%
clickbench_q18/duckdb:parquet 326590856 / 324434004 / +0.7% 421242134 / 398920237 / +5.6% 0.78 / 0.81 / -4.7%
clickbench_q19/duckdb:parquet 13494657 / 13759822 / -1.9% 43234384 / 42745519 / +1.1% 0.31 / 0.32 / -3.0%
clickbench_q20/duckdb:parquet 135527590 / 133700460 / +1.4% 245995386 / 241415367 / +1.9% 0.55 / 0.55 / -0.5%
clickbench_q21/duckdb:parquet 179459937 / 181167856 / -0.9% 315706157 / 316452300 / -0.2% 0.57 / 0.57 / -0.7%
clickbench_q22/duckdb:parquet 244563422 / 242150149 / +1.0% 421943580 / 422984558 / -0.2% 0.58 / 0.57 / +1.2%
clickbench_q23/duckdb:parquet 145390471 / 145499083 / -0.1% 168633993 / 167175410 / +0.9% 0.86 / 0.87 / -0.9%
clickbench_q24/duckdb:parquet 42691908 / 43125043 / -1.0% 62404968 / 62040230 / +0.6% 0.68 / 0.70 / -1.6%
clickbench_q25/duckdb:parquet 39428199 / 39958178 / -1.3% 89084862 / 90543673 / -1.6% 0.44 / 0.44 / +0.3%
clickbench_q26/duckdb:parquet 29656675 / 29302883 / +1.2% 46597775 / 48658571 / -4.2% 0.64 / 0.60 / +5.7%
clickbench_q27/duckdb:parquet 147305372 / 143248608 / +2.8% 259187210 / 256930356 / +0.9% 0.57 / 0.56 / +1.9%
clickbench_q28/duckdb:parquet 903092235 / 906880815 / -0.4% 990911150 / 1041984463 / -4.9% 0.91 / 0.87 / +4.7%
clickbench_q29/duckdb:parquet 16640434 / 17397132 / -4.3% 31098234 / 31171061 / -0.2% 0.54 / 0.56 / -4.1%
clickbench_q30/duckdb:parquet 91081054 / 92928040 / -2.0% 173586127 / 170552669 / +1.8% 0.52 / 0.54 / -3.7%
clickbench_q31/duckdb:parquet 143826221 / 144105682 / -0.2% 291571999 / 296580921 / -1.7% 0.49 / 0.49 / +1.5%
clickbench_q32/duckdb:parquet 461572338 / 467884582 / -1.3% 491974643 / 493543250 / -0.3% 0.94 / 0.95 / -1.0%
clickbench_q33/duckdb:parquet 452133869 / 447770364 / +1.0% 492188944 / 479315794 / +2.7% 0.92 / 0.93 / -1.7%
clickbench_q34/duckdb:parquet 464312393 / 459334712 / +1.1% 493727089 / 499027570 / -1.1% 0.94 / 0.92 / +2.2%
clickbench_q35/duckdb:parquet 101503754 / 101706674 / -0.2% 129753728 / 124133282 / +4.5% 0.78 / 0.82 / -4.5%
clickbench_q36/duckdb:parquet 31686113 / 31149938 / +1.7% 41683934 / 40117423 / +3.9% 0.76 / 0.78 / -2.1%
clickbench_q37/duckdb:parquet 22697640 / 23468236 / -3.3% 31831024 / 31143789 / +2.2% 0.71 / 0.75 / -5.4%
clickbench_q38/duckdb:parquet 23578982 / 24101662 / -2.2% 33114063 / 35090259 / -5.6% 0.71 / 0.69 / +3.7%
clickbench_q39/duckdb:parquet 56337614 / 56795866 / -0.8% 65827945 / 66351387 / -0.8% 0.86 / 0.86 / -0.0%
clickbench_q40/duckdb:parquet 12325444 / 12439530 / -0.9% 21684961 / 23254594 / -6.7% 0.57 / 0.53 / +6.3%
clickbench_q41/duckdb:parquet 12828852 / 12544000 / +2.3% 21691974 / 22281453 / -2.6% 0.59 / 0.56 / +5.1%
clickbench_q42/duckdb:parquet 14062529 / 14290001 / -1.6% 24004388 / 24609704 / -2.5% 0.59 / 0.58 / +0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.961x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92604350 / 90772560 / +2.0% 168041994 / 159620748 / +5.3% 0.55 / 0.57 / -3.1%
tpch_q02/datafusion:vortex-file-compressed 63587185 / 64144933 / -0.9% 92000722 / 95022486 / -3.2% 0.69 / 0.68 / +2.4%
tpch_q03/datafusion:vortex-file-compressed 65856763 / 65706571 / +0.2% 113495960 / 114405565 / -0.8% 0.58 / 0.57 / +1.0%
tpch_q04/datafusion:vortex-file-compressed 35124853 / 35927676 / -2.2% 74790353 / 75717698 / -1.2% 0.47 / 0.47 / -1.0%
tpch_q05/datafusion:vortex-file-compressed 118956554 / 116154914 / +2.4% 171038103 / 173683596 / -1.5% 0.70 / 0.67 / +4.0%
tpch_q06/datafusion:vortex-file-compressed 14150000 / 15120999 / -6.4% 76452090 / 77412700 / -1.2% 0.19 / 0.20 / -5.2%
tpch_q07/datafusion:vortex-file-compressed 139186836 / 139826512 / -0.5% 184364720 / 193775131 / -4.9% 0.75 / 0.72 / +4.6%
tpch_q08/datafusion:vortex-file-compressed 146362651 / 145209988 / +0.8% 202258387 / 210497413 / -3.9% 0.72 / 0.69 / +4.9%
tpch_q09/datafusion:vortex-file-compressed 184084175 / 196092122 / -6.1% 261334791 / 248864066 / +5.0% 0.70 / 0.79 / -10.6%
tpch_q10/datafusion:vortex-file-compressed 75722302 / 74694616 / +1.4% 139679337 / 135066363 / +3.4% 0.54 / 0.55 / -2.0%
tpch_q11/datafusion:vortex-file-compressed 42708694 / 43171728 / -1.1% 66539121 / 68043468 / -2.2% 0.64 / 0.63 / +1.2%
tpch_q12/datafusion:vortex-file-compressed 47577505 / 46696979 / +1.9% 89724446 / 97585255 / -8.1% 0.53 / 0.48 / +10.8%
tpch_q13/datafusion:vortex-file-compressed 46679173 / 47264502 / -1.2% 77450206 / 81441009 / -4.9% 0.60 / 0.58 / +3.9%
tpch_q14/datafusion:vortex-file-compressed 24669329 / 24366782 / +1.2% 98943492 / 102399179 / -3.4% 0.25 / 0.24 / +4.8%
tpch_q15/datafusion:vortex-file-compressed 37017104 / 36885477 / +0.4% 102077851 / 101573953 / +0.5% 0.36 / 0.36 / -0.1%
tpch_q16/datafusion:vortex-file-compressed 36760315 / 36760233 / +0.0% 69845653 / 68384291 / +2.1% 0.53 / 0.54 / -2.1%
tpch_q17/datafusion:vortex-file-compressed 176803165 / 180006781 / -1.8% 235922508 / 229723103 / +2.7% 0.75 / 0.78 / -4.4%
tpch_q18/datafusion:vortex-file-compressed 199980559 / 201707980 / -0.9% 256339185 / 258543160 / -0.9% 0.78 / 0.78 / -0.0%
tpch_q19/datafusion:vortex-file-compressed 38744929 / 38268643 / +1.2% 98217411 / 96575458 / +1.7% 0.39 / 0.40 / -0.4%
tpch_q20/datafusion:vortex-file-compressed 62770003 / 63085105 / -0.5% 122732307 / 124318653 / -1.3% 0.51 / 0.51 / +0.8%
tpch_q21/datafusion:vortex-file-compressed 179945578 / 181709166 / -1.0% 241103166 / 240326228 / +0.3% 0.75 / 0.76 / -1.3%
tpch_q22/datafusion:vortex-file-compressed 25545049 / 25409884 / +0.5% 56704280 / 57769806 / -1.8% 0.45 / 0.44 / +2.4%
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 97703425 / 98568521 / -0.9% 149781312 / 161181931 / -7.1% 0.65 / 0.61 / +6.7%
tpch_q02/datafusion:vortex-compact 65066140 / 64743933 / +0.5% 94731992 / 95304520 / -0.6% 0.69 / 0.68 / +1.1%
tpch_q03/datafusion:vortex-compact 66851626 / 66588615 / +0.4% 110663952 / 109563124 / +1.0% 0.60 / 0.61 / -0.6%
tpch_q04/datafusion:vortex-compact 41753718 / 41591022 / +0.4% 86816270 / 84560356 / +2.7% 0.48 / 0.49 / -2.2%
tpch_q05/datafusion:vortex-compact 119240329 / 118343944 / +0.8% 167987298 / 166544352 / +0.9% 0.71 / 0.71 / -0.1%
tpch_q06/datafusion:vortex-compact 18281561 / 18029919 / +1.4% 61746966 / 65176717 / -5.3% 0.30 / 0.28 / +7.0%
tpch_q07/datafusion:vortex-compact 141995359 / 144100716 / -1.5% 192127607 / 192340659 / -0.1% 0.74 / 0.75 / -1.4%
tpch_q08/datafusion:vortex-compact 147783221 / 145580514 / +1.5% 196379900 / 205676036 / -4.5% 0.75 / 0.71 / +6.3%
tpch_q09/datafusion:vortex-compact 186576012 / 185434616 / +0.6% 249349255 / 252088981 / -1.1% 0.75 / 0.74 / +1.7%
tpch_q10/datafusion:vortex-compact 78582175 / 78966488 / -0.5% 128684804 / 129745634 / -0.8% 0.61 / 0.61 / +0.3%
tpch_q11/datafusion:vortex-compact 43038819 / 43103538 / -0.2% 67885673 / 67895996 / -0.0% 0.63 / 0.63 / -0.1%
tpch_q12/datafusion:vortex-compact 57583818 / 57891625 / -0.5% 97317142 / 100967876 / -3.6% 0.59 / 0.57 / +3.2%
tpch_q13/datafusion:vortex-compact 53657069 / 53976941 / -0.6% 85639331 / 83336942 / +2.8% 0.63 / 0.65 / -3.3%
tpch_q14/datafusion:vortex-compact 27066860 / 27296111 / -0.8% 97116672 / 99630203 / -2.5% 0.28 / 0.27 / +1.7%
tpch_q15/datafusion:vortex-compact 44203492 / 44425881 / -0.5% 103513621 / 101372563 / +2.1% 0.43 / 0.44 / -2.6%
tpch_q16/datafusion:vortex-compact 40373696 / 40245966 / +0.3% 66827939 / 68356957 / -2.2% 0.60 / 0.59 / +2.6%
tpch_q17/datafusion:vortex-compact 176714303 / 172614138 / +2.4% 226006111 / 225258046 / +0.3% 0.78 / 0.77 / +2.0%
tpch_q18/datafusion:vortex-compact 202175219 / 200579576 / +0.8% 251107331 / 251391848 / -0.1% 0.81 / 0.80 / +0.9%
tpch_q19/datafusion:vortex-compact 63326870 / 61679515 / +2.7% 105837363 / 115212866 / -8.1% 0.60 / 0.54 / +11.8%
tpch_q20/datafusion:vortex-compact 65654151 / 65342293 / +0.5% 118908449 / 125839094 / -5.5% 0.55 / 0.52 / +6.3%
tpch_q21/datafusion:vortex-compact 193723581 / 190606724 / +1.6% 241356673 / 240346014 / +0.4% 0.80 / 0.79 / +1.2%
tpch_q22/datafusion:vortex-compact 26438837 / 26665940 / -0.9% 54342105 / 55844592 / -2.7% 0.49 / 0.48 / +1.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83302074 / 82811039 / +0.6% 140255315 / 134726055 / +4.1% 0.59 / 0.61 / -3.4%
tpch_q02/datafusion:parquet 134681791 / 135880098 / -0.9% 163343189 / 165997158 / -1.6% 0.82 / 0.82 / +0.7%
tpch_q03/datafusion:parquet 124569922 / 124065832 / +0.4% 196393706 / 193542394 / +1.5% 0.63 / 0.64 / -1.1%
tpch_q04/datafusion:parquet 53246450 / 54147105 / -1.7% 111761042 / 110442278 / +1.2% 0.48 / 0.49 / -2.8%
tpch_q05/datafusion:parquet 162056869 / 164569787 / -1.5% 240782634 / 245340452 / -1.9% 0.67 / 0.67 / +0.3%
tpch_q06/datafusion:parquet 32478793 / 32367859 / +0.3% 85524350 / 88745808 / -3.6% 0.38 / 0.36 / +4.1%
tpch_q07/datafusion:parquet 213453806 / 216042629 / -1.2% 297165435 / 296057084 / +0.4% 0.72 / 0.73 / -1.6%
tpch_q08/datafusion:parquet 209490480 / 210869128 / -0.7% 289215167 / 299415245 / -3.4% 0.72 / 0.70 / +2.8%
tpch_q09/datafusion:parquet 277954977 / 280987408 / -1.1% 364182069 / 373652882 / -2.5% 0.76 / 0.75 / +1.5%
tpch_q10/datafusion:parquet 306597424 / 302599809 / +1.3% 371721514 / 384036193 / -3.2% 0.82 / 0.79 / +4.7%
tpch_q11/datafusion:parquet 96238109 / 95983569 / +0.3% 118506127 / 123809438 / -4.3% 0.81 / 0.78 / +4.8%
tpch_q12/datafusion:parquet 78285363 / 78479524 / -0.2% 133616548 / 137805245 / -3.0% 0.59 / 0.57 / +2.9%
tpch_q13/datafusion:parquet 193951877 / 193772431 / +0.1% 229666999 / 232472062 / -1.2% 0.84 / 0.83 / +1.3%
tpch_q14/datafusion:parquet 74962887 / 75024782 / -0.1% 175087014 / 182777117 / -4.2% 0.43 / 0.41 / +4.3%
tpch_q15/datafusion:parquet 78017231 / 78178062 / -0.2% 141894104 / 145725751 / -2.6% 0.55 / 0.54 / +2.5%
tpch_q16/datafusion:parquet 86895381 / 86375709 / +0.6% 112725055 / 120113727 / -6.2% 0.77 / 0.72 / +7.2%
tpch_q17/datafusion:parquet 203506595 / 203964761 / -0.2% 265958965 / 269294278 / -1.2% 0.77 / 0.76 / +1.0%
tpch_q18/datafusion:parquet 260656993 / 264388211 / -1.4% 315402272 / 316108017 / -0.2% 0.83 / 0.84 / -1.2%
tpch_q19/datafusion:parquet 97349232 / 98508287 / -1.2% 173450644 / 175217166 / -1.0% 0.56 / 0.56 / -0.2%
tpch_q20/datafusion:parquet 151312063 / 152357867 / -0.7% 210639050 / 215645933 / -2.3% 0.72 / 0.71 / +1.7%
tpch_q21/datafusion:parquet 226956311 / 225624896 / +0.6% 304846995 / 308093710 / -1.1% 0.74 / 0.73 / +1.7%
tpch_q22/datafusion:parquet 161166341 / 160368478 / +0.5% 185498578 / 188275590 / -1.5% 0.87 / 0.85 / +2.0%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54300748 / 54892812 / -1.1% 91398628 / 102863715 / -11.1% 🟢 0.59 / 0.53 / +11.3%
tpch_q02/duckdb:vortex-file-compressed 32939350 / 32312829 / +1.9% 47888312 / 47666120 / +0.5% 0.69 / 0.68 / +1.5%
tpch_q03/duckdb:vortex-file-compressed 59268854 / 60289489 / -1.7% 99640174 / 104809386 / -4.9% 0.59 / 0.58 / +3.4%
tpch_q04/duckdb:vortex-file-compressed 79582535 / 80260682 / -0.8% 111312155 / 116627195 / -4.6% 0.71 / 0.69 / +3.9%
tpch_q05/duckdb:vortex-file-compressed 65188134 / 65804779 / -0.9% 106711240 / 113530099 / -6.0% 0.61 / 0.58 / +5.4%
tpch_q06/duckdb:vortex-file-compressed 23237502 / 20703942 / +12.2% 🔴 58163452 / 67595684 / -14.0% 🟢 0.40 / 0.31 / +30.4%
tpch_q07/duckdb:vortex-file-compressed 62256284 / 62316698 / -0.1% 128196156 / 134422521 / -4.6% 0.49 / 0.46 / +4.8%
tpch_q08/duckdb:vortex-file-compressed 84576024 / 85474403 / -1.1% 138206218 / 144730519 / -4.5% 0.61 / 0.59 / +3.6%
tpch_q09/duckdb:vortex-file-compressed 174568925 / 167027393 / +4.5% 222859411 / 241595874 / -7.8% 0.78 / 0.69 / +13.3%
tpch_q10/duckdb:vortex-file-compressed 115339201 / 116936413 / -1.4% 186702235 / 199253631 / -6.3% 0.62 / 0.59 / +5.3%
tpch_q11/duckdb:vortex-file-compressed 17182478 / 17072564 / +0.6% 34002167 / 32415385 / +4.9% 0.51 / 0.53 / -4.1%
tpch_q12/duckdb:vortex-file-compressed 54272606 / 55116468 / -1.5% 89535941 / 104902939 / -14.6% 🟢 0.61 / 0.53 / +15.4%
tpch_q13/duckdb:vortex-file-compressed 90059173 / 91750940 / -1.8% 128014211 / 136054404 / -5.9% 0.70 / 0.67 / +4.3%
tpch_q14/duckdb:vortex-file-compressed 30049030 / 30073326 / -0.1% 77133242 / 76018644 / +1.5% 0.39 / 0.40 / -1.5%
tpch_q15/duckdb:vortex-file-compressed 37711321 / 37913156 / -0.5% 82654395 / 89671939 / -7.8% 0.46 / 0.42 / +7.9%
tpch_q16/duckdb:vortex-file-compressed 42873621 / 42708754 / +0.4% 53749548 / 55747871 / -3.6% 0.80 / 0.77 / +4.1%
tpch_q17/duckdb:vortex-file-compressed 77445676 / 67314843 / +15.0% 🔴 155306743 / 167152006 / -7.1% 0.50 / 0.40 / +23.8%
tpch_q18/duckdb:vortex-file-compressed 136092764 / 134341774 / +1.3% 150853991 / 159599288 / -5.5% 0.90 / 0.84 / +7.2%
tpch_q19/duckdb:vortex-file-compressed 44268534 / 42489846 / +4.2% 105554661 / 110874093 / -4.8% 0.42 / 0.38 / +9.4%
tpch_q20/duckdb:vortex-file-compressed 58837938 / 60670733 / -3.0% 111236652 / 125622786 / -11.5% 🟢 0.53 / 0.48 / +9.5%
tpch_q21/duckdb:vortex-file-compressed 234840914 / 245906432 / -4.5% 278597400 / 286999147 / -2.9% 0.84 / 0.86 / -1.6%
tpch_q22/duckdb:vortex-file-compressed 40463737 / 41789677 / -3.2% 57193450 / 62579842 / -8.6% 0.71 / 0.67 / +5.9%
duckdb / vortex-compact / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 70061095 / 69963819 / +0.1% 104141514 / 106101466 / -1.8% 0.67 / 0.66 / +2.0%
tpch_q02/duckdb:vortex-compact 35399070 / 34551729 / +2.5% 49090675 / 54209617 / -9.4% 0.72 / 0.64 / +13.1%
tpch_q03/duckdb:vortex-compact 62271624 / 62089850 / +0.3% 96097352 / 102468958 / -6.2% 0.65 / 0.61 / +6.9%
tpch_q04/duckdb:vortex-compact 93521975 / 88761146 / +5.4% 118929539 / 114345542 / +4.0% 0.79 / 0.78 / +1.3%
tpch_q05/duckdb:vortex-compact 69282583 / 69986349 / -1.0% 116690710 / 121162629 / -3.7% 0.59 / 0.58 / +2.8%
tpch_q06/duckdb:vortex-compact 25157812 / 25181478 / -0.1% 55881328 / 66454880 / -15.9% 🟢 0.45 / 0.38 / +18.8%
tpch_q07/duckdb:vortex-compact 72376201 / 72553070 / -0.2% 122179670 / 137536608 / -11.2% 🟢 0.59 / 0.53 / +12.3%
tpch_q08/duckdb:vortex-compact 90386765 / 90416578 / -0.0% 139272695 / 153386963 / -9.2% 0.65 / 0.59 / +10.1%
tpch_q09/duckdb:vortex-compact 175632447 / 178444538 / -1.6% 233780196 / 241808533 / -3.3% 0.75 / 0.74 / +1.8%
tpch_q10/duckdb:vortex-compact 121424039 / 123886936 / -2.0% 177924153 / 187113094 / -4.9% 0.68 / 0.66 / +3.1%
tpch_q11/duckdb:vortex-compact 18949606 / 19108660 / -0.8% 34480690 / 36289320 / -5.0% 0.55 / 0.53 / +4.4%
tpch_q12/duckdb:vortex-compact 71202298 / 70560940 / +0.9% 96143116 / 108672530 / -11.5% 🟢 0.74 / 0.65 / +14.1%
tpch_q13/duckdb:vortex-compact 95345549 / 97103204 / -1.8% 129198453 / 142387133 / -9.3% 0.74 / 0.68 / +8.2%
tpch_q14/duckdb:vortex-compact 34197377 / 34789671 / -1.7% 69663845 / 78848692 / -11.6% 🟢 0.49 / 0.44 / +11.3%
tpch_q15/duckdb:vortex-compact 42863799 / 46430000 / -7.7% 82396088 / 98383566 / -16.3% 🟢 0.52 / 0.47 / +10.2%
tpch_q16/duckdb:vortex-compact 44076484 / 44149201 / -0.2% 60382902 / 58250067 / +3.7% 0.73 / 0.76 / -3.7%
tpch_q17/duckdb:vortex-compact 60335895 / 61523599 / -1.9% 111665732 / 119858393 / -6.8% 0.54 / 0.51 / +5.3%
tpch_q18/duckdb:vortex-compact 140091237 / 148864641 / -5.9% 152665653 / 165372450 / -7.7% 0.92 / 0.90 / +1.9%
tpch_q19/duckdb:vortex-compact 44496711 / 46106865 / -3.5% 91228633 / 98669527 / -7.5% 0.49 / 0.47 / +4.4%
tpch_q20/duckdb:vortex-compact 68604485 / 68897650 / -0.4% 122385096 / 134864210 / -9.3% 0.56 / 0.51 / +9.7%
tpch_q21/duckdb:vortex-compact 264289251 / 259629548 / +1.8% 291779081 / 301492274 / -3.2% 0.91 / 0.86 / +5.2%
tpch_q22/duckdb:vortex-compact 41014723 / 41710609 / -1.7% 58220126 / 59946592 / -2.9% 0.70 / 0.70 / +1.2%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70413515 / 70444315 / -0.0% 87759287 / 91470119 / -4.1% 0.80 / 0.77 / +4.2%
tpch_q02/duckdb:parquet 70752794 / 70847510 / -0.1% 81845273 / 84330140 / -2.9% 0.86 / 0.84 / +2.9%
tpch_q03/duckdb:parquet 116104992 / 118969754 / -2.4% 148868180 / 150256693 / -0.9% 0.78 / 0.79 / -1.5%
tpch_q04/duckdb:parquet 74359206 / 74687855 / -0.4% 101975294 / 97478803 / +4.6% 0.73 / 0.77 / -4.8%
tpch_q05/duckdb:parquet 124552533 / 124525387 / +0.0% 163996673 / 173617862 / -5.5% 0.76 / 0.72 / +5.9%
tpch_q06/duckdb:parquet 34537742 / 34921047 / -1.1% 49461375 / 48533481 / +1.9% 0.70 / 0.72 / -3.0%
tpch_q07/duckdb:parquet 89169277 / 88888060 / +0.3% 128261280 / 134058981 / -4.3% 0.70 / 0.66 / +4.9%
tpch_q08/duckdb:parquet 142589863 / 142784310 / -0.1% 204100676 / 186811143 / +9.3% 0.70 / 0.76 / -8.6%
tpch_q09/duckdb:parquet 222453577 / 223986827 / -0.7% 262569466 / 266872717 / -1.6% 0.85 / 0.84 / +0.9%
tpch_q10/duckdb:parquet 470149721 / 471776264 / -0.3% 509692198 / 525911368 / -3.1% 0.92 / 0.90 / +2.8%
tpch_q11/duckdb:parquet 30632409 / 30700190 / -0.2% 37662340 / 38178000 / -1.4% 0.81 / 0.80 / +1.1%
tpch_q12/duckdb:parquet 75565396 / 74563722 / +1.3% 94170984 / 94240119 / -0.1% 0.80 / 0.79 / +1.4%
tpch_q13/duckdb:parquet 316592122 / 315005956 / +0.5% 328487224 / 331319657 / -0.9% 0.96 / 0.95 / +1.4%
tpch_q14/duckdb:parquet 102598629 / 103876239 / -1.2% 133983587 / 132464438 / +1.1% 0.77 / 0.78 / -2.3%
tpch_q15/duckdb:parquet 44784274 / 43718415 / +2.4% 79761473 / 67892607 / +17.5% 🔴 0.56 / 0.64 / -12.8%
tpch_q16/duckdb:parquet 113465186 / 114262732 / -0.7% 124553693 / 125588937 / -0.8% 0.91 / 0.91 / +0.1%
tpch_q17/duckdb:parquet 74586955 / 73365784 / +1.7% 101028695 / 114451058 / -11.7% 🟢 0.74 / 0.64 / +15.2%
tpch_q18/duckdb:parquet 186821169 / 199583460 / -6.4% 170072107 / 185584937 / -8.4% 1.10 / 1.08 / +2.1%
tpch_q19/duckdb:parquet 162741874 / 162027687 / +0.4% 194734307 / 204204714 / -4.6% 0.84 / 0.79 / +5.3%
tpch_q20/duckdb:parquet 127944484 / 127949756 / -0.0% 175998220 / 165198781 / +6.5% 0.73 / 0.77 / -6.1%
tpch_q21/duckdb:parquet 273709962 / 274315958 / -0.2% 294132001 / 280453418 / +4.9% 0.93 / 0.98 / -4.9%
tpch_q22/duckdb:parquet 260698461 / 262917505 / -0.8% 270837427 / 274612509 / -1.4% 0.96 / 0.96 / +0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.1%
Engines: DataFusion No clear signal (-2.2%, environment too noisy confidence) · DuckDB No clear signal (+8.7%, environment too noisy confidence)
Vortex (geomean): hot 1.051x ➖ · cold 1.033x ➖
Parquet (geomean): hot 1.020x ➖ · cold 1.038x ➖
Shifts: Parquet (control) +2.0% · Median polish +4.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.037x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 207867255 / 209836058 / -0.9% 646629514 / 706852324 / -8.5% 0.32 / 0.30 / +8.3%
tpch_q02/datafusion:vortex-file-compressed 376660777 / 437647234 / -13.9% 715518618 / 717429053 / -0.3% 0.53 / 0.61 / -13.7%
tpch_q03/datafusion:vortex-file-compressed 426604312 / 353868274 / +20.6% 1065948207 / 998103708 / +6.8% 0.40 / 0.35 / +12.9%
tpch_q04/datafusion:vortex-file-compressed 156010775 / 153658633 / +1.5% 462363575 / 371827415 / +24.3% 0.34 / 0.41 / -18.4%
tpch_q05/datafusion:vortex-file-compressed 456372867 / 323548049 / +41.1% 🔴 604823608 / 522611053 / +15.7% 0.75 / 0.62 / +21.9%
tpch_q06/datafusion:vortex-file-compressed 278995512 / 261527130 / +6.7% 369881754 / 518975782 / -28.7% 0.75 / 0.50 / +49.7%
tpch_q07/datafusion:vortex-file-compressed 438048916 / 453643681 / -3.4% 775802141 / 644919479 / +20.3% 0.56 / 0.70 / -19.7%
tpch_q08/datafusion:vortex-file-compressed 454506074 / 486171674 / -6.5% 670089596 / 652416760 / +2.7% 0.68 / 0.75 / -9.0%
tpch_q09/datafusion:vortex-file-compressed 499291790 / 799392173 / -37.5% 🟢 588294503 / 749521842 / -21.5% 0.85 / 1.07 / -20.4%
tpch_q10/datafusion:vortex-file-compressed 384867930 / 398869286 / -3.5% 741461183 / 621886906 / +19.2% 0.52 / 0.64 / -19.1%
tpch_q11/datafusion:vortex-file-compressed 286686254 / 336497985 / -14.8% 495918063 / 470086253 / +5.5% 0.58 / 0.72 / -19.2%
tpch_q12/datafusion:vortex-file-compressed 349196775 / 360455447 / -3.1% 637102171 / 630839724 / +1.0% 0.55 / 0.57 / -4.1%
tpch_q13/datafusion:vortex-file-compressed 149942760 / 114661513 / +30.8% 🔴 475346679 / 463210862 / +2.6% 0.32 / 0.25 / +27.4%
tpch_q14/datafusion:vortex-file-compressed 206285513 / 204063224 / +1.1% 366126040 / 320380600 / +14.3% 0.56 / 0.64 / -11.5%
tpch_q15/datafusion:vortex-file-compressed 284000839 / 332197942 / -14.5% 457684126 / 603928456 / -24.2% 0.62 / 0.55 / +12.8%
tpch_q16/datafusion:vortex-file-compressed 181880771 / 192383224 / -5.5% 290702669 / 309964931 / -6.2% 0.63 / 0.62 / +0.8%
tpch_q17/datafusion:vortex-file-compressed 410919423 / 300891303 / +36.6% 🔴 539607704 / 505791396 / +6.7% 0.76 / 0.59 / +28.0%
tpch_q18/datafusion:vortex-file-compressed 724744053 / 262821374 / +175.8% 🔴 969793922 / 629220627 / +54.1% 🔴 0.75 / 0.42 / +78.9%
tpch_q19/datafusion:vortex-file-compressed 373848606 / 408309451 / -8.4% 561942685 / 542540909 / +3.6% 0.67 / 0.75 / -11.6%
tpch_q20/datafusion:vortex-file-compressed 294319747 / 292545398 / +0.6% 450412236 / 442333601 / +1.8% 0.65 / 0.66 / -1.2%
tpch_q21/datafusion:vortex-file-compressed 478066302 / 461177049 / +3.7% 706312325 / 605288152 / +16.7% 0.68 / 0.76 / -11.2%
tpch_q22/datafusion:vortex-file-compressed 169992880 / 205288661 / -17.2% 370214471 / 346328557 / +6.9% 0.46 / 0.59 / -22.5%
datafusion / vortex-compact / ns (1.026x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 223450840 / 217734880 / +2.6% 645111192 / 622049278 / +3.7% 0.35 / 0.35 / -1.0%
tpch_q02/datafusion:vortex-compact 370723879 / 297714810 / +24.5% 901880007 / 669290112 / +34.8% 🔴 0.41 / 0.44 / -7.6%
tpch_q03/datafusion:vortex-compact 330706823 / 310574502 / +6.5% 977954244 / 670119678 / +45.9% 🔴 0.34 / 0.46 / -27.0%
tpch_q04/datafusion:vortex-compact 196953488 / 163164243 / +20.7% 342627688 / 353698305 / -3.1% 0.57 / 0.46 / +24.6%
tpch_q05/datafusion:vortex-compact 304827597 / 346751400 / -12.1% 540153797 / 634157032 / -14.8% 0.56 / 0.55 / +3.2%
tpch_q06/datafusion:vortex-compact 254073744 / 249905292 / +1.7% 405534591 / 408873928 / -0.8% 0.63 / 0.61 / +2.5%
tpch_q07/datafusion:vortex-compact 375762666 / 349448781 / +7.5% 606266556 / 469100993 / +29.2% 0.62 / 0.74 / -16.8%
tpch_q08/datafusion:vortex-compact 499569547 / 464900150 / +7.5% 793791323 / 580392754 / +36.8% 🔴 0.63 / 0.80 / -21.4%
tpch_q09/datafusion:vortex-compact 451812104 / 312027215 / +44.8% 🔴 674887650 / 506899271 / +33.1% 🔴 0.67 / 0.62 / +8.8%
tpch_q10/datafusion:vortex-compact 315942582 / 345158896 / -8.5% 439373285 / 516243426 / -14.9% 0.72 / 0.67 / +7.5%
tpch_q11/datafusion:vortex-compact 266709133 / 312912279 / -14.8% 472411640 / 601938678 / -21.5% 0.56 / 0.52 / +8.6%
tpch_q12/datafusion:vortex-compact 313647646 / 323171525 / -2.9% 498486185 / 443282744 / +12.5% 0.63 / 0.73 / -13.7%
tpch_q13/datafusion:vortex-compact 157295075 / 140220654 / +12.2% 501638559 / 320172255 / +56.7% 🔴 0.31 / 0.44 / -28.4%
tpch_q14/datafusion:vortex-compact 187253954 / 186456022 / +0.4% 292051471 / 331577859 / -11.9% 0.64 / 0.56 / +14.0%
tpch_q15/datafusion:vortex-compact 302401722 / 291443050 / +3.8% 512746009 / 505664015 / +1.4% 0.59 / 0.58 / +2.3%
tpch_q16/datafusion:vortex-compact 174416891 / 156896825 / +11.2% 352681968 / 274671957 / +28.4% 0.49 / 0.57 / -13.4%
tpch_q17/datafusion:vortex-compact 321636007 / 291799717 / +10.2% 426402363 / 682333678 / -37.5% 🟢 0.75 / 0.43 / +76.4%
tpch_q18/datafusion:vortex-compact 255232930 / 249265679 / +2.4% 329833317 / 428737901 / -23.1% 0.77 / 0.58 / +33.1%
tpch_q19/datafusion:vortex-compact 465543793 / 376529052 / +23.6% 479639518 / 468702927 / +2.3% 0.97 / 0.80 / +20.8%
tpch_q20/datafusion:vortex-compact 256160449 / 405185247 / -36.8% 🟢 408972357 / 400173364 / +2.2% 0.63 / 1.01 / -38.1%
tpch_q21/datafusion:vortex-compact 395600135 / 374269060 / +5.7% 595236764 / 526022317 / +13.2% 0.66 / 0.71 / -6.6%
tpch_q22/datafusion:vortex-compact 152308056 / 194158070 / -21.6% 326597063 / 641731025 / -49.1% 🟢 0.47 / 0.30 / +54.1%
datafusion / parquet / ns (1.055x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 166418798 / 189041752 / -12.0% 437247376 / 691331013 / -36.8% 🟢 0.38 / 0.27 / +39.2%
tpch_q02/datafusion:parquet 277313115 / 324713770 / -14.6% 513882729 / 567785178 / -9.5% 0.54 / 0.57 / -5.6%
tpch_q03/datafusion:parquet 431523363 / 276409715 / +56.1% 🔴 688671001 / 634641336 / +8.5% 0.63 / 0.44 / +43.9%
tpch_q04/datafusion:parquet 169829083 / 138804998 / +22.4% 405756487 / 330698762 / +22.7% 0.42 / 0.42 / -0.3%
tpch_q05/datafusion:parquet 350356123 / 367565584 / -4.7% 460676651 / 506077886 / -9.0% 0.76 / 0.73 / +4.7%
tpch_q06/datafusion:parquet 137749697 / 144771739 / -4.9% 308586375 / 308313167 / +0.1% 0.45 / 0.47 / -4.9%
tpch_q07/datafusion:parquet 344188026 / 339771092 / +1.3% 540743760 / 447988256 / +20.7% 0.64 / 0.76 / -16.1%
tpch_q08/datafusion:parquet 410288160 / 407759119 / +0.6% 556556131 / 530382506 / +4.9% 0.74 / 0.77 / -4.1%
tpch_q09/datafusion:parquet 462079410 / 415045844 / +11.3% 686932954 / 551124343 / +24.6% 0.67 / 0.75 / -10.7%
tpch_q10/datafusion:parquet 403601800 / 386187262 / +4.5% 514775096 / 533665878 / -3.5% 0.78 / 0.72 / +8.3%
tpch_q11/datafusion:parquet 256713820 / 263158634 / -2.4% 404379582 / 382193193 / +5.8% 0.63 / 0.69 / -7.8%
tpch_q12/datafusion:parquet 173798787 / 174066842 / -0.2% 617478033 / 423749000 / +45.7% 🔴 0.28 / 0.41 / -31.5%
tpch_q13/datafusion:parquet 396634835 / 394859823 / +0.4% 587282135 / 731532240 / -19.7% 0.68 / 0.54 / +25.1%
tpch_q14/datafusion:parquet 189413737 / 159837912 / +18.5% 415123659 / 408785073 / +1.6% 0.46 / 0.39 / +16.7%
tpch_q15/datafusion:parquet 318532972 / 258059322 / +23.4% 477177357 / 432388109 / +10.4% 0.67 / 0.60 / +11.8%
tpch_q16/datafusion:parquet 107113623 / 104819519 / +2.2% 258378601 / 285999482 / -9.7% 0.41 / 0.37 / +13.1%
tpch_q17/datafusion:parquet 293643398 / 463354678 / -36.6% 🟢 400762341 / 653783262 / -38.7% 🟢 0.73 / 0.71 / +3.4%
tpch_q18/datafusion:parquet 405996650 / 386970354 / +4.9% 527541342 / 561754107 / -6.1% 0.77 / 0.69 / +11.7%
tpch_q19/datafusion:parquet 177802166 / 156309648 / +13.7% 344960551 / 289417466 / +19.2% 0.52 / 0.54 / -4.6%
tpch_q20/datafusion:parquet 305875601 / 244356082 / +25.2% 558450702 / 373649626 / +49.5% 🔴 0.55 / 0.65 / -16.2%
tpch_q21/datafusion:parquet 405858203 / 315003513 / +28.8% 572501358 / 401726334 / +42.5% 🔴 0.71 / 0.78 / -9.6%
tpch_q22/datafusion:parquet 200785893 / 169502812 / +18.5% 340506553 / 315798623 / +7.8% 0.59 / 0.54 / +9.9%
duckdb / vortex-file-compressed / ns (1.060x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 198211542 / 195907120 / +1.2% 347746430 / 304179758 / +14.3% 0.57 / 0.64 / -11.5%
tpch_q02/duckdb:vortex-file-compressed 406721056 / 406494317 / +0.1% 400181445 / 413143418 / -3.1% 1.02 / 0.98 / +3.3%
tpch_q03/duckdb:vortex-file-compressed 453941776 / 410209956 / +10.7% 394386863 / 454392084 / -13.2% 1.15 / 0.90 / +27.5%
tpch_q04/duckdb:vortex-file-compressed 244441292 / 253683636 / -3.6% 324446560 / 277754572 / +16.8% 0.75 / 0.91 / -17.5%
tpch_q05/duckdb:vortex-file-compressed 394853680 / 567149367 / -30.4% 🟢 412398739 / 516215618 / -20.1% 0.96 / 1.10 / -12.9%
tpch_q06/duckdb:vortex-file-compressed 274150800 / 264457642 / +3.7% 299860084 / 271293406 / +10.5% 0.91 / 0.97 / -6.2%
tpch_q07/duckdb:vortex-file-compressed 477822006 / 469120464 / +1.9% 530274783 / 675778963 / -21.5% 0.90 / 0.69 / +29.8%
tpch_q08/duckdb:vortex-file-compressed 559153742 / 556496097 / +0.5% 598182304 / 572529428 / +4.5% 0.93 / 0.97 / -3.8%
tpch_q09/duckdb:vortex-file-compressed 561652599 / 429514245 / +30.8% 🔴 722702564 / 509532764 / +41.8% 🔴 0.78 / 0.84 / -7.8%
tpch_q10/duckdb:vortex-file-compressed 457854530 / 416255597 / +10.0% 503674457 / 473711342 / +6.3% 0.91 / 0.88 / +3.5%
tpch_q11/duckdb:vortex-file-compressed 135648573 / 137527198 / -1.4% 162068122 / 184297117 / -12.1% 0.84 / 0.75 / +12.2%
tpch_q12/duckdb:vortex-file-compressed 453767576 / 625403766 / -27.4% 496339228 / 661446423 / -25.0% 0.91 / 0.95 / -3.3%
tpch_q13/duckdb:vortex-file-compressed 318227901 / 266584037 / +19.4% 346111852 / 317164253 / +9.1% 0.92 / 0.84 / +9.4%
tpch_q14/duckdb:vortex-file-compressed 248639566 / 236283882 / +5.2% 291355936 / 355366556 / -18.0% 0.85 / 0.66 / +28.3%
tpch_q15/duckdb:vortex-file-compressed 172265784 / 140662446 / +22.5% 289750254 / 214907052 / +34.8% 🔴 0.59 / 0.65 / -9.2%
tpch_q16/duckdb:vortex-file-compressed 186983099 / 177974640 / +5.1% 208885377 / 211226495 / -1.1% 0.90 / 0.84 / +6.2%
tpch_q17/duckdb:vortex-file-compressed 389813371 / 378032871 / +3.1% 507513205 / 415042899 / +22.3% 0.77 / 0.91 / -15.7%
tpch_q18/duckdb:vortex-file-compressed 287790532 / 269437740 / +6.8% 336287036 / 312948096 / +7.5% 0.86 / 0.86 / -0.6%
tpch_q19/duckdb:vortex-file-compressed 353358354 / 318617696 / +10.9% 370075707 / 346415941 / +6.8% 0.95 / 0.92 / +3.8%
tpch_q20/duckdb:vortex-file-compressed 410794329 / 356790419 / +15.1% 487113300 / 447184945 / +8.9% 0.84 / 0.80 / +5.7%
tpch_q21/duckdb:vortex-file-compressed 680630827 / 623618091 / +9.1% 671617090 / 621791830 / +8.0% 1.01 / 1.00 / +1.0%
tpch_q22/duckdb:vortex-file-compressed 192860453 / 109813593 / +75.6% 🔴 202074246 / 131999441 / +53.1% 🔴 0.95 / 0.83 / +14.7%
duckdb / vortex-compact / ns (1.083x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 212944696 / 204984400 / +3.9% 217645455 / 282893512 / -23.1% 0.98 / 0.72 / +35.0%
tpch_q02/duckdb:vortex-compact 370394124 / 361188242 / +2.5% 399892551 / 338442700 / +18.2% 0.93 / 1.07 / -13.2%
tpch_q03/duckdb:vortex-compact 414227520 / 430812181 / -3.8% 475264774 / 586736484 / -19.0% 0.87 / 0.73 / +18.7%
tpch_q04/duckdb:vortex-compact 238756325 / 270629650 / -11.8% 321613603 / 499740726 / -35.6% 🟢 0.74 / 0.54 / +37.1%
tpch_q05/duckdb:vortex-compact 346661520 / 340520791 / +1.8% 427119192 / 406469686 / +5.1% 0.81 / 0.84 / -3.1%
tpch_q06/duckdb:vortex-compact 261623583 / 311482433 / -16.0% 273527942 / 273150195 / +0.1% 0.96 / 1.14 / -16.1%
tpch_q07/duckdb:vortex-compact 438830205 / 451096510 / -2.7% 458657866 / 471971342 / -2.8% 0.96 / 0.96 / +0.1%
tpch_q08/duckdb:vortex-compact 510240273 / 499589487 / +2.1% 543122309 / 574379663 / -5.4% 0.94 / 0.87 / +8.0%
tpch_q09/duckdb:vortex-compact 452480639 / 496417617 / -8.9% 484200607 / 495290558 / -2.2% 0.93 / 1.00 / -6.8%
tpch_q10/duckdb:vortex-compact 561940081 / 386647062 / +45.3% 🔴 834020215 / 426816034 / +95.4% 🔴 0.67 / 0.91 / -25.6%
tpch_q11/duckdb:vortex-compact 127414120 / 140542454 / -9.3% 134829074 / 178442989 / -24.4% 0.95 / 0.79 / +20.0%
tpch_q12/duckdb:vortex-compact 530184638 / 437868859 / +21.1% 461113289 / 466797261 / -1.2% 1.15 / 0.94 / +22.6%
tpch_q13/duckdb:vortex-compact 409204973 / 240469565 / +70.2% 🔴 368863473 / 258040571 / +42.9% 🔴 1.11 / 0.93 / +19.0%
tpch_q14/duckdb:vortex-compact 354953509 / 227576990 / +56.0% 🔴 393339870 / 271516254 / +44.9% 🔴 0.90 / 0.84 / +7.7%
tpch_q15/duckdb:vortex-compact 174013518 / 142045204 / +22.5% 211222373 / 260959723 / -19.1% 0.82 / 0.54 / +51.4%
tpch_q16/duckdb:vortex-compact 171599702 / 166195082 / +3.3% 190658110 / 202223169 / -5.7% 0.90 / 0.82 / +9.5%
tpch_q17/duckdb:vortex-compact 379678985 / 360091929 / +5.4% 386876810 / 359955496 / +7.5% 0.98 / 1.00 / -1.9%
tpch_q18/duckdb:vortex-compact 300840349 / 272960629 / +10.2% 312667806 / 309747157 / +0.9% 0.96 / 0.88 / +9.2%
tpch_q19/duckdb:vortex-compact 352664453 / 334712159 / +5.4% 385181627 / 365289777 / +5.4% 0.92 / 0.92 / -0.1%
tpch_q20/duckdb:vortex-compact 358262289 / 360578131 / -0.6% 393396112 / 371756122 / +5.8% 0.91 / 0.97 / -6.1%
tpch_q21/duckdb:vortex-compact 610449953 / 515657012 / +18.4% 648668509 / 583315670 / +11.2% 0.94 / 0.88 / +6.5%
tpch_q22/duckdb:vortex-compact 114134173 / 106048860 / +7.6% 193400063 / 131353973 / +47.2% 🔴 0.59 / 0.81 / -26.9%
duckdb / parquet / ns (0.985x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 315927491 / 295978623 / +6.7% 414024438 / 319195567 / +29.7% 0.76 / 0.93 / -17.7%
tpch_q02/duckdb:parquet 615905236 / 640910136 / -3.9% 691309235 / 618830356 / +11.7% 0.89 / 1.04 / -14.0%
tpch_q03/duckdb:parquet 730867381 / 738969971 / -1.1% 974342798 / 880749977 / +10.6% 0.75 / 0.84 / -10.6%
tpch_q04/duckdb:parquet 483634659 / 476963319 / +1.4% 512503990 / 787425100 / -34.9% 🟢 0.94 / 0.61 / +55.8%
tpch_q05/duckdb:parquet 935729872 / 837726511 / +11.7% 1005455740 / 926472762 / +8.5% 0.93 / 0.90 / +2.9%
tpch_q06/duckdb:parquet 326540688 / 353796586 / -7.7% 324735958 / 341862295 / -5.0% 1.01 / 1.03 / -2.8%
tpch_q07/duckdb:parquet 874819083 / 808970224 / +8.1% 888783791 / 827399327 / +7.4% 0.98 / 0.98 / +0.7%
tpch_q08/duckdb:parquet 1066429980 / 1101237062 / -3.2% 1176555646 / 927784769 / +26.8% 0.91 / 1.19 / -23.6%
tpch_q09/duckdb:parquet 1067436154 / 1011282961 / +5.6% 997679320 / 982283253 / +1.6% 1.07 / 1.03 / +3.9%
tpch_q10/duckdb:parquet 1023587317 / 973836570 / +5.1% 1102387989 / 981778011 / +12.3% 0.93 / 0.99 / -6.4%
tpch_q11/duckdb:parquet 462899478 / 467351409 / -1.0% 423668187 / 418439292 / +1.2% 1.09 / 1.12 / -2.2%
tpch_q12/duckdb:parquet 540749247 / 595891178 / -9.3% 607331724 / 578308480 / +5.0% 0.89 / 1.03 / -13.6%
tpch_q13/duckdb:parquet 778327613 / 789403059 / -1.4% 880792524 / 959680341 / -8.2% 0.88 / 0.82 / +7.4%
tpch_q14/duckdb:parquet 539362106 / 527879116 / +2.2% 462870481 / 674053225 / -31.3% 🟢 1.17 / 0.78 / +48.8%
tpch_q15/duckdb:parquet 383808240 / 525750301 / -27.0% 355379826 / 379366303 / -6.3% 1.08 / 1.39 / -22.1%
tpch_q16/duckdb:parquet 487779286 / 467620818 / +4.3% 497126617 / 439497366 / +13.1% 0.98 / 1.06 / -7.8%
tpch_q17/duckdb:parquet 485250620 / 471748061 / +2.9% 491676139 / 483056811 / +1.8% 0.99 / 0.98 / +1.1%
tpch_q18/duckdb:parquet 598211471 / 627660017 / -4.7% 1637928652 / 599092596 / +173.4% 🔴 0.37 / 1.05 / -65.1%
tpch_q19/duckdb:parquet 565262498 / 595531813 / -5.1% 596797988 / 772306675 / -22.7% 0.95 / 0.77 / +22.8%
tpch_q20/duckdb:parquet 854941162 / 846066673 / +1.0% 790070365 / 778255254 / +1.5% 1.08 / 1.09 / -0.5%
tpch_q21/duckdb:parquet 725611520 / 750336194 / -3.3% 712901557 / 703280708 / +1.4% 1.02 / 1.07 / -4.6%
tpch_q22/duckdb:parquet 381164276 / 408887900 / -6.8% 413841389 / 448718228 / -7.8% 0.92 / 0.91 / +1.1%

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.8%
Engines: DataFusion No clear signal (+9.4%, environment too noisy confidence) · DuckDB No clear signal (+8.3%, environment too noisy confidence)
Vortex (geomean): hot 1.038x ➖ · cold 0.991x ➖
Parquet (geomean): hot 0.954x ➖ · cold 0.905x ➖
Shifts: Parquet (control) -4.6% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.056x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 357325336 / 311060875 / +14.9% 797664438 / 944482630 / -15.5% 0.45 / 0.33 / +36.0%
tpch_q02/datafusion:vortex-compact 571320685 / 488641446 / +16.9% 1099154505 / 1023726226 / +7.4% 0.52 / 0.48 / +8.9%
tpch_q03/datafusion:vortex-compact 500991766 / 584156741 / -14.2% 1380171452 / 1323069449 / +4.3% 0.36 / 0.44 / -17.8%
tpch_q04/datafusion:vortex-compact 363186144 / 620340932 / -41.5% 🟢 876796632 / 804070657 / +9.0% 0.41 / 0.77 / -46.3%
tpch_q05/datafusion:vortex-compact 604009274 / 621107099 / -2.8% 884368189 / 765974792 / +15.5% 0.68 / 0.81 / -15.8%
tpch_q06/datafusion:vortex-compact 444389544 / 405283754 / +9.6% 460348861 / 625742911 / -26.4% 0.97 / 0.65 / +49.0%
tpch_q07/datafusion:vortex-compact 808356570 / 556418816 / +45.3% 🔴 990866419 / 712171659 / +39.1% 🔴 0.82 / 0.78 / +4.4%
tpch_q08/datafusion:vortex-compact 1021151102 / 822832330 / +24.1% 1329553460 / 1108351047 / +20.0% 0.77 / 0.74 / +3.5%
tpch_q09/datafusion:vortex-compact 713651548 / 666713146 / +7.0% 1218204783 / 1253992748 / -2.9% 0.59 / 0.53 / +10.2%
tpch_q10/datafusion:vortex-compact 579912979 / 523735940 / +10.7% 843379012 / 947246526 / -11.0% 0.69 / 0.55 / +24.4%
tpch_q11/datafusion:vortex-compact 367395705 / 350184749 / +4.9% 652188055 / 669876248 / -2.6% 0.56 / 0.52 / +7.8%
tpch_q12/datafusion:vortex-compact 404736806 / 654732941 / -38.2% 🟢 758024043 / 970758592 / -21.9% 0.53 / 0.67 / -20.8%
tpch_q13/datafusion:vortex-compact 315209999 / 204465350 / +54.2% 🔴 1101052168 / 1016944673 / +8.3% 0.29 / 0.20 / +42.4%
tpch_q14/datafusion:vortex-compact 359705297 / 412961112 / -12.9% 576914942 / 425310828 / +35.6% 🔴 0.62 / 0.97 / -35.8%
tpch_q15/datafusion:vortex-compact 740920644 / 570501710 / +29.9% 1007835680 / 872905368 / +15.5% 0.74 / 0.65 / +12.5%
tpch_q16/datafusion:vortex-compact 298321497 / 242107257 / +23.2% 505197730 / 463182416 / +9.1% 0.59 / 0.52 / +13.0%
tpch_q17/datafusion:vortex-compact 748148679 / 773691882 / -3.3% 858173575 / 958131187 / -10.4% 0.87 / 0.81 / +8.0%
tpch_q18/datafusion:vortex-compact 670957841 / 550234511 / +21.9% 723002528 / 545558468 / +32.5% 🔴 0.93 / 1.01 / -8.0%
tpch_q19/datafusion:vortex-compact 687658182 / 608719697 / +13.0% 993047254 / 781377731 / +27.1% 0.69 / 0.78 / -11.1%
tpch_q20/datafusion:vortex-compact 638380990 / 872043101 / -26.8% 661733459 / 1444710895 / -54.2% 🟢 0.96 / 0.60 / +59.8%
tpch_q21/datafusion:vortex-compact 851049729 / 697680231 / +22.0% 1114874622 / 1105342392 / +0.9% 0.76 / 0.63 / +20.9%
tpch_q22/datafusion:vortex-compact 413396342 / 316218179 / +30.7% 🔴 599488638 / 564160557 / +6.3% 0.69 / 0.56 / +23.0%
datafusion / parquet / ns (0.966x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 285532965 / 257318608 / +11.0% 651062281 / 741731285 / -12.2% 0.44 / 0.35 / +26.4%
tpch_q02/datafusion:parquet 508137007 / 526671989 / -3.5% 1037084369 / 1149807638 / -9.8% 0.49 / 0.46 / +7.0%
tpch_q03/datafusion:parquet 715972639 / 609568252 / +17.5% 1332505476 / 2014047972 / -33.8% 🟢 0.54 / 0.30 / +77.5%
tpch_q04/datafusion:parquet 376999941 / 424881650 / -11.3% 469708474 / 695718276 / -32.5% 🟢 0.80 / 0.61 / +31.4%
tpch_q05/datafusion:parquet 721950824 / 860464278 / -16.1% 928506155 / 1025609672 / -9.5% 0.78 / 0.84 / -7.3%
tpch_q06/datafusion:parquet 227022137 / 196310477 / +15.6% 377352303 / 368510173 / +2.4% 0.60 / 0.53 / +12.9%
tpch_q07/datafusion:parquet 681414384 / 740486056 / -8.0% 971168654 / 910027981 / +6.7% 0.70 / 0.81 / -13.8%
tpch_q08/datafusion:parquet 857025022 / 961966330 / -10.9% 1185088673 / 1298012194 / -8.7% 0.72 / 0.74 / -2.4%
tpch_q09/datafusion:parquet 1500093040 / 1312183231 / +14.3% 1533250697 / 2114736994 / -27.5% 0.98 / 0.62 / +57.7%
tpch_q10/datafusion:parquet 1616726870 / 2357843546 / -31.4% 🟢 2296480891 / 3133141798 / -26.7% 0.70 / 0.75 / -6.5%
tpch_q11/datafusion:parquet 394295760 / 375271903 / +5.1% 557357383 / 653788286 / -14.7% 0.71 / 0.57 / +23.2%
tpch_q12/datafusion:parquet 426520279 / 450457024 / -5.3% 687981251 / 576491789 / +19.3% 0.62 / 0.78 / -20.7%
tpch_q13/datafusion:parquet 485572736 / 483726438 / +0.4% 1086264831 / 965550766 / +12.5% 0.45 / 0.50 / -10.8%
tpch_q14/datafusion:parquet 443696387 / 416922707 / +6.4% 603752146 / 692409073 / -12.8% 0.73 / 0.60 / +22.0%
tpch_q15/datafusion:parquet 736552661 / 660768118 / +11.5% 1135705605 / 890239168 / +27.6% 0.65 / 0.74 / -12.6%
tpch_q16/datafusion:parquet 269102688 / 260173410 / +3.4% 470864718 / 506273708 / -7.0% 0.57 / 0.51 / +11.2%
tpch_q17/datafusion:parquet 729013506 / 676980806 / +7.7% 855013795 / 840016593 / +1.8% 0.85 / 0.81 / +5.8%
tpch_q18/datafusion:parquet 1009558048 / 1025220701 / -1.5% 1386300481 / 1196310787 / +15.9% 0.73 / 0.86 / -15.0%
tpch_q19/datafusion:parquet 466701458 / 646899107 / -27.9% 743108045 / 832660777 / -10.8% 0.63 / 0.78 / -19.2%
tpch_q20/datafusion:parquet 765191690 / 768947038 / -0.5% 991563740 / 1053198792 / -5.9% 0.77 / 0.73 / +5.7%
tpch_q21/datafusion:parquet 1008861642 / 1397186308 / -27.8% 1059893220 / 1648946157 / -35.7% 🟢 0.95 / 0.85 / +12.3%
tpch_q22/datafusion:parquet 610268807 / 617650541 / -1.2% 1010801594 / 895099915 / +12.9% 0.60 / 0.69 / -12.5%
duckdb / vortex-compact / ns (1.020x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 946974530 / 876682598 / +8.0% 1372034260 / 2071099113 / -33.8% 🟢 0.69 / 0.42 / +63.1%
tpch_q02/duckdb:vortex-compact 476923869 / 470851686 / +1.3% 865579432 / 1090140123 / -20.6% 0.55 / 0.43 / +27.6%
tpch_q03/duckdb:vortex-compact 1179721787 / 1019438262 / +15.7% 1398258072 / 1612024749 / -13.3% 0.84 / 0.63 / +33.4%
tpch_q04/duckdb:vortex-compact 709849924 / 677960304 / +4.7% 820957752 / 1127019080 / -27.2% 0.86 / 0.60 / +43.7%
tpch_q05/duckdb:vortex-compact 1126489182 / 1014180061 / +11.1% 1334245449 / 1343401120 / -0.7% 0.84 / 0.75 / +11.8%
tpch_q06/duckdb:vortex-compact 1066517319 / 1100151857 / -3.1% 1072820649 / 1200527492 / -10.6% 0.99 / 0.92 / +8.5%
tpch_q07/duckdb:vortex-compact 1545362880 / 1482636679 / +4.2% 1716793209 / 1760591969 / -2.5% 0.90 / 0.84 / +6.9%
tpch_q08/duckdb:vortex-compact 1315873555 / 1347957853 / -2.4% 1617030973 / 1409326028 / +14.7% 0.81 / 0.96 / -14.9%
tpch_q09/duckdb:vortex-compact 1799076211 / 1752190468 / +2.7% 2023983996 / 2072045586 / -2.3% 0.89 / 0.85 / +5.1%
tpch_q10/duckdb:vortex-compact 1537053007 / 1379604080 / +11.4% 2418235920 / 1804552031 / +34.0% 🔴 0.64 / 0.76 / -16.9%
tpch_q11/duckdb:vortex-compact 461086978 / 453080897 / +1.8% 606770754 / 573042686 / +5.9% 0.76 / 0.79 / -3.9%
tpch_q12/duckdb:vortex-compact 1973178681 / 2237359021 / -11.8% 2221662146 / 2345653377 / -5.3% 0.89 / 0.95 / -6.9%
tpch_q13/duckdb:vortex-compact 1331243308 / 1123342909 / +18.5% 1637339035 / 1504864994 / +8.8% 0.81 / 0.75 / +8.9%
tpch_q14/duckdb:vortex-compact 763045013 / 825359049 / -7.5% 860279946 / 906352658 / -5.1% 0.89 / 0.91 / -2.6%
tpch_q15/duckdb:vortex-compact 941970235 / 864389538 / +9.0% 962496738 / 1020279512 / -5.7% 0.98 / 0.85 / +15.5%
tpch_q16/duckdb:vortex-compact 221842454 / 225855559 / -1.8% 372219308 / 273828601 / +35.9% 🔴 0.60 / 0.82 / -27.7%
tpch_q17/duckdb:vortex-compact 1393006393 / 1315221341 / +5.9% 1408996164 / 1287903639 / +9.4% 0.99 / 1.02 / -3.2%
tpch_q18/duckdb:vortex-compact 1060965200 / 1317382360 / -19.5% 1135186418 / 1443537805 / -21.4% 0.93 / 0.91 / +2.4%
tpch_q19/duckdb:vortex-compact 980844133 / 984151790 / -0.3% 1428677399 / 1131440385 / +26.3% 0.69 / 0.87 / -21.1%
tpch_q20/duckdb:vortex-compact 1727791000 / 1529795013 / +12.9% 1905184291 / 1697171633 / +12.3% 0.91 / 0.90 / +0.6%
tpch_q21/duckdb:vortex-compact 2321953095 / 2424079930 / -4.2% 2376068706 / 2205959030 / +7.7% 0.98 / 1.10 / -11.1%
tpch_q22/duckdb:vortex-compact 280959218 / 292635935 / -4.0% 385716178 / 569702607 / -32.3% 🟢 0.73 / 0.51 / +41.8%
duckdb / parquet / ns (0.942x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 379276729 / 468380810 / -19.0% 347410608 / 806900599 / -56.9% 🟢 1.09 / 0.58 / +88.1%
tpch_q02/duckdb:parquet 828878899 / 818282772 / +1.3% 1306194875 / 1759586947 / -25.8% 0.63 / 0.47 / +36.5%
tpch_q03/duckdb:parquet 1057045089 / 1149490722 / -8.0% 1244769844 / 1810458617 / -31.2% 🟢 0.85 / 0.63 / +33.7%
tpch_q04/duckdb:parquet 679345468 / 800206850 / -15.1% 1057964689 / 922740910 / +14.7% 0.64 / 0.87 / -26.0%
tpch_q05/duckdb:parquet 1211323226 / 1360209428 / -10.9% 1373392033 / 1563433482 / -12.2% 0.88 / 0.87 / +1.4%
tpch_q06/duckdb:parquet 344583223 / 499693438 / -31.0% 🟢 379186341 / 503510402 / -24.7% 0.91 / 0.99 / -8.4%
tpch_q07/duckdb:parquet 1140306455 / 1340025871 / -14.9% 1148809053 / 1330943036 / -13.7% 0.99 / 1.01 / -1.4%
tpch_q08/duckdb:parquet 1469411142 / 1478181708 / -0.6% 1530598070 / 1495182885 / +2.4% 0.96 / 0.99 / -2.9%
tpch_q09/duckdb:parquet 1347819715 / 1366934326 / -1.4% 1739862526 / 1464351690 / +18.8% 0.77 / 0.93 / -17.0%
tpch_q10/duckdb:parquet 2190708938 / 2245580233 / -2.4% 2900696754 / 3477481602 / -16.6% 0.76 / 0.65 / +17.0%
tpch_q11/duckdb:parquet 501679581 / 490981248 / +2.2% 471544559 / 530391560 / -11.1% 1.06 / 0.93 / +14.9%
tpch_q12/duckdb:parquet 618633735 / 823698293 / -24.9% 685080764 / 1057942359 / -35.2% 🟢 0.90 / 0.78 / +16.0%
tpch_q13/duckdb:parquet 861629728 / 966107375 / -10.8% 1284424990 / 1235267033 / +4.0% 0.67 / 0.78 / -14.2%
tpch_q14/duckdb:parquet 706799622 / 887371864 / -20.3% 950244701 / 752215899 / +26.3% 0.74 / 1.18 / -36.9%
tpch_q15/duckdb:parquet 589572777 / 509131470 / +15.8% 725456199 / 737595286 / -1.6% 0.81 / 0.69 / +17.7%
tpch_q16/duckdb:parquet 662911814 / 656704829 / +0.9% 662359878 / 705402133 / -6.1% 1.00 / 0.93 / +7.5%
tpch_q17/duckdb:parquet 678092456 / 610550431 / +11.1% 648561397 / 708779043 / -8.5% 1.05 / 0.86 / +21.4%
tpch_q18/duckdb:parquet 872651607 / 866362372 / +0.7% 963646809 / 823492760 / +17.0% 0.91 / 1.05 / -13.9%
tpch_q19/duckdb:parquet 853302058 / 835987184 / +2.1% 809424761 / 958281785 / -15.5% 1.05 / 0.87 / +20.8%
tpch_q20/duckdb:parquet 1237501093 / 1362248123 / -9.2% 1366751243 / 1405346011 / -2.7% 0.91 / 0.97 / -6.6%
tpch_q21/duckdb:parquet 1125023252 / 878222781 / +28.1% 1180887473 / 1412389759 / -16.4% 0.95 / 0.62 / +53.2%
tpch_q22/duckdb:parquet 784605507 / 795546713 / -1.4% 1017424227 / 908686803 / +12.0% 0.77 / 0.88 / -11.9%

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 5e44d39b vs base 0d9d5b82
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.6%
Engines: random-access No clear signal (-2.6%, low confidence)
Vortex (geomean): hot 0.975x ➖
Parquet (geomean): hot 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.937x ➖, 2↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 65315 / 72473 / -9.9%
random-access/arrow-tokio-local-disk-footer 153190 / 167468 / -8.5%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 1336773 / 1369605 / -2.4%
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 1935663 / 1996336 / -3.0%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 33304036 / 31158071 / +6.9%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 33043883 / 32611262 / +1.3%
random-access/nested-lists/correlated/arrow-tokio-local-disk 59494 / 64507 / -7.8%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 98678 / 106042 / -6.9%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1108437 / 1181114 / -6.2%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1154928 / 1211270 / -4.7%
random-access/nested-structs/correlated/arrow-tokio-local-disk 50241 / 56164 / -10.5% 🟢
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 85710 / 94646 / -9.4%
random-access/nested-structs/uniform/arrow-tokio-local-disk 826886 / 929740 / -11.1% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 870993 / 936873 / -7.0%
random-access/taxi/correlated/arrow-tokio-local-disk 112812 / 123401 / -8.6%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 207484 / 224115 / -7.4%
random-access/taxi/uniform/arrow-tokio-local-disk 2433096 / 2624819 / -7.3%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2615570 / 2890789 / -9.5%
random-access / vortex-file-compressed / ns (0.975x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 242173 / 250667 / -3.4%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1233162 / 1234978 / -0.1%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1435926 / 1451757 / -1.1%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2638933 / 2729051 / -3.3%
random-access/nested-lists/correlated/vortex-tokio-local-disk 198523 / 207748 / -4.4%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 361260 / 369215 / -2.2%
random-access/nested-lists/uniform/vortex-tokio-local-disk 855887 / 827288 / +3.5%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 1039648 / 1055921 / -1.5%
random-access/nested-structs/correlated/vortex-tokio-local-disk 268510 / 291626 / -7.9%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 518406 / 528286 / -1.9%
random-access/nested-structs/uniform/vortex-tokio-local-disk 615788 / 628808 / -2.1%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 960844 / 988215 / -2.8%
random-access/taxi/correlated/vortex-tokio-local-disk 695410 / 711598 / -2.3%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1443042 / 1516215 / -4.8%
random-access/taxi/uniform/vortex-tokio-local-disk 2652399 / 2642498 / +0.4%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3872557 / 3872524 / +0.0%
random-access/vortex-tokio-local-disk 505413 / 528392 / -4.3%
random-access/vortex-tokio-local-disk-footer 1097986 / 1160824 / -5.4%
random-access / parquet / ns (1.001x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 103399012917 / 103661563651 / -0.3%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 104146398416 / 104104158138 / +0.0%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 103492974481 / 103484850588 / +0.0%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 104526213490 / 104116165065 / +0.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk 130801350 / 131467262 / -0.5%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131110791 / 131282328 / -0.1%
random-access/nested-lists/uniform/parquet-tokio-local-disk 131314189 / 131307699 / +0.0%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130935087 / 131041071 / -0.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk 7331716 / 7319726 / +0.2%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 7491555 / 7416493 / +1.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk 7290502 / 7336428 / -0.6%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 7629370 / 7562613 / +0.9%
random-access/parquet-tokio-local-disk 117993146 / 117891654 / +0.1%
random-access/parquet-tokio-local-disk-footer 118172979 / 117984259 / +0.2%
random-access/taxi/correlated/parquet-tokio-local-disk 177035831 / 176952253 / +0.0%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 177336607 / 177019434 / +0.2%
random-access/taxi/uniform/parquet-tokio-local-disk 187079284 / 185888363 / +0.6%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 186752670 / 186396089 / +0.2%
random-access / lance / ns (0.985x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 274416 / 279219 / -1.7%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1247640 / 1263740 / -1.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1010373 / 1026865 / -1.6%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1966638 / 2018577 / -2.6%
random-access/lance-tokio-local-disk 513847 / 519519 / -1.1%
random-access/lance-tokio-local-disk-footer 1384394 / 1409325 / -1.8%
random-access/nested-lists/correlated/lance-tokio-local-disk 152121 / 156720 / -2.9%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 703723 / 707396 / -0.5%
random-access/nested-lists/uniform/lance-tokio-local-disk 834227 / 868865 / -4.0%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1394328 / 1418107 / -1.7%
random-access/nested-structs/correlated/lance-tokio-local-disk 260498 / 265103 / -1.7%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 624668 / 632056 / -1.2%
random-access/nested-structs/uniform/lance-tokio-local-disk 2263873 / 2347808 / -3.6%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2640273 / 2654031 / -0.5%
random-access/taxi/correlated/lance-tokio-local-disk 736427 / 733164 / +0.4%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1928816 / 1918746 / +0.5%
random-access/taxi/uniform/lance-tokio-local-disk 8044402 / 8231325 / -2.3%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8922911 / 8933680 / -0.1%

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 5e44d39b vs base 0d9d5b82


vortex / vortex-file-compressed / ns (0.988x ➖, 1↑ 1↓)
name ns (PR / base / %diff)
compress time/Arade 924732666 / 932166798 / -0.8%
compress time/Bimbo 4194226273 / 4262700558 / -1.6%
compress time/CMSprovider 3052846106 / 3139204628 / -2.8%
compress time/Euro2016 359708650 / 360994391 / -0.4%
compress time/Food 334193824 / 333843702 / +0.1%
compress time/HashTags 616348120 / 622122973 / -0.9%
compress time/TPC-H l_comment canonical 829235465 / 838725955 / -1.1%
compress time/TPC-H l_comment chunked 830131725 / 840684259 / -1.3%
compress time/taxi 459065027 / 467362430 / -1.8%
compress time/wide table cols=100 chunks=1 rows=1000 7154697 / 7278429 / -1.7%
compress time/wide table cols=100 chunks=50 rows=1000 7341474 / 7245993 / +1.3%
compress time/wide table cols=1000 chunks=1 rows=1000 73159006 / 73022824 / +0.2%
compress time/wide table cols=1000 chunks=50 rows=1000 74350513 / 72633429 / +2.4%
compress time/wide table cols=10000 chunks=1 rows=1000 814911916 / 794240364 / +2.6%
compress time/wide table cols=10000 chunks=50 rows=1000 817622246 / 803125795 / +1.8%
decompress time/Arade 11274790 / 11891404 / -5.2%
decompress time/Bimbo 58946266 / 59436358 / -0.8%
decompress time/CMSprovider 29266819 / 31455872 / -7.0%
decompress time/Euro2016 8513705 / 8843551 / -3.7%
decompress time/Food 4234252 / 3647393 / +16.1% 🔴
decompress time/HashTags 72763282 / 73564851 / -1.1%
decompress time/TPC-H l_comment canonical 21933700 / 22819039 / -3.9%
decompress time/TPC-H l_comment chunked 22258654 / 23395517 / -4.9%
decompress time/taxi 8272813 / 8394823 / -1.5%
decompress time/wide table cols=100 chunks=1 rows=1000 2139440 / 2150589 / -0.5%
decompress time/wide table cols=100 chunks=50 rows=1000 2132989 / 2172069 / -1.8%
decompress time/wide table cols=1000 chunks=1 rows=1000 20482741 / 20627431 / -0.7%
decompress time/wide table cols=1000 chunks=50 rows=1000 20510553 / 20679255 / -0.8%
decompress time/wide table cols=10000 chunks=1 rows=1000 273103966 / 264275999 / +3.3%
decompress time/wide table cols=10000 chunks=50 rows=1000 225542015 / 268362487 / -16.0% 🟢
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 144460980 / 144460980 / +0.0%
vortex-file-compressed size/Bimbo 461842908 / 461842908 / +0.0%
vortex-file-compressed size/CMSprovider 415191460 / 415191460 / +0.0%
vortex-file-compressed size/Euro2016 157847508 / 157847508 / +0.0%
vortex-file-compressed size/Food 41581624 / 41581624 / +0.0%
vortex-file-compressed size/HashTags 177850636 / 177850636 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 163461696 / 163461696 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 163461696 / 163461696 / +0.0%
vortex-file-compressed size/taxi 51475172 / 51475172 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932744 / 932744 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932744 / 932744 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309944 / 9309944 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309944 / 9309944 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117944 / 93117944 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117944 / 93117944 / +0.0%
vortex / vortex-file-compressed / ratio (0.992x ➖, 1↑ 2↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.407035357 / 0.410494969 / -0.8%
vortex:parquet-zstd ratio compress time/Bimbo 0.351989852 / 0.357525744 / -1.5%
vortex:parquet-zstd ratio compress time/CMSprovider 0.473900091 / 0.483824776 / -2.1%
vortex:parquet-zstd ratio compress time/Euro2016 0.33118392 / 0.33119898 / -0.0%
vortex:parquet-zstd ratio compress time/Food 0.449200741 / 0.448363665 / +0.2%
vortex:parquet-zstd ratio compress time/HashTags 0.331304914 / 0.333589394 / -0.7%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.309351194 / 0.314481746 / -1.6%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.308890401 / 0.312699941 / -1.2%
vortex:parquet-zstd ratio compress time/taxi 0.416207351 / 0.422503283 / -1.5%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.80938767 / 1.81136148 / -0.1%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.80942184 / 1.81120076 / -0.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.64124805 / 1.62264115 / +1.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.66980536 / 1.6272323 / +2.6%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.73990389 / 1.67725959 / +3.7%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.73576425 / 1.691587 / +2.6%
vortex:parquet-zstd ratio decompress time/Arade 0.0200782934 / 0.0211411908 / -5.0%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0369721421 / 0.0373899705 / -1.1%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0212575039 / 0.0227537772 / -6.6%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0256329307 / 0.0265702949 / -3.5%
vortex:parquet-zstd ratio decompress time/Food 0.024785903 / 0.0213472983 / +16.1% 🔴
vortex:parquet-zstd ratio decompress time/HashTags 0.141019756 / 0.142401444 / -1.0%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0444421131 / 0.0460699353 / -3.5%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0450499608 / 0.0472982463 / -4.8%
vortex:parquet-zstd ratio decompress time/taxi 0.0379636851 / 0.03850302 / -1.4%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1.02629293 / 1.04635443 / -1.9%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.99550039 / 1.06974127 / -6.9%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.858566818 / 0.860583325 / -0.2%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.868445451 / 0.874194596 / -0.7%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 1.0541481 / 0.881320763 / +19.6% 🔴
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.765000847 / 1.03022429 / -25.7% 🟢
vortex:parquet-zstd size/Arade 0.559895285 / 0.559895285 / -0.0%
vortex:parquet-zstd size/Bimbo 1.20109789 / 1.20109789 / -0.0%
vortex:parquet-zstd size/CMSprovider 1.10163114 / 1.10163114 / +0.0%
vortex:parquet-zstd size/Euro2016 1.2835317 / 1.2835317 / -0.0%
vortex:parquet-zstd size/Food 1.16476769 / 1.16476769 / -0.0%
vortex:parquet-zstd size/HashTags 1.33223855 / 1.33223855 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.0322273 / 1.0322273 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.0322273 / 1.0322273 / -0.0%
vortex:parquet-zstd size/taxi 0.931110481 / 0.931110481 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00036465 / 1.00036465 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00036465 / 1.00036465 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.998492064 / 0.998492064 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.998492064 / 0.998492064 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998690905 / 0.998690905 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998690905 / 0.998690905 / -0.0%
vortex / parquet / ns (0.999x ➖, 1↑ 1↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2271873069 / 2270836106 / +0.0%
parquet_rs-zstd compress time/Bimbo 11915759088 / 11922779367 / -0.1%
parquet_rs-zstd compress time/CMSprovider 6441961422 / 6488308964 / -0.7%
parquet_rs-zstd compress time/Euro2016 1086129575 / 1089962268 / -0.4%
parquet_rs-zstd compress time/Food 743974339 / 744582419 / -0.1%
parquet_rs-zstd compress time/HashTags 1860365162 / 1864936308 / -0.2%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2680563323 / 2667009980 / +0.5%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2687463652 / 2688469517 / -0.0%
parquet_rs-zstd compress time/taxi 1102971934 / 1106174671 / -0.3%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3954209 / 4018209 / -1.6%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 4057359 / 4000657 / +1.4%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44575228 / 45002448 / -0.9%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44526455 / 44636177 / -0.2%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 468366051 / 473534550 / -1.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 471044525 / 474776523 / -0.8%
parquet_rs-zstd decompress time/Arade 561541251 / 562475601 / -0.2%
parquet_rs-zstd decompress time/Bimbo 1594342732 / 1589633724 / +0.3%
parquet_rs-zstd decompress time/CMSprovider 1376775899 / 1382446163 / -0.4%
parquet_rs-zstd decompress time/Euro2016 332139352 / 332836012 / -0.2%
parquet_rs-zstd decompress time/Food 170833074 / 170859701 / -0.0%
parquet_rs-zstd decompress time/HashTags 515979350 / 516601862 / -0.1%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 493534138 / 495313025 / -0.4%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 494088199 / 494638149 / -0.1%
parquet_rs-zstd decompress time/taxi 217913856 / 218030248 / -0.1%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2084629 / 2055316 / +1.4%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2142630 / 2030462 / +5.5%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23856898 / 23969127 / -0.5%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23617549 / 23655208 / -0.2%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 259075519 / 299863580 / -13.6% 🟢
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 294825837 / 260489381 / +13.2% 🔴
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.973x ➖, 2↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 100811889 / 101949334 / -1.1%
arrow-ipc compress time/Bimbo 665240592 / 677993998 / -1.9%
arrow-ipc compress time/CMSprovider 441821741 / 446671289 / -1.1%
arrow-ipc compress time/Euro2016 38386944 / 38669990 / -0.7%
arrow-ipc compress time/Food 33852868 / 34327340 / -1.4%
arrow-ipc compress time/HashTags 78174365 / 79046685 / -1.1%
arrow-ipc compress time/TPC-H l_comment canonical 505332619 / 508106820 / -0.5%
arrow-ipc compress time/TPC-H l_comment chunked 518946605 / 515517226 / +0.7%
arrow-ipc compress time/taxi 72898949 / 75295689 / -3.2%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 205145 / 211583 / -3.0%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 206438 / 208301 / -0.9%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2267539 / 2305548 / -1.6%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2271915 / 2315484 / -1.9%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25841031 / 25978934 / -0.5%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25925374 / 26383196 / -1.7%
arrow-ipc decompress time/Arade 140218051 / 181009971 / -22.5% 🟢
arrow-ipc decompress time/Bimbo 423142228 / 428656946 / -1.3%
arrow-ipc decompress time/CMSprovider 477092157 / 479745838 / -0.6%
arrow-ipc decompress time/Euro2016 64101985 / 64315734 / -0.3%
arrow-ipc decompress time/Food 48927780 / 58329325 / -16.1% 🟢
arrow-ipc decompress time/HashTags 120242524 / 123290117 / -2.5%
arrow-ipc decompress time/TPC-H l_comment canonical 552085357 / 551387951 / +0.1%
arrow-ipc decompress time/TPC-H l_comment chunked 552359609 / 550899567 / +0.3%
arrow-ipc decompress time/taxi 45152500 / 48552700 / -7.0%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 331472 / 344103 / -3.7%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 331325 / 332463 / -0.3%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3489095 / 3532428 / -1.2%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3475061 / 3505607 / -0.9%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 35503951 / 35623235 / -0.3%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 35200277 / 35258045 / -0.2%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 4, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 4, 2026
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 4, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants