Skip to content

Upgrade DataFusion to 54#8044

Draft
AdamGS wants to merge 3 commits into
developfrom
adamg/df-54
Draft

Upgrade DataFusion to 54#8044
AdamGS wants to merge 3 commits into
developfrom
adamg/df-54

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 20, 2026

Summary

This PR includes an upgrade of our DataFusion dependency/integration to the upcoming 54 release. It aims to make the minimal amount of changes, and implementing the new Morselizer API will be part of a future PR (I have an old PR that was based on an earlier PoC, I'll try and pull stuff from there when the time comes).

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added changelog/chore A trivial change ext/datafusion Relates to the DataFusion integration labels May 20, 2026
@AdamGS AdamGS changed the title Upgrade DF to 54 Upgrade DataFusion to 54 May 20, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 20, 2026

Merging this PR will improve performance by 23.7%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 1236 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation bitwise_not_vortex_buffer_mut[128] 304.4 ns 246.1 ns +23.7%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/df-54 (dfd1f68) with develop (19a1fb3)

Open in CodSpeed

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 20, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 20, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added action/benchmark-sql Trigger SQL benchmarks to run on this PR and removed changelog/chore A trivial change labels May 20, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 20, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done dfd1f68 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress dfd1f68 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.922x ➖


datafusion / vortex-file-compressed (0.922x ➖, 5↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 118029626 126817457 0.93
polarsignals_q01/datafusion:vortex-file-compressed 🚀 260688344 312556831 0.83
polarsignals_q02/datafusion:vortex-file-compressed 🚀 23804628 26734188 0.89
polarsignals_q03/datafusion:vortex-file-compressed 286102022 287958073 0.99
polarsignals_q04/datafusion:vortex-file-compressed 11605717 12755006 0.91
polarsignals_q05/datafusion:vortex-file-compressed 🚀 16153769 18694174 0.86
polarsignals_q06/datafusion:vortex-file-compressed 21046168 19869010 1.06
polarsignals_q07/datafusion:vortex-file-compressed 🚀 13516578 15246886 0.89
polarsignals_q08/datafusion:vortex-file-compressed 🚀 399817790 446651203 0.90
polarsignals_q09/datafusion:vortex-file-compressed 11058659 11314180 0.98

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 0.949x ➖
Parquet (geomean): 0.978x ➖
Shifts: Parquet (control) -2.2% · Median polish -4.2%


datafusion / vortex-file-compressed (0.963x ➖, 1↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5294747 6197408 0.85
fineweb_q01/datafusion:vortex-file-compressed 19852565 21104201 0.94
fineweb_q02/datafusion:vortex-file-compressed 21575516 23299537 0.93
fineweb_q03/datafusion:vortex-file-compressed 74055241 78897221 0.94
fineweb_q04/datafusion:vortex-file-compressed 226498328 229149081 0.99
fineweb_q05/datafusion:vortex-file-compressed 219044333 216102663 1.01
fineweb_q06/datafusion:vortex-file-compressed 53268347 53647645 0.99
fineweb_q07/datafusion:vortex-file-compressed 57372309 56735410 1.01
fineweb_q08/datafusion:vortex-file-compressed 21866930 21504364 1.02
datafusion / vortex-compact (0.961x ➖, 1↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5800643 6464880 0.90
fineweb_q01/datafusion:vortex-compact 96222131 94567218 1.02
fineweb_q02/datafusion:vortex-compact 109766517 107806537 1.02
fineweb_q03/datafusion:vortex-compact 869999069 881447345 0.99
fineweb_q04/datafusion:vortex-compact 911406429 973714420 0.94
fineweb_q05/datafusion:vortex-compact 822892451 899171898 0.92
fineweb_q06/datafusion:vortex-compact 470376132 479235826 0.98
fineweb_q07/datafusion:vortex-compact 473942266 495521284 0.96
fineweb_q08/datafusion:vortex-compact 17870124 18919292 0.94
datafusion / parquet (0.992x ➖, 0↑ 1↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 9332775 6685629 1.40
fineweb_q01/datafusion:parquet 290215824 309008253 0.94
fineweb_q02/datafusion:parquet 297343486 312738740 0.95
fineweb_q03/datafusion:parquet 297056840 310722515 0.96
fineweb_q04/datafusion:parquet 300996498 326359950 0.92
fineweb_q05/datafusion:parquet 298919943 317855560 0.94
fineweb_q06/datafusion:parquet 287926185 296488157 0.97
fineweb_q07/datafusion:parquet 285638060 293998073 0.97
fineweb_q08/datafusion:parquet 283405376 296728322 0.96
duckdb / vortex-file-compressed (0.952x ➖, 1↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3641896 3735223 0.98
fineweb_q01/duckdb:vortex-file-compressed 22751294 23544185 0.97
fineweb_q02/duckdb:vortex-file-compressed 25292618 25913005 0.98
fineweb_q03/duckdb:vortex-file-compressed 123796195 130503417 0.95
fineweb_q04/duckdb:vortex-file-compressed 220604589 226965259 0.97
fineweb_q05/duckdb:vortex-file-compressed 214061753 223608091 0.96
fineweb_q06/duckdb:vortex-file-compressed 🚀 53312078 60488287 0.88
fineweb_q07/duckdb:vortex-file-compressed 54461419 57440694 0.95
fineweb_q08/duckdb:vortex-file-compressed 22140560 23356846 0.95
duckdb / vortex-compact (0.920x ➖, 2↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4175324 4638465 0.90
fineweb_q01/duckdb:vortex-compact 🚀 92834007 112512519 0.83
fineweb_q02/duckdb:vortex-compact 126847386 121288093 1.05
fineweb_q03/duckdb:vortex-compact 869000927 913648522 0.95
fineweb_q04/duckdb:vortex-compact 896124906 956310381 0.94
fineweb_q05/duckdb:vortex-compact 798118893 857750131 0.93
fineweb_q06/duckdb:vortex-compact 456331781 494007207 0.92
fineweb_q07/duckdb:vortex-compact 474631755 520969956 0.91
fineweb_q08/duckdb:vortex-compact 🚀 19579164 22492741 0.87
duckdb / parquet (0.964x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30945165 34109236 0.91
fineweb_q01/duckdb:parquet 85288628 93845298 0.91
fineweb_q02/duckdb:parquet 86027791 90261327 0.95
fineweb_q03/duckdb:parquet 317389105 331793745 0.96
fineweb_q04/duckdb:parquet 445662776 456591980 0.98
fineweb_q05/duckdb:parquet 417501172 423096668 0.99
fineweb_q06/duckdb:parquet 205724883 209198751 0.98
fineweb_q07/duckdb:parquet 217291300 220577264 0.99
fineweb_q08/duckdb:parquet 33859768 32994298 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -10.3% +12.5% -20.3% +45.7% ➖ noise
0 datafusion:vortex-file-compressed -14.6% +12.5% -24.1% +52.1% ➖ noise
0 duckdb:vortex-compact -10.0% +12.5% -20.0% +79.0% ➖ noise
0 duckdb:vortex-file-compressed -2.5% +12.5% -13.4% +66.2% ➖ noise
1 datafusion:vortex-compact +1.7% -7.6% +10.1% +21.8% ➖ noise
1 datafusion:vortex-file-compressed -5.9% -7.6% +1.8% +28.9% ➖ noise
1 duckdb:vortex-compact -17.5% -7.6% -10.7% +26.4% ➖ noise
1 duckdb:vortex-file-compressed -3.4% -7.6% +4.6% +69.8% ➖ noise
2 datafusion:vortex-compact +1.8% -4.8% +7.0% +17.2% ➖ noise
2 datafusion:vortex-file-compressed -7.4% -4.8% -2.7% +15.6% ➖ noise
2 duckdb:vortex-compact +4.6% -4.8% +9.9% +19.8% ➖ noise
2 duckdb:vortex-file-compressed -2.4% -4.8% +2.5% +15.6% ➖ noise
3 datafusion:vortex-compact -1.3% -4.4% +3.2% +15.6% ➖ noise
3 datafusion:vortex-file-compressed -6.1% -4.4% -1.8% +34.5% ➖ noise
3 duckdb:vortex-compact -4.9% -4.4% -0.5% +15.6% ➖ noise
3 duckdb:vortex-file-compressed -5.1% -4.4% -0.8% +28.4% ➖ noise
4 datafusion:vortex-compact -6.4% -5.1% -1.3% +15.6% ➖ noise
4 datafusion:vortex-file-compressed -1.2% -5.1% +4.2% +15.6% ➖ noise
4 duckdb:vortex-compact -6.3% -5.1% -1.2% +15.6% ➖ noise
4 duckdb:vortex-file-compressed -2.8% -5.1% +2.4% +15.6% ➖ noise
5 datafusion:vortex-compact -8.5% -3.7% -5.0% +15.6% ➖ noise
5 datafusion:vortex-file-compressed +1.4% -3.7% +5.2% +15.6% ➖ noise
5 duckdb:vortex-compact -7.0% -3.7% -3.4% +15.6% ➖ noise
5 duckdb:vortex-file-compressed -4.3% -3.7% -0.6% +15.6% ➖ noise
6 datafusion:vortex-compact -1.8% -2.3% +0.4% +15.6% ➖ noise
6 datafusion:vortex-file-compressed -0.7% -2.3% +1.6% +15.6% ➖ noise
6 duckdb:vortex-compact -7.6% -2.3% -5.5% +15.6% ➖ noise
6 duckdb:vortex-file-compressed -11.9% -2.3% -9.8% +15.6% ➖ noise
7 datafusion:vortex-compact -4.4% -2.2% -2.2% +15.6% ➖ noise
7 datafusion:vortex-file-compressed +1.1% -2.2% +3.4% +17.0% ➖ noise
7 duckdb:vortex-compact -8.9% -2.2% -6.9% +15.6% ➖ noise
7 duckdb:vortex-file-compressed -5.2% -2.2% -3.1% +15.6% ➖ noise
8 datafusion:vortex-compact -5.5% -1.0% -4.6% +16.7% ➖ noise
8 datafusion:vortex-file-compressed +1.7% -1.0% +2.7% +15.6% ➖ noise
8 duckdb:vortex-compact -13.0% -1.0% -12.1% +15.6% ➖ noise
8 duckdb:vortex-file-compressed -5.2% -1.0% -4.3% +15.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -1.8%


datafusion / vortex-file-compressed (0.983x ➖, 2↑ 1↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51945321 51078491 1.02
tpch_q02/datafusion:vortex-file-compressed 22538826 22228064 1.01
tpch_q03/datafusion:vortex-file-compressed 🚨 31826175 28797972 1.11
tpch_q04/datafusion:vortex-file-compressed 20198612 20116322 1.00
tpch_q05/datafusion:vortex-file-compressed 45792971 49020055 0.93
tpch_q06/datafusion:vortex-file-compressed 10717510 10561289 1.01
tpch_q07/datafusion:vortex-file-compressed 53311862 55128858 0.97
tpch_q08/datafusion:vortex-file-compressed 39100691 39023567 1.00
tpch_q09/datafusion:vortex-file-compressed 51379850 52755621 0.97
tpch_q10/datafusion:vortex-file-compressed 🚀 34201767 39512467 0.87
tpch_q11/datafusion:vortex-file-compressed 15781665 15831705 1.00
tpch_q12/datafusion:vortex-file-compressed 24318225 24555864 0.99
tpch_q13/datafusion:vortex-file-compressed 25558790 25517639 1.00
tpch_q14/datafusion:vortex-file-compressed 15492752 16159635 0.96
tpch_q15/datafusion:vortex-file-compressed 23850217 24667577 0.97
tpch_q16/datafusion:vortex-file-compressed 19490027 20236338 0.96
tpch_q17/datafusion:vortex-file-compressed 64379284 66876020 0.96
tpch_q18/datafusion:vortex-file-compressed 🚀 71879829 83171047 0.86
tpch_q19/datafusion:vortex-file-compressed 21273709 20308818 1.05
tpch_q20/datafusion:vortex-file-compressed 29695376 29233869 1.02
tpch_q21/datafusion:vortex-file-compressed 70888154 72421481 0.98
tpch_q22/datafusion:vortex-file-compressed 12415714 12379699 1.00
datafusion / vortex-compact (0.995x ➖, 1↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57949206 58166863 1.00
tpch_q02/datafusion:vortex-compact 25724018 25741703 1.00
tpch_q03/datafusion:vortex-compact 🚨 33976980 29686596 1.14
tpch_q04/datafusion:vortex-compact 22531478 22260852 1.01
tpch_q05/datafusion:vortex-compact 47042126 50339847 0.93
tpch_q06/datafusion:vortex-compact 12861269 12574302 1.02
tpch_q07/datafusion:vortex-compact 55220923 59008560 0.94
tpch_q08/datafusion:vortex-compact 42560444 43631261 0.98
tpch_q09/datafusion:vortex-compact 55390083 56018490 0.99
tpch_q10/datafusion:vortex-compact 🚀 38545286 45912333 0.84
tpch_q11/datafusion:vortex-compact 16960215 16792093 1.01
tpch_q12/datafusion:vortex-compact 30924709 31656897 0.98
tpch_q13/datafusion:vortex-compact 31659493 31897561 0.99
tpch_q14/datafusion:vortex-compact 18772471 19200062 0.98
tpch_q15/datafusion:vortex-compact 30483926 31854268 0.96
tpch_q16/datafusion:vortex-compact 24173574 24099243 1.00
tpch_q17/datafusion:vortex-compact 69022951 72207533 0.96
tpch_q18/datafusion:vortex-compact 76948172 84063536 0.92
tpch_q19/datafusion:vortex-compact 🚨 40731570 30969637 1.32
tpch_q20/datafusion:vortex-compact 35572693 34903750 1.02
tpch_q21/datafusion:vortex-compact 75415572 77848061 0.97
tpch_q22/datafusion:vortex-compact 13602273 13111889 1.04
datafusion / parquet (0.973x ➖, 4↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 116763999 126437669 0.92
tpch_q02/datafusion:parquet 59123817 60250060 0.98
tpch_q03/datafusion:parquet 🚨 81500477 72327287 1.13
tpch_q04/datafusion:parquet 46967556 43826680 1.07
tpch_q05/datafusion:parquet 88112544 93198056 0.95
tpch_q06/datafusion:parquet 🚀 32717600 42197701 0.78
tpch_q07/datafusion:parquet 103448663 105350087 0.98
tpch_q08/datafusion:parquet 94168107 94932257 0.99
tpch_q09/datafusion:parquet 121632115 132336963 0.92
tpch_q10/datafusion:parquet 115856527 111651631 1.04
tpch_q11/datafusion:parquet 39170093 41623279 0.94
tpch_q12/datafusion:parquet 🚀 71374589 82793269 0.86
tpch_q13/datafusion:parquet 184531921 204841579 0.90
tpch_q14/datafusion:parquet 🚀 41322014 46340237 0.89
tpch_q15/datafusion:parquet 57943996 59328278 0.98
tpch_q16/datafusion:parquet 39822581 40580046 0.98
tpch_q17/datafusion:parquet 134189111 124580928 1.08
tpch_q18/datafusion:parquet 150993142 164005334 0.92
tpch_q19/datafusion:parquet 🚀 66325317 81752269 0.81
tpch_q20/datafusion:parquet 67440582 64925210 1.04
tpch_q21/datafusion:parquet 137290621 133918048 1.03
tpch_q22/datafusion:parquet 🚨 42164327 30945109 1.36
datafusion / arrow (0.937x ➖, 6↑ 1↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54129066 58952159 0.92
tpch_q02/datafusion:arrow 🚀 16917222 19655351 0.86
tpch_q03/datafusion:arrow 31513150 31046828 1.02
tpch_q04/datafusion:arrow 26096522 25781586 1.01
tpch_q05/datafusion:arrow 🚀 60314613 75014530 0.80
tpch_q06/datafusion:arrow 🚨 23367948 19872624 1.18
tpch_q07/datafusion:arrow 103791091 102119357 1.02
tpch_q08/datafusion:arrow 42829104 41345788 1.04
tpch_q09/datafusion:arrow 62439100 68090323 0.92
tpch_q10/datafusion:arrow 48137363 51738033 0.93
tpch_q11/datafusion:arrow 🚀 8997101 10699588 0.84
tpch_q12/datafusion:arrow 47560301 52807665 0.90
tpch_q13/datafusion:arrow 44712255 47837021 0.93
tpch_q14/datafusion:arrow 23070078 22211289 1.04
tpch_q15/datafusion:arrow 46122338 45339482 1.02
tpch_q16/datafusion:arrow 🚀 16303867 18969878 0.86
tpch_q17/datafusion:arrow 65758064 68771234 0.96
tpch_q18/datafusion:arrow 🚀 105907474 138899983 0.76
tpch_q19/datafusion:arrow 36547689 35436639 1.03
tpch_q20/datafusion:arrow 35744899 34975490 1.02
tpch_q21/datafusion:arrow 157026936 152926433 1.03
tpch_q22/datafusion:arrow 🚀 12001383 17723189 0.68
duckdb / vortex-file-compressed (0.976x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31672410 32083774 0.99
tpch_q02/duckdb:vortex-file-compressed 24960090 25273794 0.99
tpch_q03/duckdb:vortex-file-compressed 32855952 32918305 1.00
tpch_q04/duckdb:vortex-file-compressed 29379143 29288343 1.00
tpch_q05/duckdb:vortex-file-compressed 37124466 37988183 0.98
tpch_q06/duckdb:vortex-file-compressed 8247230 8540760 0.97
tpch_q07/duckdb:vortex-file-compressed 34515576 36093671 0.96
tpch_q08/duckdb:vortex-file-compressed 36861416 36891430 1.00
tpch_q09/duckdb:vortex-file-compressed 57977887 59262375 0.98
tpch_q10/duckdb:vortex-file-compressed 40707829 41357274 0.98
tpch_q11/duckdb:vortex-file-compressed 15090479 15666710 0.96
tpch_q12/duckdb:vortex-file-compressed 22144365 22859873 0.97
tpch_q13/duckdb:vortex-file-compressed 37812660 37947083 1.00
tpch_q14/duckdb:vortex-file-compressed 22019661 23419970 0.94
tpch_q15/duckdb:vortex-file-compressed 16953025 17282078 0.98
tpch_q16/duckdb:vortex-file-compressed 28362037 30060293 0.94
tpch_q17/duckdb:vortex-file-compressed 23961354 24682167 0.97
tpch_q18/duckdb:vortex-file-compressed 52488048 54040195 0.97
tpch_q19/duckdb:vortex-file-compressed 28671905 29329387 0.98
tpch_q20/duckdb:vortex-file-compressed 33057827 34077379 0.97
tpch_q21/duckdb:vortex-file-compressed 100623717 101413231 0.99
tpch_q22/duckdb:vortex-file-compressed 17054761 17682748 0.96
duckdb / vortex-compact (0.988x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38954176 38628449 1.01
tpch_q02/duckdb:vortex-compact 34141117 32935320 1.04
tpch_q03/duckdb:vortex-compact 34017858 35494116 0.96
tpch_q04/duckdb:vortex-compact 31497918 31778658 0.99
tpch_q05/duckdb:vortex-compact 40055533 41775484 0.96
tpch_q06/duckdb:vortex-compact 11119809 10799254 1.03
tpch_q07/duckdb:vortex-compact 40744705 41653785 0.98
tpch_q08/duckdb:vortex-compact 41589788 42560250 0.98
tpch_q09/duckdb:vortex-compact 64880302 68927239 0.94
tpch_q10/duckdb:vortex-compact 44821110 46404910 0.97
tpch_q11/duckdb:vortex-compact 18592323 18807638 0.99
tpch_q12/duckdb:vortex-compact 29678321 30239424 0.98
tpch_q13/duckdb:vortex-compact 44155860 45003004 0.98
tpch_q14/duckdb:vortex-compact 26718033 26344789 1.01
tpch_q15/duckdb:vortex-compact 20004180 20881357 0.96
tpch_q16/duckdb:vortex-compact 32575393 32049489 1.02
tpch_q17/duckdb:vortex-compact 30332528 28971138 1.05
tpch_q18/duckdb:vortex-compact 53000490 52643120 1.01
tpch_q19/duckdb:vortex-compact 32555614 34046024 0.96
tpch_q20/duckdb:vortex-compact 40588974 41114626 0.99
tpch_q21/duckdb:vortex-compact 102262672 104153919 0.98
tpch_q22/duckdb:vortex-compact 18332708 18900603 0.97
duckdb / parquet (0.971x ➖, 4↑ 1↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78297958 80036628 0.98
tpch_q02/duckdb:parquet 38525169 39713191 0.97
tpch_q03/duckdb:parquet 70145647 70816913 0.99
tpch_q04/duckdb:parquet 🚀 49371019 59227173 0.83
tpch_q05/duckdb:parquet 67976664 68734832 0.99
tpch_q06/duckdb:parquet 22025263 22473824 0.98
tpch_q07/duckdb:parquet 83990460 84190417 1.00
tpch_q08/duckdb:parquet 🚀 82208977 91394129 0.90
tpch_q09/duckdb:parquet 🚀 133764903 149742557 0.89
tpch_q10/duckdb:parquet 125865504 127913193 0.98
tpch_q11/duckdb:parquet 22117688 22492936 0.98
tpch_q12/duckdb:parquet 46538238 47985880 0.97
tpch_q13/duckdb:parquet 250830037 251903631 1.00
tpch_q14/duckdb:parquet 50392076 50934502 0.99
tpch_q15/duckdb:parquet 🚨 31481425 25807303 1.22
tpch_q16/duckdb:parquet 57491441 58246499 0.99
tpch_q17/duckdb:parquet 56970382 58449051 0.97
tpch_q18/duckdb:parquet 122105384 119363423 1.02
tpch_q19/duckdb:parquet 🚀 68779966 87309614 0.79
tpch_q20/duckdb:parquet 64943059 65364885 0.99
tpch_q21/duckdb:parquet 175768705 179993443 0.98
tpch_q22/duckdb:parquet 53548854 53181676 1.01
duckdb / duckdb (0.987x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17574952 17787194 0.99
tpch_q02/duckdb:duckdb 14318485 14678994 0.98
tpch_q03/duckdb:duckdb 22636347 22906738 0.99
tpch_q04/duckdb:duckdb 22571849 21322600 1.06
tpch_q05/duckdb:duckdb 23871298 23413919 1.02
tpch_q06/duckdb:duckdb 7109453 7129206 1.00
tpch_q07/duckdb:duckdb 25217402 26077577 0.97
tpch_q08/duckdb:duckdb 24087974 24586987 0.98
tpch_q09/duckdb:duckdb 57313888 59310405 0.97
tpch_q10/duckdb:duckdb 50058892 51860127 0.97
tpch_q11/duckdb:duckdb 7079971 7384569 0.96
tpch_q12/duckdb:duckdb 17881897 18091439 0.99
tpch_q13/duckdb:duckdb 39406281 39701668 0.99
tpch_q14/duckdb:duckdb 21101475 21769412 0.97
tpch_q15/duckdb:duckdb 13650362 13582432 1.01
tpch_q16/duckdb:duckdb 25874930 26783062 0.97
tpch_q17/duckdb:duckdb 16098883 16258606 0.99
tpch_q18/duckdb:duckdb 40796963 41320821 0.99
tpch_q19/duckdb:duckdb 30724821 31022914 0.99
tpch_q20/duckdb:duckdb 25153105 25573459 0.98
tpch_q21/duckdb:duckdb 60871368 61734801 0.99
tpch_q22/duckdb:duckdb 25497208 25494478 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.2% -5.0% -3.4% +22.0% ➖ noise
1 datafusion:vortex-compact -0.4% -5.0% +4.8% +22.0% ➖ noise
1 datafusion:vortex-file-compressed +1.7% -5.0% +7.0% +22.0% ➖ noise
1 duckdb:duckdb -1.2% -5.0% +4.0% +22.0% ➖ noise
1 duckdb:vortex-compact +0.8% -5.0% +6.1% +22.0% ➖ noise
1 duckdb:vortex-file-compressed -1.3% -5.0% +3.9% +22.0% ➖ noise
2 datafusion:arrow -13.9% -2.4% -11.8% +22.0% ➖ noise
2 datafusion:vortex-compact -0.1% -2.4% +2.4% +22.0% ➖ noise
2 datafusion:vortex-file-compressed +1.4% -2.4% +3.9% +22.0% ➖ noise
2 duckdb:duckdb -2.5% -2.4% -0.0% +22.0% ➖ noise
2 duckdb:vortex-compact +3.7% -2.4% +6.2% +22.0% ➖ noise
2 duckdb:vortex-file-compressed -1.2% -2.4% +1.2% +22.0% ➖ noise
3 datafusion:arrow +1.5% +5.6% -3.9% +22.0% ➖ noise
3 datafusion:vortex-compact +14.5% +5.6% +8.3% +22.0% ➖ noise
3 datafusion:vortex-file-compressed +10.5% +5.6% +4.6% +22.0% ➖ noise
3 duckdb:duckdb -1.2% +5.6% -6.5% +22.0% ➖ noise
3 duckdb:vortex-compact -4.2% +5.6% -9.3% +22.0% ➖ noise
3 duckdb:vortex-file-compressed -0.2% +5.6% -5.5% +22.0% ➖ noise
4 datafusion:arrow +1.2% -5.5% +7.1% +22.0% ➖ noise
4 datafusion:vortex-compact +1.2% -5.5% +7.1% +22.0% ➖ noise
4 datafusion:vortex-file-compressed +0.4% -5.5% +6.2% +22.0% ➖ noise
4 duckdb:duckdb +5.9% -5.5% +12.0% +22.0% ➖ noise
4 duckdb:vortex-compact -0.9% -5.5% +4.9% +22.0% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -5.5% +6.1% +22.0% ➖ noise
5 datafusion:arrow -19.6% -3.3% -16.8% +22.0% ➖ noise
5 datafusion:vortex-compact -6.6% -3.3% -3.4% +22.0% ➖ noise
5 datafusion:vortex-file-compressed -6.6% -3.3% -3.4% +22.0% ➖ noise
5 duckdb:duckdb +2.0% -3.3% +5.4% +22.0% ➖ noise
5 duckdb:vortex-compact -4.1% -3.3% -0.8% +22.0% ➖ noise
5 duckdb:vortex-file-compressed -2.3% -3.3% +1.1% +22.0% ➖ noise
6 datafusion:arrow +17.6% -12.8% +34.9% +22.0% 🚨 regression
6 datafusion:vortex-compact +2.3% -12.8% +17.3% +22.0% ➖ noise
6 datafusion:vortex-file-compressed +1.5% -12.8% +16.4% +22.0% ➖ noise
6 duckdb:duckdb -0.3% -12.8% +14.4% +22.0% ➖ noise
6 duckdb:vortex-compact +3.0% -12.8% +18.1% +22.0% ➖ noise
6 duckdb:vortex-file-compressed -3.4% -12.8% +10.8% +22.0% ➖ noise
7 datafusion:arrow +1.6% -1.0% +2.7% +22.0% ➖ noise
7 datafusion:vortex-compact -6.4% -1.0% -5.5% +22.0% ➖ noise
7 datafusion:vortex-file-compressed -3.3% -1.0% -2.3% +22.0% ➖ noise
7 duckdb:duckdb -3.3% -1.0% -2.3% +22.0% ➖ noise
7 duckdb:vortex-compact -2.2% -1.0% -1.2% +22.0% ➖ noise
7 duckdb:vortex-file-compressed -4.4% -1.0% -3.4% +22.0% ➖ noise
8 datafusion:arrow +3.6% -5.5% +9.7% +22.0% ➖ noise
8 datafusion:vortex-compact -2.5% -5.5% +3.3% +22.0% ➖ noise
8 datafusion:vortex-file-compressed +0.2% -5.5% +6.1% +22.0% ➖ noise
8 duckdb:duckdb -2.0% -5.5% +3.7% +22.0% ➖ noise
8 duckdb:vortex-compact -2.3% -5.5% +3.5% +22.0% ➖ noise
8 duckdb:vortex-file-compressed -0.1% -5.5% +5.8% +22.0% ➖ noise
9 datafusion:arrow -8.3% -9.4% +1.2% +22.0% ➖ noise
9 datafusion:vortex-compact -1.1% -9.4% +9.1% +22.0% ➖ noise
9 datafusion:vortex-file-compressed -2.6% -9.4% +7.5% +22.0% ➖ noise
9 duckdb:duckdb -3.4% -9.4% +6.6% +22.0% ➖ noise
9 duckdb:vortex-compact -5.9% -9.4% +3.9% +22.0% ➖ noise
9 duckdb:vortex-file-compressed -2.2% -9.4% +8.0% +22.0% ➖ noise
10 datafusion:arrow -7.0% +1.0% -7.9% +22.0% ➖ noise
10 datafusion:vortex-compact -16.0% +1.0% -16.9% +22.0% ➖ noise
10 datafusion:vortex-file-compressed -13.4% +1.0% -14.3% +22.0% ➖ noise
10 duckdb:duckdb -3.5% +1.0% -4.5% +22.0% ➖ noise
10 duckdb:vortex-compact -3.4% +1.0% -4.4% +22.0% ➖ noise
10 duckdb:vortex-file-compressed -1.6% +1.0% -2.6% +22.0% ➖ noise
11 datafusion:arrow -15.9% -3.8% -12.6% +22.0% ➖ noise
11 datafusion:vortex-compact +1.0% -3.8% +5.0% +22.0% ➖ noise
11 datafusion:vortex-file-compressed -0.3% -3.8% +3.6% +22.0% ➖ noise
11 duckdb:duckdb -4.1% -3.8% -0.3% +22.0% ➖ noise
11 duckdb:vortex-compact -1.1% -3.8% +2.8% +22.0% ➖ noise
11 duckdb:vortex-file-compressed -3.7% -3.8% +0.1% +22.0% ➖ noise
12 datafusion:arrow -9.9% -8.6% -1.5% +32.2% ➖ noise
12 datafusion:vortex-compact -2.3% -8.6% +6.8% +22.0% ➖ noise
12 datafusion:vortex-file-compressed -1.0% -8.6% +8.3% +22.0% ➖ noise
12 duckdb:duckdb -1.2% -8.6% +8.1% +22.0% ➖ noise
12 duckdb:vortex-compact -1.9% -8.6% +7.3% +22.0% ➖ noise
12 duckdb:vortex-file-compressed -3.1% -8.6% +5.9% +22.0% ➖ noise
13 datafusion:arrow -6.5% -5.3% -1.3% +22.0% ➖ noise
13 datafusion:vortex-compact -0.7% -5.3% +4.8% +22.0% ➖ noise
13 datafusion:vortex-file-compressed +0.2% -5.3% +5.8% +22.0% ➖ noise
13 duckdb:duckdb -0.7% -5.3% +4.8% +22.0% ➖ noise
13 duckdb:vortex-compact -1.9% -5.3% +3.6% +22.0% ➖ noise
13 duckdb:vortex-file-compressed -0.4% -5.3% +5.2% +22.0% ➖ noise
14 datafusion:arrow +3.9% -6.1% +10.6% +22.0% ➖ noise
14 datafusion:vortex-compact -2.2% -6.1% +4.1% +22.0% ➖ noise
14 datafusion:vortex-file-compressed -4.1% -6.1% +2.1% +22.0% ➖ noise
14 duckdb:duckdb -3.1% -6.1% +3.2% +22.0% ➖ noise
14 duckdb:vortex-compact +1.4% -6.1% +8.0% +22.0% ➖ noise
14 duckdb:vortex-file-compressed -6.0% -6.1% +0.1% +22.0% ➖ noise
15 datafusion:arrow +1.7% +9.2% -6.8% +22.0% ➖ noise
15 datafusion:vortex-compact -4.3% +9.2% -12.3% +22.0% ➖ noise
15 datafusion:vortex-file-compressed -3.3% +9.2% -11.4% +22.0% ➖ noise
15 duckdb:duckdb +0.5% +9.2% -7.9% +22.0% ➖ noise
15 duckdb:vortex-compact -4.2% +9.2% -12.2% +22.0% ➖ noise
15 duckdb:vortex-file-compressed -1.9% +9.2% -10.1% +22.0% ➖ noise
16 datafusion:arrow -14.1% -1.6% -12.7% +22.0% ➖ noise
16 datafusion:vortex-compact +0.3% -1.6% +1.9% +22.0% ➖ noise
16 datafusion:vortex-file-compressed -3.7% -1.6% -2.1% +22.0% ➖ noise
16 duckdb:duckdb -3.4% -1.6% -1.8% +22.0% ➖ noise
16 duckdb:vortex-compact +1.6% -1.6% +3.3% +22.0% ➖ noise
16 duckdb:vortex-file-compressed -5.6% -1.6% -4.1% +22.0% ➖ noise
17 datafusion:arrow -4.4% +2.5% -6.7% +22.0% ➖ noise
17 datafusion:vortex-compact -4.4% +2.5% -6.7% +22.0% ➖ noise
17 datafusion:vortex-file-compressed -3.7% +2.5% -6.0% +22.0% ➖ noise
17 duckdb:duckdb -1.0% +2.5% -3.4% +22.0% ➖ noise
17 duckdb:vortex-compact +4.7% +2.5% +2.2% +22.0% ➖ noise
17 duckdb:vortex-file-compressed -2.9% +2.5% -5.3% +22.0% ➖ noise
18 datafusion:arrow -23.8% -3.0% -21.4% +22.0% ✅ faster
18 datafusion:vortex-compact -8.5% -3.0% -5.7% +22.0% ➖ noise
18 datafusion:vortex-file-compressed -13.6% -3.0% -10.9% +22.0% ➖ noise
18 duckdb:duckdb -1.3% -3.0% +1.7% +22.0% ➖ noise
18 duckdb:vortex-compact +0.7% -3.0% +3.7% +22.0% ➖ noise
18 duckdb:vortex-file-compressed -2.9% -3.0% +0.1% +22.0% ➖ noise
19 datafusion:arrow +3.1% -20.1% +29.0% +22.0% 🚨 regression
19 datafusion:vortex-compact +31.5% -20.1% +64.5% +22.0% 🚨 regression
19 datafusion:vortex-file-compressed +4.8% -20.1% +31.0% +22.0% 🚨 regression
19 duckdb:duckdb -1.0% -20.1% +23.9% +22.0% 🚨 regression
19 duckdb:vortex-compact -4.4% -20.1% +19.6% +22.0% ➖ noise
19 duckdb:vortex-file-compressed -2.2% -20.1% +22.3% +22.0% 🚨 regression
20 datafusion:arrow +2.2% +1.6% +0.6% +22.0% ➖ noise
20 datafusion:vortex-compact +1.9% +1.6% +0.3% +22.0% ➖ noise
20 datafusion:vortex-file-compressed +1.6% +1.6% -0.0% +22.0% ➖ noise
20 duckdb:duckdb -1.6% +1.6% -3.2% +22.0% ➖ noise
20 duckdb:vortex-compact -1.3% +1.6% -2.8% +22.0% ➖ noise
20 duckdb:vortex-file-compressed -3.0% +1.6% -4.5% +22.0% ➖ noise
21 datafusion:arrow +2.7% +0.1% +2.6% +22.0% ➖ noise
21 datafusion:vortex-compact -3.1% +0.1% -3.2% +22.0% ➖ noise
21 datafusion:vortex-file-compressed -2.1% +0.1% -2.2% +22.0% ➖ noise
21 duckdb:duckdb -1.4% +0.1% -1.5% +22.0% ➖ noise
21 duckdb:vortex-compact -1.8% +0.1% -1.9% +22.0% ➖ noise
21 duckdb:vortex-file-compressed -0.8% +0.1% -0.8% +22.0% ➖ noise
22 datafusion:arrow -32.3% +17.1% -42.2% +22.0% ✅ faster
22 datafusion:vortex-compact +3.7% +17.1% -11.4% +22.0% ➖ noise
22 datafusion:vortex-file-compressed +0.3% +17.1% -14.4% +22.0% ➖ noise
22 duckdb:duckdb +0.0% +17.1% -14.6% +22.0% ➖ noise
22 duckdb:vortex-compact -3.0% +17.1% -17.2% +22.0% ➖ noise
22 duckdb:vortex-file-compressed -3.6% +17.1% -17.7% +22.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.7%
Vortex (geomean): 0.975x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.9%


datafusion / vortex-file-compressed (0.998x ➖, 7↑ 6↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25646999 24914939 1.03
tpcds_q02/datafusion:vortex-file-compressed 47956048 46464994 1.03
tpcds_q03/datafusion:vortex-file-compressed 🚨 16909150 15199906 1.11
tpcds_q04/datafusion:vortex-file-compressed 259068813 257819403 1.00
tpcds_q05/datafusion:vortex-file-compressed 43795233 42499517 1.03
tpcds_q06/datafusion:vortex-file-compressed 🚀 23762541 59684997 0.40
tpcds_q07/datafusion:vortex-file-compressed 🚀 39898461 44517378 0.90
tpcds_q08/datafusion:vortex-file-compressed 30454654 28568127 1.07
tpcds_q09/datafusion:vortex-file-compressed 🚀 34123970 38484022 0.89
tpcds_q10/datafusion:vortex-file-compressed 40016788 39025898 1.03
tpcds_q11/datafusion:vortex-file-compressed 132154935 135690226 0.97
tpcds_q12/datafusion:vortex-file-compressed 19903601 20172414 0.99
tpcds_q13/datafusion:vortex-file-compressed 40028599 39315109 1.02
tpcds_q14/datafusion:vortex-file-compressed 163769518 169971503 0.96
tpcds_q15/datafusion:vortex-file-compressed 26354243 27804480 0.95
tpcds_q16/datafusion:vortex-file-compressed 25291937 28067809 0.90
tpcds_q17/datafusion:vortex-file-compressed 61910417 64162962 0.96
tpcds_q18/datafusion:vortex-file-compressed 64941674 69569281 0.93
tpcds_q19/datafusion:vortex-file-compressed 22583659 22041984 1.02
tpcds_q20/datafusion:vortex-file-compressed 21735909 20404860 1.07
tpcds_q21/datafusion:vortex-file-compressed 36577462 34256584 1.07
tpcds_q22/datafusion:vortex-file-compressed 🚨 155109655 111686524 1.39
tpcds_q23/datafusion:vortex-file-compressed 157082398 147849549 1.06
tpcds_q24/datafusion:vortex-file-compressed 82676792 81905697 1.01
tpcds_q25/datafusion:vortex-file-compressed 64404770 66990321 0.96
tpcds_q26/datafusion:vortex-file-compressed 35798364 32997975 1.08
tpcds_q27/datafusion:vortex-file-compressed 94354256 103944321 0.91
tpcds_q28/datafusion:vortex-file-compressed 34420412 34280245 1.00
tpcds_q29/datafusion:vortex-file-compressed 62705494 61588856 1.02
tpcds_q30/datafusion:vortex-file-compressed 🚨 24785157 22523511 1.10
tpcds_q31/datafusion:vortex-file-compressed 77268737 73108313 1.06
tpcds_q32/datafusion:vortex-file-compressed 20298583 19766259 1.03
tpcds_q33/datafusion:vortex-file-compressed 29473333 29451433 1.00
tpcds_q34/datafusion:vortex-file-compressed 26037106 24070253 1.08
tpcds_q35/datafusion:vortex-file-compressed 46563484 45426859 1.03
tpcds_q36/datafusion:vortex-file-compressed 57485913 56958729 1.01
tpcds_q37/datafusion:vortex-file-compressed 🚀 21201180 23595749 0.90
tpcds_q38/datafusion:vortex-file-compressed 44189959 42552907 1.04
tpcds_q39/datafusion:vortex-file-compressed 106623830 103377060 1.03
tpcds_q40/datafusion:vortex-file-compressed 30088629 32300233 0.93
tpcds_q41/datafusion:vortex-file-compressed 15848097 15156276 1.05
tpcds_q42/datafusion:vortex-file-compressed 14002304 13614102 1.03
tpcds_q43/datafusion:vortex-file-compressed 18490636 18873295 0.98
tpcds_q44/datafusion:vortex-file-compressed 🚀 31050522 34754096 0.89
tpcds_q45/datafusion:vortex-file-compressed 26820939 27514962 0.97
tpcds_q46/datafusion:vortex-file-compressed 33925332 33518283 1.01
tpcds_q47/datafusion:vortex-file-compressed 133041728 130272649 1.02
tpcds_q48/datafusion:vortex-file-compressed 35551155 35434544 1.00
tpcds_q49/datafusion:vortex-file-compressed 56864784 55921497 1.02
tpcds_q50/datafusion:vortex-file-compressed 38593890 39105047 0.99
tpcds_q51/datafusion:vortex-file-compressed 90000936 86540982 1.04
tpcds_q52/datafusion:vortex-file-compressed 14865094 13872574 1.07
tpcds_q53/datafusion:vortex-file-compressed 22159879 20933502 1.06
tpcds_q54/datafusion:vortex-file-compressed 34382444 34560530 0.99
tpcds_q55/datafusion:vortex-file-compressed 13999920 13304250 1.05
tpcds_q56/datafusion:vortex-file-compressed 29212018 29872228 0.98
tpcds_q57/datafusion:vortex-file-compressed 109378638 109875152 1.00
tpcds_q58/datafusion:vortex-file-compressed 56520695 54192470 1.04
tpcds_q59/datafusion:vortex-file-compressed 58497548 55943319 1.05
tpcds_q60/datafusion:vortex-file-compressed 29914046 28956219 1.03
tpcds_q61/datafusion:vortex-file-compressed 40518687 43356798 0.93
tpcds_q62/datafusion:vortex-file-compressed 24670183 23035997 1.07
tpcds_q63/datafusion:vortex-file-compressed 22515587 21436940 1.05
tpcds_q64/datafusion:vortex-file-compressed 380624222 419502985 0.91
tpcds_q65/datafusion:vortex-file-compressed 🚨 51321049 40768935 1.26
tpcds_q66/datafusion:vortex-file-compressed 74715186 74588718 1.00
tpcds_q67/datafusion:vortex-file-compressed 152044436 147127754 1.03
tpcds_q68/datafusion:vortex-file-compressed 33462146 34794812 0.96
tpcds_q69/datafusion:vortex-file-compressed 38688715 36578994 1.06
tpcds_q70/datafusion:vortex-file-compressed 🚨 100030152 84275706 1.19
tpcds_q71/datafusion:vortex-file-compressed 23683568 23585950 1.00
tpcds_q72/datafusion:vortex-file-compressed 2095622247 2133737505 0.98
tpcds_q73/datafusion:vortex-file-compressed 23897993 22916308 1.04
tpcds_q74/datafusion:vortex-file-compressed 81453452 86994644 0.94
tpcds_q75/datafusion:vortex-file-compressed 108217654 107947611 1.00
tpcds_q76/datafusion:vortex-file-compressed 24910067 24863482 1.00
tpcds_q77/datafusion:vortex-file-compressed 37397985 40474373 0.92
tpcds_q78/datafusion:vortex-file-compressed 🚀 113712271 127085216 0.89
tpcds_q79/datafusion:vortex-file-compressed 28726947 29387991 0.98
tpcds_q80/datafusion:vortex-file-compressed 89168854 97614133 0.91
tpcds_q81/datafusion:vortex-file-compressed 25160247 23723603 1.06
tpcds_q82/datafusion:vortex-file-compressed 🚀 22024184 26229546 0.84
tpcds_q83/datafusion:vortex-file-compressed 36069724 33725871 1.07
tpcds_q84/datafusion:vortex-file-compressed 13000581 12658731 1.03
tpcds_q85/datafusion:vortex-file-compressed 88305868 90205007 0.98
tpcds_q86/datafusion:vortex-file-compressed 17433401 17620147 0.99
tpcds_q87/datafusion:vortex-file-compressed 45467345 44364927 1.02
tpcds_q88/datafusion:vortex-file-compressed 55919578 55852797 1.00
tpcds_q89/datafusion:vortex-file-compressed 24653240 25594626 0.96
tpcds_q90/datafusion:vortex-file-compressed 14472495 15231013 0.95
tpcds_q91/datafusion:vortex-file-compressed 18283365 18238758 1.00
tpcds_q92/datafusion:vortex-file-compressed 18322529 18167872 1.01
tpcds_q93/datafusion:vortex-file-compressed 33554726 33250457 1.01
tpcds_q94/datafusion:vortex-file-compressed 22419436 23510601 0.95
tpcds_q95/datafusion:vortex-file-compressed 58951585 61194336 0.96
tpcds_q96/datafusion:vortex-file-compressed 13385953 13999464 0.96
tpcds_q97/datafusion:vortex-file-compressed 30668719 30737469 1.00
tpcds_q98/datafusion:vortex-file-compressed 24941187 24495058 1.02
tpcds_q99/datafusion:vortex-file-compressed 🚨 33241305 28924601 1.15
datafusion / vortex-compact (0.943x ➖, 21↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27227657 25853034 1.05
tpcds_q02/datafusion:vortex-compact 54526552 54130585 1.01
tpcds_q03/datafusion:vortex-compact 20016042 20053814 1.00
tpcds_q04/datafusion:vortex-compact 305322680 323324791 0.94
tpcds_q05/datafusion:vortex-compact 🚀 46009571 54525844 0.84
tpcds_q06/datafusion:vortex-compact 🚀 27303475 63457802 0.43
tpcds_q07/datafusion:vortex-compact 🚀 53060501 61032670 0.87
tpcds_q08/datafusion:vortex-compact 37566683 38003371 0.99
tpcds_q09/datafusion:vortex-compact 🚀 49270158 57811177 0.85
tpcds_q10/datafusion:vortex-compact 50685453 53151659 0.95
tpcds_q11/datafusion:vortex-compact 153351833 167050657 0.92
tpcds_q12/datafusion:vortex-compact 26468668 28998910 0.91
tpcds_q13/datafusion:vortex-compact 🚨 152876136 128306556 1.19
tpcds_q14/datafusion:vortex-compact 🚀 190146733 222000754 0.86
tpcds_q15/datafusion:vortex-compact 🚀 28238275 34088059 0.83
tpcds_q16/datafusion:vortex-compact 🚀 29518016 35259304 0.84
tpcds_q17/datafusion:vortex-compact 🚀 72136271 81876576 0.88
tpcds_q18/datafusion:vortex-compact 🚀 75223407 87633926 0.86
tpcds_q19/datafusion:vortex-compact 30481046 32182505 0.95
tpcds_q20/datafusion:vortex-compact 26085562 28586959 0.91
tpcds_q21/datafusion:vortex-compact 🚀 40009506 45351737 0.88
tpcds_q22/datafusion:vortex-compact 125600592 133841487 0.94
tpcds_q23/datafusion:vortex-compact 166390448 181417641 0.92
tpcds_q24/datafusion:vortex-compact 🚀 94434906 108013698 0.87
tpcds_q25/datafusion:vortex-compact 78046121 84404952 0.92
tpcds_q26/datafusion:vortex-compact 44711413 46467679 0.96
tpcds_q27/datafusion:vortex-compact 116942662 123129394 0.95
tpcds_q28/datafusion:vortex-compact 99792903 99336260 1.00
tpcds_q29/datafusion:vortex-compact 71819545 75132090 0.96
tpcds_q30/datafusion:vortex-compact 28933111 28241797 1.02
tpcds_q31/datafusion:vortex-compact 102228076 99546414 1.03
tpcds_q32/datafusion:vortex-compact 24750333 27341043 0.91
tpcds_q33/datafusion:vortex-compact 36115177 37678288 0.96
tpcds_q34/datafusion:vortex-compact 33455275 33918188 0.99
tpcds_q35/datafusion:vortex-compact 54843049 52231161 1.05
tpcds_q36/datafusion:vortex-compact 75594547 80275999 0.94
tpcds_q37/datafusion:vortex-compact 🚀 31041859 34884220 0.89
tpcds_q38/datafusion:vortex-compact 51887334 51506621 1.01
tpcds_q39/datafusion:vortex-compact 110379287 121793933 0.91
tpcds_q40/datafusion:vortex-compact 🚀 33938367 43160766 0.79
tpcds_q41/datafusion:vortex-compact 17420010 18763741 0.93
tpcds_q42/datafusion:vortex-compact 17798308 18633527 0.96
tpcds_q43/datafusion:vortex-compact 25896482 26329768 0.98
tpcds_q44/datafusion:vortex-compact 🚀 42769541 50548545 0.85
tpcds_q45/datafusion:vortex-compact 32506617 34883041 0.93
tpcds_q46/datafusion:vortex-compact 44315554 47245292 0.94
tpcds_q47/datafusion:vortex-compact 156020668 167907920 0.93
tpcds_q48/datafusion:vortex-compact 85167546 84649174 1.01
tpcds_q49/datafusion:vortex-compact 69258617 75283778 0.92
tpcds_q50/datafusion:vortex-compact 🚀 45359394 52389690 0.87
tpcds_q51/datafusion:vortex-compact 97323165 103750413 0.94
tpcds_q52/datafusion:vortex-compact 19533518 21152134 0.92
tpcds_q53/datafusion:vortex-compact 28635868 30664985 0.93
tpcds_q54/datafusion:vortex-compact 43233514 45433272 0.95
tpcds_q55/datafusion:vortex-compact 18298048 20060587 0.91
tpcds_q56/datafusion:vortex-compact 🚀 35209476 39927188 0.88
tpcds_q57/datafusion:vortex-compact 112929402 125280546 0.90
tpcds_q58/datafusion:vortex-compact 65167980 70561751 0.92
tpcds_q59/datafusion:vortex-compact 72643104 74727648 0.97
tpcds_q60/datafusion:vortex-compact 🚀 35433546 39468077 0.90
tpcds_q61/datafusion:vortex-compact 55109426 60312301 0.91
tpcds_q62/datafusion:vortex-compact 🚀 24500778 27964380 0.88
tpcds_q63/datafusion:vortex-compact 28650709 30843613 0.93
tpcds_q64/datafusion:vortex-compact 🚀 418688010 532400518 0.79
tpcds_q65/datafusion:vortex-compact 64535766 60854793 1.06
tpcds_q66/datafusion:vortex-compact 76007485 82521123 0.92
tpcds_q67/datafusion:vortex-compact 🚀 152065821 175581765 0.87
tpcds_q68/datafusion:vortex-compact 44813655 48506105 0.92
tpcds_q69/datafusion:vortex-compact 47658260 48200865 0.99
tpcds_q70/datafusion:vortex-compact 107105313 99602028 1.08
tpcds_q71/datafusion:vortex-compact 30498555 29238680 1.04
tpcds_q72/datafusion:vortex-compact 2050427830 2118053263 0.97
tpcds_q73/datafusion:vortex-compact 30253383 30662254 0.99
tpcds_q74/datafusion:vortex-compact 91807344 88886456 1.03
tpcds_q75/datafusion:vortex-compact 126810660 129435253 0.98
tpcds_q76/datafusion:vortex-compact 32588005 31851006 1.02
tpcds_q77/datafusion:vortex-compact 49907306 49391882 1.01
tpcds_q78/datafusion:vortex-compact 128229808 139076597 0.92
tpcds_q79/datafusion:vortex-compact 38590591 37352921 1.03
tpcds_q80/datafusion:vortex-compact 98720845 107469685 0.92
tpcds_q81/datafusion:vortex-compact 29456216 27952348 1.05
tpcds_q82/datafusion:vortex-compact 31423801 33911848 0.93
tpcds_q83/datafusion:vortex-compact 35537926 32801524 1.08
tpcds_q84/datafusion:vortex-compact 14844904 15338554 0.97
tpcds_q85/datafusion:vortex-compact 155885578 159609724 0.98
tpcds_q86/datafusion:vortex-compact 🚨 21878468 19543048 1.12
tpcds_q87/datafusion:vortex-compact 54295194 50116104 1.08
tpcds_q88/datafusion:vortex-compact 77671329 77869728 1.00
tpcds_q89/datafusion:vortex-compact 31380030 30822322 1.02
tpcds_q90/datafusion:vortex-compact 15136564 14363031 1.05
tpcds_q91/datafusion:vortex-compact 33267426 32717001 1.02
tpcds_q92/datafusion:vortex-compact 22944599 24247954 0.95
tpcds_q93/datafusion:vortex-compact 35694047 38325591 0.93
tpcds_q94/datafusion:vortex-compact 26006957 26663268 0.98
tpcds_q95/datafusion:vortex-compact 66150660 64488820 1.03
tpcds_q96/datafusion:vortex-compact 17493167 17621813 0.99
tpcds_q97/datafusion:vortex-compact 34867079 35297148 0.99
tpcds_q98/datafusion:vortex-compact 30115394 29492856 1.02
tpcds_q99/datafusion:vortex-compact 🚀 30458435 34388901 0.89
datafusion / parquet (0.990x ➖, 10↑ 10↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 24404998 32342306 0.75
tpcds_q02/datafusion:parquet 42884990 41839159 1.02
tpcds_q03/datafusion:parquet 13381575 12927024 1.04
tpcds_q04/datafusion:parquet 291027657 274899202 1.06
tpcds_q05/datafusion:parquet 🚨 48178355 41736976 1.15
tpcds_q06/datafusion:parquet 🚀 24286552 59105525 0.41
tpcds_q07/datafusion:parquet 79375470 76530608 1.04
tpcds_q08/datafusion:parquet 🚨 29598910 26902947 1.10
tpcds_q09/datafusion:parquet 41505184 45120483 0.92
tpcds_q10/datafusion:parquet 🚨 76000284 68231340 1.11
tpcds_q11/datafusion:parquet 146393571 150655209 0.97
tpcds_q12/datafusion:parquet 19632876 18266599 1.07
tpcds_q13/datafusion:parquet 76316499 75076161 1.02
tpcds_q14/datafusion:parquet 161011995 165002498 0.98
tpcds_q15/datafusion:parquet 21314287 21601616 0.99
tpcds_q16/datafusion:parquet 29089956 26952757 1.08
tpcds_q17/datafusion:parquet 62042679 66131451 0.94
tpcds_q18/datafusion:parquet 110883505 114496268 0.97
tpcds_q19/datafusion:parquet 23629431 22514873 1.05
tpcds_q20/datafusion:parquet 16989002 17213517 0.99
tpcds_q21/datafusion:parquet 19311948 18655230 1.04
tpcds_q22/datafusion:parquet 165986524 151252574 1.10
tpcds_q23/datafusion:parquet 151757331 145423945 1.04
tpcds_q24/datafusion:parquet 89320110 91961029 0.97
tpcds_q25/datafusion:parquet 63741495 63529867 1.00
tpcds_q26/datafusion:parquet 63546602 66024173 0.96
tpcds_q27/datafusion:parquet 136698585 143312588 0.95
tpcds_q28/datafusion:parquet 45136832 44654256 1.01
tpcds_q29/datafusion:parquet 63525981 64456064 0.99
tpcds_q30/datafusion:parquet 34489106 33857561 1.02
tpcds_q31/datafusion:parquet 67122772 63725709 1.05
tpcds_q32/datafusion:parquet 18418352 17826964 1.03
tpcds_q33/datafusion:parquet 28378962 26815058 1.06
tpcds_q34/datafusion:parquet 22473751 21261051 1.06
tpcds_q35/datafusion:parquet 71491261 66454225 1.08
tpcds_q36/datafusion:parquet 58005444 55785143 1.04
tpcds_q37/datafusion:parquet 19901727 18345836 1.08
tpcds_q38/datafusion:parquet 42618572 40071091 1.06
tpcds_q39/datafusion:parquet 75393266 73006165 1.03
tpcds_q40/datafusion:parquet 24095855 23004655 1.05
tpcds_q41/datafusion:parquet 🚨 15324135 12981060 1.18
tpcds_q42/datafusion:parquet 12226643 11637251 1.05
tpcds_q43/datafusion:parquet 17192905 16731866 1.03
tpcds_q44/datafusion:parquet 33003618 32424252 1.02
tpcds_q45/datafusion:parquet 26986606 27775655 0.97
tpcds_q46/datafusion:parquet 33085956 31956420 1.04
tpcds_q47/datafusion:parquet 128334417 122650861 1.05
tpcds_q48/datafusion:parquet 72467359 69434174 1.04
tpcds_q49/datafusion:parquet 56766577 55883001 1.02
tpcds_q50/datafusion:parquet 43432110 42893149 1.01
tpcds_q51/datafusion:parquet 85873956 83691245 1.03
tpcds_q52/datafusion:parquet 🚨 12854131 11628276 1.11
tpcds_q53/datafusion:parquet 18631568 17165346 1.09
tpcds_q54/datafusion:parquet 34564239 33533269 1.03
tpcds_q55/datafusion:parquet 11803584 11027005 1.07
tpcds_q56/datafusion:parquet 30128755 27499151 1.10
tpcds_q57/datafusion:parquet 105396033 104076874 1.01
tpcds_q58/datafusion:parquet 🚨 54084164 48815883 1.11
tpcds_q59/datafusion:parquet 🚨 63146089 56697670 1.11
tpcds_q60/datafusion:parquet 29407025 27732123 1.06
tpcds_q61/datafusion:parquet 43680558 43192524 1.01
tpcds_q62/datafusion:parquet 🚨 26616117 19561836 1.36
tpcds_q63/datafusion:parquet 18358001 17395501 1.06
tpcds_q64/datafusion:parquet 🚀 302099765 518547438 0.58
tpcds_q65/datafusion:parquet 38887494 40273329 0.97
tpcds_q66/datafusion:parquet 65773454 64824935 1.01
tpcds_q67/datafusion:parquet 145641574 145551622 1.00
tpcds_q68/datafusion:parquet 32619082 31583067 1.03
tpcds_q69/datafusion:parquet 68247952 67183399 1.02
tpcds_q70/datafusion:parquet 🚀 33507582 94462249 0.35
tpcds_q71/datafusion:parquet 23380330 24339809 0.96
tpcds_q72/datafusion:parquet 🚀 580624512 710850737 0.82
tpcds_q73/datafusion:parquet 20875609 23178553 0.90
tpcds_q74/datafusion:parquet 🚀 82933158 92845929 0.89
tpcds_q75/datafusion:parquet 102152110 109779875 0.93
tpcds_q76/datafusion:parquet 30975523 33118060 0.94
tpcds_q77/datafusion:parquet 40078109 43138407 0.93
tpcds_q78/datafusion:parquet 🚀 109964189 127743412 0.86
tpcds_q79/datafusion:parquet 26957192 28784998 0.94
tpcds_q80/datafusion:parquet 🚀 75168897 89040703 0.84
tpcds_q81/datafusion:parquet 🚀 30501336 34263526 0.89
tpcds_q82/datafusion:parquet 🚀 19264493 21850816 0.88
tpcds_q83/datafusion:parquet 41352290 40543045 1.02
tpcds_q84/datafusion:parquet 40704842 40883525 1.00
tpcds_q85/datafusion:parquet 146953766 160856940 0.91
tpcds_q86/datafusion:parquet 16858895 17081896 0.99
tpcds_q87/datafusion:parquet 44723612 42951650 1.04
tpcds_q88/datafusion:parquet 61973264 61950078 1.00
tpcds_q89/datafusion:parquet 23426357 21454883 1.09
tpcds_q90/datafusion:parquet 14542726 14416215 1.01
tpcds_q91/datafusion:parquet 59501643 56666758 1.05
tpcds_q92/datafusion:parquet 18133418 17149624 1.06
tpcds_q93/datafusion:parquet 29383575 32254341 0.91
tpcds_q94/datafusion:parquet 🚨 21400913 18961771 1.13
tpcds_q95/datafusion:parquet 62138049 58923895 1.05
tpcds_q96/datafusion:parquet 12800813 11728159 1.09
tpcds_q97/datafusion:parquet 31595044 29950794 1.05
tpcds_q98/datafusion:parquet 21223779 20348616 1.04
tpcds_q99/datafusion:parquet 🚨 28327912 25428069 1.11
duckdb / vortex-file-compressed (0.962x ➖, 21↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25532088 24889351 1.03
tpcds_q02/duckdb:vortex-file-compressed 34443527 35962352 0.96
tpcds_q03/duckdb:vortex-file-compressed 27091355 26759037 1.01
tpcds_q04/duckdb:vortex-file-compressed 97191775 98616817 0.99
tpcds_q05/duckdb:vortex-file-compressed 34789844 32493356 1.07
tpcds_q06/duckdb:vortex-file-compressed 34223784 34528311 0.99
tpcds_q07/duckdb:vortex-file-compressed 22036552 22052180 1.00
tpcds_q08/duckdb:vortex-file-compressed 28475240 26675734 1.07
tpcds_q09/duckdb:vortex-file-compressed 15636701 16366592 0.96
tpcds_q10/duckdb:vortex-file-compressed 37909846 37541179 1.01
tpcds_q11/duckdb:vortex-file-compressed 67620625 63916773 1.06
tpcds_q12/duckdb:vortex-file-compressed 17173051 16411916 1.05
tpcds_q13/duckdb:vortex-file-compressed 33608788 33761327 1.00
tpcds_q14/duckdb:vortex-file-compressed 97938253 97229239 1.01
tpcds_q15/duckdb:vortex-file-compressed 27111987 27386555 0.99
tpcds_q16/duckdb:vortex-file-compressed 28248275 26476511 1.07
tpcds_q17/duckdb:vortex-file-compressed 46434659 47079054 0.99
tpcds_q18/duckdb:vortex-file-compressed 37749959 37381030 1.01
tpcds_q19/duckdb:vortex-file-compressed 33196522 32726110 1.01
tpcds_q20/duckdb:vortex-file-compressed 17804581 16495916 1.08
tpcds_q21/duckdb:vortex-file-compressed 16717753 16241242 1.03
tpcds_q22/duckdb:vortex-file-compressed 74925025 74396456 1.01
tpcds_q23/duckdb:vortex-file-compressed 113060648 108438750 1.04
tpcds_q24/duckdb:vortex-file-compressed 48804143 48740604 1.00
tpcds_q25/duckdb:vortex-file-compressed 51676228 51752245 1.00
tpcds_q26/duckdb:vortex-file-compressed 18848827 19247190 0.98
tpcds_q27/duckdb:vortex-file-compressed 23224977 23576906 0.99
tpcds_q28/duckdb:vortex-file-compressed 12704216 13372401 0.95
tpcds_q29/duckdb:vortex-file-compressed 44844133 42873355 1.05
tpcds_q30/duckdb:vortex-file-compressed 26442463 25159005 1.05
tpcds_q31/duckdb:vortex-file-compressed 28540896 28880042 0.99
tpcds_q32/duckdb:vortex-file-compressed 13796023 14075647 0.98
tpcds_q33/duckdb:vortex-file-compressed 24127517 24077773 1.00
tpcds_q34/duckdb:vortex-file-compressed 24486407 25237895 0.97
tpcds_q35/duckdb:vortex-file-compressed 65577967 65762537 1.00
tpcds_q36/duckdb:vortex-file-compressed 24402462 25017817 0.98
tpcds_q37/duckdb:vortex-file-compressed 20803068 19925936 1.04
tpcds_q38/duckdb:vortex-file-compressed 38273283 37272094 1.03
tpcds_q39/duckdb:vortex-file-compressed 36452708 35836093 1.02
tpcds_q40/duckdb:vortex-file-compressed 20530948 19258368 1.07
tpcds_q41/duckdb:vortex-file-compressed 10463740 10174641 1.03
tpcds_q42/duckdb:vortex-file-compressed 12866401 12968101 0.99
tpcds_q43/duckdb:vortex-file-compressed 21976818 21297426 1.03
tpcds_q44/duckdb:vortex-file-compressed 21564711 21273194 1.01
tpcds_q45/duckdb:vortex-file-compressed 30553366 29104738 1.05
tpcds_q46/duckdb:vortex-file-compressed 32424649 31442483 1.03
tpcds_q47/duckdb:vortex-file-compressed 🚀 54163803 60836213 0.89
tpcds_q48/duckdb:vortex-file-compressed 31198253 32872847 0.95
tpcds_q49/duckdb:vortex-file-compressed 35109001 36797052 0.95
tpcds_q50/duckdb:vortex-file-compressed 31199678 34159338 0.91
tpcds_q51/duckdb:vortex-file-compressed 106890790 113601915 0.94
tpcds_q52/duckdb:vortex-file-compressed 🚀 12863574 14702356 0.87
tpcds_q53/duckdb:vortex-file-compressed 🚀 21981746 24654925 0.89
tpcds_q54/duckdb:vortex-file-compressed 🚀 28515602 32833206 0.87
tpcds_q55/duckdb:vortex-file-compressed 13733817 14550335 0.94
tpcds_q56/duckdb:vortex-file-compressed 25998061 27950578 0.93
tpcds_q57/duckdb:vortex-file-compressed 43612947 47242691 0.92
tpcds_q58/duckdb:vortex-file-compressed 29748610 32247818 0.92
tpcds_q59/duckdb:vortex-file-compressed 68919333 70835266 0.97
tpcds_q60/duckdb:vortex-file-compressed 🚀 25554271 28741515 0.89
tpcds_q61/duckdb:vortex-file-compressed 🚀 30029922 35186738 0.85
tpcds_q62/duckdb:vortex-file-compressed 16352737 17504422 0.93
tpcds_q63/duckdb:vortex-file-compressed 🚀 20988454 24004907 0.87
tpcds_q64/duckdb:vortex-file-compressed 🚀 102883904 118105175 0.87
tpcds_q65/duckdb:vortex-file-compressed 22992242 25045354 0.92
tpcds_q66/duckdb:vortex-file-compressed 29174613 31852151 0.92
tpcds_q67/duckdb:vortex-file-compressed 🚀 139599859 167877982 0.83
tpcds_q68/duckdb:vortex-file-compressed 🚀 31732937 37247145 0.85
tpcds_q69/duckdb:vortex-file-compressed 🚀 41375288 50814940 0.81
tpcds_q70/duckdb:vortex-file-compressed 37389288 39652678 0.94
tpcds_q71/duckdb:vortex-file-compressed 🚀 20535734 23125121 0.89
tpcds_q72/duckdb:vortex-file-compressed 171723495 181139161 0.95
tpcds_q73/duckdb:vortex-file-compressed 🚀 25417031 29814590 0.85
tpcds_q74/duckdb:vortex-file-compressed 🚀 42583713 48179411 0.88
tpcds_q75/duckdb:vortex-file-compressed 🚀 49364679 56076093 0.88
tpcds_q76/duckdb:vortex-file-compressed 🚀 17797038 22432805 0.79
tpcds_q77/duckdb:vortex-file-compressed 26761723 27863177 0.96
tpcds_q78/duckdb:vortex-file-compressed 83574896 89642564 0.93
tpcds_q79/duckdb:vortex-file-compressed 🚀 25663572 28914339 0.89
tpcds_q80/duckdb:vortex-file-compressed 49236364 49657918 0.99
tpcds_q81/duckdb:vortex-file-compressed 30343198 30849302 0.98
tpcds_q82/duckdb:vortex-file-compressed 46765921 46522335 1.01
tpcds_q83/duckdb:vortex-file-compressed 28544762 28197677 1.01
tpcds_q84/duckdb:vortex-file-compressed 20238154 21910189 0.92
tpcds_q85/duckdb:vortex-file-compressed 48665242 48057365 1.01
tpcds_q86/duckdb:vortex-file-compressed 16963293 17080872 0.99
tpcds_q87/duckdb:vortex-file-compressed 41890462 41103681 1.02
tpcds_q88/duckdb:vortex-file-compressed 51820863 50521875 1.03
tpcds_q89/duckdb:vortex-file-compressed 22210349 22060863 1.01
tpcds_q90/duckdb:vortex-file-compressed 10703022 11431466 0.94
tpcds_q91/duckdb:vortex-file-compressed 25339742 27938667 0.91
tpcds_q92/duckdb:vortex-file-compressed 🚀 20076046 23662973 0.85
tpcds_q93/duckdb:vortex-file-compressed 30556968 31909288 0.96
tpcds_q94/duckdb:vortex-file-compressed 🚀 21585668 24126425 0.89
tpcds_q95/duckdb:vortex-file-compressed 🚀 149226504 171676865 0.87
tpcds_q96/duckdb:vortex-file-compressed 12945650 12931965 1.00
tpcds_q97/duckdb:vortex-file-compressed 🚀 39948917 46141822 0.87
tpcds_q98/duckdb:vortex-file-compressed 19755817 21709907 0.91
tpcds_q99/duckdb:vortex-file-compressed 27250556 28539325 0.95
duckdb / vortex-compact (0.999x ➖, 4↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 26805291 29856862 0.90
tpcds_q02/duckdb:vortex-compact 42755773 42424201 1.01
tpcds_q03/duckdb:vortex-compact 49160897 51578140 0.95
tpcds_q04/duckdb:vortex-compact 110261647 122390582 0.90
tpcds_q05/duckdb:vortex-compact 44851205 45457215 0.99
tpcds_q06/duckdb:vortex-compact 🚀 39803487 44527544 0.89
tpcds_q07/duckdb:vortex-compact 35798831 39176292 0.91
tpcds_q08/duckdb:vortex-compact 40111075 43057426 0.93
tpcds_q09/duckdb:vortex-compact 20173389 21393302 0.94
tpcds_q10/duckdb:vortex-compact 🚀 52770464 59718907 0.88
tpcds_q11/duckdb:vortex-compact 73053179 80493269 0.91
tpcds_q12/duckdb:vortex-compact 22189048 24409990 0.91
tpcds_q13/duckdb:vortex-compact 54393260 56138666 0.97
tpcds_q14/duckdb:vortex-compact 122655268 128604076 0.95
tpcds_q15/duckdb:vortex-compact 🚀 30231217 34228131 0.88
tpcds_q16/duckdb:vortex-compact 28261420 30061594 0.94
tpcds_q17/duckdb:vortex-compact 56467828 61529266 0.92
tpcds_q18/duckdb:vortex-compact 52179915 54941332 0.95
tpcds_q19/duckdb:vortex-compact 43932621 45422054 0.97
tpcds_q20/duckdb:vortex-compact 21792830 22187198 0.98
tpcds_q21/duckdb:vortex-compact 19554822 21084810 0.93
tpcds_q22/duckdb:vortex-compact 78896986 78888637 1.00
tpcds_q23/duckdb:vortex-compact 129851900 138637777 0.94
tpcds_q24/duckdb:vortex-compact 58143241 57920058 1.00
tpcds_q25/duckdb:vortex-compact 82371285 85518723 0.96
tpcds_q26/duckdb:vortex-compact 31936355 32263032 0.99
tpcds_q27/duckdb:vortex-compact 38146986 36167184 1.05
tpcds_q28/duckdb:vortex-compact 34589846 34793881 0.99
tpcds_q29/duckdb:vortex-compact 57691647 55124917 1.05
tpcds_q30/duckdb:vortex-compact 30767983 29477186 1.04
tpcds_q31/duckdb:vortex-compact 35611789 35822147 0.99
tpcds_q32/duckdb:vortex-compact 22643460 20623982 1.10
tpcds_q33/duckdb:vortex-compact 34294053 32018221 1.07
tpcds_q34/duckdb:vortex-compact 31702450 30727941 1.03
tpcds_q35/duckdb:vortex-compact 77761453 75909751 1.02
tpcds_q36/duckdb:vortex-compact 37411517 36062909 1.04
tpcds_q37/duckdb:vortex-compact 24122265 23152152 1.04
tpcds_q38/duckdb:vortex-compact 42353498 39769249 1.06
tpcds_q39/duckdb:vortex-compact 39199343 39823076 0.98
tpcds_q40/duckdb:vortex-compact 24206049 23601717 1.03
tpcds_q41/duckdb:vortex-compact 12347365 11835535 1.04
tpcds_q42/duckdb:vortex-compact 19441179 19516626 1.00
tpcds_q43/duckdb:vortex-compact 28650660 29816703 0.96
tpcds_q44/duckdb:vortex-compact 29782943 29736513 1.00
tpcds_q45/duckdb:vortex-compact 37017000 35599299 1.04
tpcds_q46/duckdb:vortex-compact 44638727 47066882 0.95
tpcds_q47/duckdb:vortex-compact 64197407 63632088 1.01
tpcds_q48/duckdb:vortex-compact 46754367 45889969 1.02
tpcds_q49/duckdb:vortex-compact 53112108 49404924 1.08
tpcds_q50/duckdb:vortex-compact 40458686 38546332 1.05
tpcds_q51/duckdb:vortex-compact 112471468 111854732 1.01
tpcds_q52/duckdb:vortex-compact 19836037 20383440 0.97
tpcds_q53/duckdb:vortex-compact 33379917 32947096 1.01
tpcds_q54/duckdb:vortex-compact 37369507 36172991 1.03
tpcds_q55/duckdb:vortex-compact 19354441 18379323 1.05
tpcds_q56/duckdb:vortex-compact 32281854 33211858 0.97
tpcds_q57/duckdb:vortex-compact 45701908 45665952 1.00
tpcds_q58/duckdb:vortex-compact 40005496 37033186 1.08
tpcds_q59/duckdb:vortex-compact 85518401 87850429 0.97
tpcds_q60/duckdb:vortex-compact 35334446 35179695 1.00
tpcds_q61/duckdb:vortex-compact 54872877 53108953 1.03
tpcds_q62/duckdb:vortex-compact 22060050 20592500 1.07
tpcds_q63/duckdb:vortex-compact 31783796 32210178 0.99
tpcds_q64/duckdb:vortex-compact 134431703 134592732 1.00
tpcds_q65/duckdb:vortex-compact 31964933 31681199 1.01
tpcds_q66/duckdb:vortex-compact 35828886 35366787 1.01
tpcds_q67/duckdb:vortex-compact 152746140 151154461 1.01
tpcds_q68/duckdb:vortex-compact 47742833 46392576 1.03
tpcds_q69/duckdb:vortex-compact 56401353 55144305 1.02
tpcds_q70/duckdb:vortex-compact 60394744 57643866 1.05
tpcds_q71/duckdb:vortex-compact 28570303 29061002 0.98
tpcds_q72/duckdb:vortex-compact 187530761 183757210 1.02
tpcds_q73/duckdb:vortex-compact 27864530 27978063 1.00
tpcds_q74/duckdb:vortex-compact 51077395 49874640 1.02
tpcds_q75/duckdb:vortex-compact 64231207 60050547 1.07
tpcds_q76/duckdb:vortex-compact 29683464 29557820 1.00
tpcds_q77/duckdb:vortex-compact 36898035 38674831 0.95
tpcds_q78/duckdb:vortex-compact 91074273 91169400 1.00
tpcds_q79/duckdb:vortex-compact 44087146 40980033 1.08
tpcds_q80/duckdb:vortex-compact 72350601 69438224 1.04
tpcds_q81/duckdb:vortex-compact 35198447 33224722 1.06
tpcds_q82/duckdb:vortex-compact 51527757 48942633 1.05
tpcds_q83/duckdb:vortex-compact 35662308 36836547 0.97
tpcds_q84/duckdb:vortex-compact 26670980 27515892 0.97
tpcds_q85/duckdb:vortex-compact 61869637 60155378 1.03
tpcds_q86/duckdb:vortex-compact 22380532 22064878 1.01
tpcds_q87/duckdb:vortex-compact 46714772 45986647 1.02
tpcds_q88/duckdb:vortex-compact 76285434 76916575 0.99
tpcds_q89/duckdb:vortex-compact 32608283 32683186 1.00
tpcds_q90/duckdb:vortex-compact 10834788 10791333 1.00
tpcds_q91/duckdb:vortex-compact 43699063 42799984 1.02
tpcds_q92/duckdb:vortex-compact 45224087 42530674 1.06
tpcds_q93/duckdb:vortex-compact 33293168 32556200 1.02
tpcds_q94/duckdb:vortex-compact 27942982 26649083 1.05
tpcds_q95/duckdb:vortex-compact 153864216 150876584 1.02
tpcds_q96/duckdb:vortex-compact 16062776 16236163 0.99
tpcds_q97/duckdb:vortex-compact 43396375 41225999 1.05
tpcds_q98/duckdb:vortex-compact 28565223 26606339 1.07
tpcds_q99/duckdb:vortex-compact 29542751 29514783 1.00
duckdb / parquet (1.007x ➖, 1↑ 1↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29845843 29102905 1.03
tpcds_q02/duckdb:parquet 25381539 24615559 1.03
tpcds_q03/duckdb:parquet 13070800 12793001 1.02
tpcds_q04/duckdb:parquet 171548967 169154715 1.01
tpcds_q05/duckdb:parquet 33106732 33297671 0.99
tpcds_q06/duckdb:parquet 33472681 33587497 1.00
tpcds_q07/duckdb:parquet 24803327 24152229 1.03
tpcds_q08/duckdb:parquet 30018226 29715360 1.01
tpcds_q09/duckdb:parquet 44986420 44402979 1.01
tpcds_q10/duckdb:parquet 38473507 38347352 1.00
tpcds_q11/duckdb:parquet 94835234 92546267 1.02
tpcds_q12/duckdb:parquet 17399402 17294997 1.01
tpcds_q13/duckdb:parquet 34899100 35293720 0.99
tpcds_q14/duckdb:parquet 100802298 103881676 0.97
tpcds_q15/duckdb:parquet 31204441 30387593 1.03
tpcds_q16/duckdb:parquet 22818669 22581574 1.01
tpcds_q17/duckdb:parquet 38627324 40760347 0.95
tpcds_q18/duckdb:parquet 49064319 47693345 1.03
tpcds_q19/duckdb:parquet 32253750 31987944 1.01
tpcds_q20/duckdb:parquet 19330102 18693219 1.03
tpcds_q21/duckdb:parquet 11667972 11578402 1.01
tpcds_q22/duckdb:parquet 73523726 72339232 1.02
tpcds_q23/duckdb:parquet 81322375 80747666 1.01
tpcds_q24/duckdb:parquet 46932815 47160224 1.00
tpcds_q25/duckdb:parquet 36221472 35324875 1.03
tpcds_q26/duckdb:parquet 40246706 39425391 1.02
tpcds_q27/duckdb:parquet 54114218 52833373 1.02
tpcds_q28/duckdb:parquet 43063449 42120253 1.02
tpcds_q29/duckdb:parquet 🚀 37507576 42196609 0.89
tpcds_q30/duckdb:parquet 37992856 37463425 1.01
tpcds_q31/duckdb:parquet 27680365 28784133 0.96
tpcds_q32/duckdb:parquet 13314008 12396464 1.07
tpcds_q33/duckdb:parquet 23763285 24294171 0.98
tpcds_q34/duckdb:parquet 22430734 23077470 0.97
tpcds_q35/duckdb:parquet 61614644 61892720 1.00
tpcds_q36/duckdb:parquet 22719876 23068542 0.98
tpcds_q37/duckdb:parquet 14762281 13955966 1.06
tpcds_q38/duckdb:parquet 37082822 37167043 1.00
tpcds_q39/duckdb:parquet 33199168 32313284 1.03
tpcds_q40/duckdb:parquet 19856484 19752697 1.01
tpcds_q41/duckdb:parquet 8898769 8750152 1.02
tpcds_q42/duckdb:parquet 12581785 12337270 1.02
tpcds_q43/duckdb:parquet 18076805 17315889 1.04
tpcds_q44/duckdb:parquet 27215382 26041083 1.05
tpcds_q45/duckdb:parquet 28536511 28721545 0.99
tpcds_q46/duckdb:parquet 47810942 47858236 1.00
tpcds_q47/duckdb:parquet 50582931 49666849 1.02
tpcds_q48/duckdb:parquet 32731853 32093961 1.02
tpcds_q49/duckdb:parquet 28684702 29173762 0.98
tpcds_q50/duckdb:parquet 26833226 26222356 1.02
tpcds_q51/duckdb:parquet 106924393 105671018 1.01
tpcds_q52/duckdb:parquet 12629896 12438703 1.02
tpcds_q53/duckdb:parquet 18493807 19344597 0.96
tpcds_q54/duckdb:parquet 29455192 29158947 1.01
tpcds_q55/duckdb:parquet 12613212 12788205 0.99
tpcds_q56/duckdb:parquet 23545035 23945302 0.98
tpcds_q57/duckdb:parquet 38451076 39185339 0.98
tpcds_q58/duckdb:parquet 26568360 25631592 1.04
tpcds_q59/duckdb:parquet 36390380 36864225 0.99
tpcds_q60/duckdb:parquet 25128469 25044016 1.00
tpcds_q61/duckdb:parquet 35170623 33136273 1.06
tpcds_q62/duckdb:parquet 12735547 12634636 1.01
tpcds_q63/duckdb:parquet 17664736 17768110 0.99
tpcds_q64/duckdb:parquet 80647717 76701757 1.05
tpcds_q65/duckdb:parquet 22207820 22269564 1.00
tpcds_q66/duckdb:parquet 29438970 29679129 0.99
tpcds_q67/duckdb:parquet 136706027 139015844 0.98
tpcds_q68/duckdb:parquet 39508875 38802988 1.02
tpcds_q69/duckdb:parquet 38649713 39323779 0.98
tpcds_q70/duckdb:parquet 22832896 22507272 1.01
tpcds_q71/duckdb:parquet 23535673 24581687 0.96
tpcds_q72/duckdb:parquet 169240548 168541888 1.00
tpcds_q73/duckdb:parquet 19716669 19859875 0.99
tpcds_q74/duckdb:parquet 128992112 127514285 1.01
tpcds_q75/duckdb:parquet 58323840 56722469 1.03
tpcds_q76/duckdb:parquet 22134001 22024697 1.00
tpcds_q77/duckdb:parquet 25069132 25418260 0.99
tpcds_q78/duckdb:parquet 77332474 78446722 0.99
tpcds_q79/duckdb:parquet 30129466 30557784 0.99
tpcds_q80/duckdb:parquet 44915090 44777939 1.00
tpcds_q81/duckdb:parquet 35454690 35375227 1.00
tpcds_q82/duckdb:parquet 18423992 18942428 0.97
tpcds_q83/duckdb:parquet 19006520 18511474 1.03
tpcds_q84/duckdb:parquet 22028296 21057918 1.05
tpcds_q85/duckdb:parquet 42614052 42289657 1.01
tpcds_q86/duckdb:parquet 13750060 13887226 0.99
tpcds_q87/duckdb:parquet 39841756 40278788 0.99
tpcds_q88/duckdb:parquet 53327883 53660898 0.99
tpcds_q89/duckdb:parquet 21794760 21560066 1.01
tpcds_q90/duckdb:parquet 8660259 8553363 1.01
tpcds_q91/duckdb:parquet 26608777 24902358 1.07
tpcds_q92/duckdb:parquet 13536949 13502229 1.00
tpcds_q93/duckdb:parquet 32279150 31983040 1.01
tpcds_q94/duckdb:parquet 18401206 18307286 1.01
tpcds_q95/duckdb:parquet 🚨 149367916 134172200 1.11
tpcds_q96/duckdb:parquet 11037841 10748228 1.03
tpcds_q97/duckdb:parquet 38446909 37834328 1.02
tpcds_q98/duckdb:parquet 25434005 24879170 1.02
tpcds_q99/duckdb:parquet 20263144 20284351 1.00
duckdb / duckdb (1.009x ➖, 1↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22398460 24055768 0.93
tpcds_q02/duckdb:duckdb 19356545 20316124 0.95
tpcds_q03/duckdb:duckdb 10634123 10591283 1.00
tpcds_q04/duckdb:duckdb 177565362 175796993 1.01
tpcds_q05/duckdb:duckdb 🚨 23465540 20274193 1.16
tpcds_q06/duckdb:duckdb 28652313 28017214 1.02
tpcds_q07/duckdb:duckdb 41897497 40687402 1.03
tpcds_q08/duckdb:duckdb 120664107 120038876 1.01
tpcds_q09/duckdb:duckdb 20750084 20497113 1.01
tpcds_q10/duckdb:duckdb 27785001 28012812 0.99
tpcds_q11/duckdb:duckdb 96045722 94489645 1.02
tpcds_q12/duckdb:duckdb 14503828 14120029 1.03
tpcds_q13/duckdb:duckdb 26446307 26369698 1.00
tpcds_q14/duckdb:duckdb 94481517 93946198 1.01
tpcds_q15/duckdb:duckdb 25391417 24120842 1.05
tpcds_q16/duckdb:duckdb 19325408 19089401 1.01
tpcds_q17/duckdb:duckdb 24443795 26471313 0.92
tpcds_q18/duckdb:duckdb 47030568 48696736 0.97
tpcds_q19/duckdb:duckdb 19349196 19027081 1.02
tpcds_q20/duckdb:duckdb 14713388 14270090 1.03
tpcds_q21/duckdb:duckdb 7679978 7477143 1.03
tpcds_q22/duckdb:duckdb 65002358 64284929 1.01
tpcds_q23/duckdb:duckdb 80267388 76439134 1.05
tpcds_q24/duckdb:duckdb 25545670 25116259 1.02
tpcds_q25/duckdb:duckdb 19013566 18704797 1.02
tpcds_q26/duckdb:duckdb 29266941 28589769 1.02
tpcds_q27/duckdb:duckdb 42540142 41389555 1.03
tpcds_q28/duckdb:duckdb 26442631 26072662 1.01
tpcds_q29/duckdb:duckdb 24240640 24164743 1.00
tpcds_q30/duckdb:duckdb 31399674 31203824 1.01
tpcds_q31/duckdb:duckdb 52977042 51396055 1.03
tpcds_q32/duckdb:duckdb 8539785 7907741 1.08
tpcds_q33/duckdb:duckdb 16605296 16351005 1.02
tpcds_q34/duckdb:duckdb 20091633 18477802 1.09
tpcds_q35/duckdb:duckdb 37364137 36876906 1.01
tpcds_q36/duckdb:duckdb 71820485 69911441 1.03
tpcds_q37/duckdb:duckdb 8789788 8949367 0.98
tpcds_q38/duckdb:duckdb 33536018 32760500 1.02
tpcds_q39/duckdb:duckdb 28934117 30071305 0.96
tpcds_q40/duckdb:duckdb 15100612 14584490 1.04
tpcds_q41/duckdb:duckdb 9799614 9261729 1.06
tpcds_q42/duckdb:duckdb 8726850 8533169 1.02
tpcds_q43/duckdb:duckdb 15329415 15061459 1.02
tpcds_q44/duckdb:duckdb 15866569 15578437 1.02
tpcds_q45/duckdb:duckdb 19320763 18343871 1.05
tpcds_q46/duckdb:duckdb 39734621 37855762 1.05
tpcds_q47/duckdb:duckdb 47130339 45068128 1.05
tpcds_q48/duckdb:duckdb 24244469 24617012 0.98
tpcds_q49/duckdb:duckdb 21323547 22056696 0.97
tpcds_q50/duckdb:duckdb 16531792 16000252 1.03
tpcds_q51/duckdb:duckdb 100611911 100731102 1.00
tpcds_q52/duckdb:duckdb 🚨 10248503 9297834 1.10
tpcds_q53/duckdb:duckdb 18119612 17690242 1.02
tpcds_q54/duckdb:duckdb 18904033 19582631 0.97
tpcds_q55/duckdb:duckdb 9691891 9668187 1.00
tpcds_q56/duckdb:duckdb 17536711 17462203 1.00
tpcds_q57/duckdb:duckdb 37192832 36361753 1.02
tpcds_q58/duckdb:duckdb 18060124 17907959 1.01
tpcds_q59/duckdb:duckdb 36839739 36884539 1.00
tpcds_q60/duckdb:duckdb 19547350 18339437 1.07
tpcds_q61/duckdb:duckdb 16676559 16379229 1.02
tpcds_q62/duckdb:duckdb 10226179 9981271 1.02
tpcds_q63/duckdb:duckdb 16710966 16574637 1.01
tpcds_q64/duckdb:duckdb 58039884 58168006 1.00
tpcds_q65/duckdb:duckdb 36150857 36249683 1.00
tpcds_q66/duckdb:duckdb 27037230 26313825 1.03
tpcds_q67/duckdb:duckdb 133783045 133833415 1.00
tpcds_q68/duckdb:duckdb 26690482 28534059 0.94
tpcds_q69/duckdb:duckdb 29469959 28932208 1.02
tpcds_q70/duckdb:duckdb 16928608 17293437 0.98
tpcds_q71/duckdb:duckdb 17254931 16370724 1.05
tpcds_q72/duckdb:duckdb 45677045 46639893 0.98
tpcds_q73/duckdb:duckdb 14825972 14326294 1.03
tpcds_q74/duckdb:duckdb 145962795 149077905 0.98
tpcds_q75/duckdb:duckdb 47792460 45940591 1.04
tpcds_q76/duckdb:duckdb 14797451 14871101 1.00
tpcds_q77/duckdb:duckdb 16192349 15721921 1.03
tpcds_q78/duckdb:duckdb 65575641 66232199 0.99
tpcds_q79/duckdb:duckdb 20401047 20418437 1.00
tpcds_q80/duckdb:duckdb 32261213 32647637 0.99
tpcds_q81/duckdb:duckdb 40763298 41962193 0.97
tpcds_q82/duckdb:duckdb 10583615 10762780 0.98
tpcds_q83/duckdb:duckdb 11391159 10990957 1.04
tpcds_q84/duckdb:duckdb 15146088 14951211 1.01
tpcds_q85/duckdb:duckdb 26679026 26344701 1.01
tpcds_q86/duckdb:duckdb 12372956 12517237 0.99
tpcds_q87/duckdb:duckdb 36896515 37537184 0.98
tpcds_q88/duckdb:duckdb 30365952 31016533 0.98
tpcds_q89/duckdb:duckdb 22764147 22357058 1.02
tpcds_q90/duckdb:duckdb 6431116 6444582 1.00
tpcds_q91/duckdb:duckdb 15370032 14863131 1.03
tpcds_q92/duckdb:duckdb 10241570 10711194 0.96
tpcds_q93/duckdb:duckdb 24750044 24330650 1.02
tpcds_q94/duckdb:duckdb 14938741 14832412 1.01
tpcds_q95/duckdb:duckdb 🚀 116370670 134334315 0.87
tpcds_q96/duckdb:duckdb 6006848 5974503 1.01
tpcds_q97/duckdb:duckdb 32151976 32635987 0.99
tpcds_q98/duckdb:duckdb 20715456 20875654 0.99
tpcds_q99/duckdb:duckdb 16890812 17104624 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +5.3% -12.0% +19.7% +24.9% ➖ noise
1 datafusion:vortex-file-compressed +2.9% -12.0% +17.0% +24.6% ➖ noise
1 duckdb:duckdb -6.9% -12.0% +5.8% +24.6% ➖ noise
1 duckdb:vortex-compact -10.2% -12.0% +2.1% +24.6% ➖ noise
1 duckdb:vortex-file-compressed +2.6% -12.0% +16.6% +27.3% ➖ noise
2 datafusion:vortex-compact +0.7% +2.8% -2.0% +24.6% ➖ noise
2 datafusion:vortex-file-compressed +3.2% +2.8% +0.4% +24.6% ➖ noise
2 duckdb:duckdb -4.7% +2.8% -7.3% +24.6% ➖ noise
2 duckdb:vortex-compact +0.8% +2.8% -2.0% +36.8% ➖ noise
2 duckdb:vortex-file-compressed -4.2% +2.8% -6.8% +24.6% ➖ noise
3 datafusion:vortex-compact -0.2% +2.8% -2.9% +24.6% ➖ noise
3 datafusion:vortex-file-compressed +11.2% +2.8% +8.2% +24.6% ➖ noise
3 duckdb:duckdb +0.4% +2.8% -2.4% +24.6% ➖ noise
3 duckdb:vortex-compact -4.7% +2.8% -7.3% +24.6% ➖ noise
3 duckdb:vortex-file-compressed +1.2% +2.8% -1.6% +24.6% ➖ noise
4 datafusion:vortex-compact -5.6% +3.6% -8.9% +24.6% ➖ noise
4 datafusion:vortex-file-compressed +0.5% +3.6% -3.0% +24.6% ➖ noise
4 duckdb:duckdb +1.0% +3.6% -2.5% +24.6% ➖ noise
4 duckdb:vortex-compact -9.9% +3.6% -13.1% +24.6% ➖ noise
4 duckdb:vortex-file-compressed -1.4% +3.6% -4.9% +24.6% ➖ noise
5 datafusion:vortex-compact -15.6% +7.1% -21.2% +24.6% ✅ faster
5 datafusion:vortex-file-compressed +3.0% +7.1% -3.8% +24.6% ➖ noise
5 duckdb:duckdb +15.7% +7.1% +8.0% +24.6% ➖ noise
5 duckdb:vortex-compact -1.3% +7.1% -7.9% +24.6% ➖ noise
5 duckdb:vortex-file-compressed +7.1% +7.1% -0.1% +24.6% ➖ noise
6 datafusion:vortex-compact -57.0% -36.0% -32.8% +24.6% ✅ faster
6 datafusion:vortex-file-compressed -60.2% -36.0% -37.8% +24.6% ✅ faster
6 duckdb:duckdb +2.3% -36.0% +59.8% +24.6% 🚨 regression
6 duckdb:vortex-compact -10.6% -36.0% +39.7% +24.6% 🚨 regression
6 duckdb:vortex-file-compressed -0.9% -36.0% +54.9% +24.6% 🚨 regression
7 datafusion:vortex-compact -13.1% +3.2% -15.8% +24.6% ➖ noise
7 datafusion:vortex-file-compressed -10.4% +3.2% -13.2% +24.6% ➖ noise
7 duckdb:duckdb +3.0% +3.2% -0.2% +24.6% ➖ noise
7 duckdb:vortex-compact -8.6% +3.2% -11.5% +24.6% ➖ noise
7 duckdb:vortex-file-compressed -0.1% +3.2% -3.2% +24.6% ➖ noise
8 datafusion:vortex-compact -1.1% +5.4% -6.2% +24.6% ➖ noise
8 datafusion:vortex-file-compressed +6.6% +5.4% +1.1% +24.6% ➖ noise
8 duckdb:duckdb +0.5% +5.4% -4.7% +24.6% ➖ noise
8 duckdb:vortex-compact -6.8% +5.4% -11.6% +24.6% ➖ noise
8 duckdb:vortex-file-compressed +6.7% +5.4% +1.3% +24.6% ➖ noise
9 datafusion:vortex-compact -14.8% -3.5% -11.7% +24.6% ➖ noise
9 datafusion:vortex-file-compressed -11.3% -3.5% -8.1% +24.6% ➖ noise
9 duckdb:duckdb +1.2% -3.5% +4.9% +24.6% ➖ noise
9 duckdb:vortex-compact -5.7% -3.5% -2.3% +24.6% ➖ noise
9 duckdb:vortex-file-compressed -4.5% -3.5% -1.0% +24.6% ➖ noise
10 datafusion:vortex-compact -4.6% +5.7% -9.8% +24.6% ➖ noise
10 datafusion:vortex-file-compressed +2.5% +5.7% -3.0% +24.6% ➖ noise
10 duckdb:duckdb -0.8% +5.7% -6.2% +24.6% ➖ noise
10 duckdb:vortex-compact -11.6% +5.7% -16.4% +24.6% ➖ noise
10 duckdb:vortex-file-compressed +1.0% +5.7% -4.5% +24.6% ➖ noise
11 datafusion:vortex-compact -8.2% -0.2% -8.0% +24.6% ➖ noise
11 datafusion:vortex-file-compressed -2.6% -0.2% -2.4% +24.6% ➖ noise
11 duckdb:duckdb +1.6% -0.2% +1.9% +24.6% ➖ noise
11 duckdb:vortex-compact -9.2% -0.2% -9.0% +24.6% ➖ noise
11 duckdb:vortex-file-compressed +5.8% -0.2% +6.0% +24.6% ➖ noise
12 datafusion:vortex-compact -8.7% +4.0% -12.2% +24.6% ➖ noise
12 datafusion:vortex-file-compressed -1.3% +4.0% -5.1% +24.6% ➖ noise
12 duckdb:duckdb +2.7% +4.0% -1.2% +24.6% ➖ noise
12 duckdb:vortex-compact -9.1% +4.0% -12.6% +24.6% ➖ noise
12 duckdb:vortex-file-compressed +4.6% +4.0% +0.6% +24.6% ➖ noise
13 datafusion:vortex-compact +19.1% +0.3% +18.8% +27.7% ➖ noise
13 datafusion:vortex-file-compressed +1.8% +0.3% +1.6% +24.6% ➖ noise
13 duckdb:duckdb +0.3% +0.3% +0.0% +24.6% ➖ noise
13 duckdb:vortex-compact -3.1% +0.3% -3.4% +24.6% ➖ noise
13 duckdb:vortex-file-compressed -0.5% +0.3% -0.7% +24.6% ➖ noise
14 datafusion:vortex-compact -14.3% -2.7% -12.0% +24.6% ➖ noise
14 datafusion:vortex-file-compressed -3.6% -2.7% -1.0% +24.6% ➖ noise
14 duckdb:duckdb +0.6% -2.7% +3.4% +24.6% ➖ noise
14 duckdb:vortex-compact -4.6% -2.7% -2.0% +24.6% ➖ noise
14 duckdb:vortex-file-compressed +0.7% -2.7% +3.5% +24.6% ➖ noise
15 datafusion:vortex-compact -17.2% +0.7% -17.7% +24.6% ➖ noise
15 datafusion:vortex-file-compressed -5.2% +0.7% -5.8% +24.6% ➖ noise
15 duckdb:duckdb +5.3% +0.7% +4.6% +24.6% ➖ noise
15 duckdb:vortex-compact -11.7% +0.7% -12.3% +24.6% ➖ noise
15 duckdb:vortex-file-compressed -1.0% +0.7% -1.7% +24.6% ➖ noise
16 datafusion:vortex-compact -16.3% +4.4% -19.8% +24.6% ✅ faster
16 datafusion:vortex-file-compressed -9.9% +4.4% -13.7% +24.6% ➖ noise
16 duckdb:duckdb +1.2% +4.4% -3.1% +24.6% ➖ noise
16 duckdb:vortex-compact -6.0% +4.4% -10.0% +24.6% ➖ noise
16 duckdb:vortex-file-compressed +6.7% +4.4% +2.2% +24.6% ➖ noise
17 datafusion:vortex-compact -11.9% -5.7% -6.6% +24.6% ➖ noise
17 datafusion:vortex-file-compressed -3.5% -5.7% +2.3% +24.6% ➖ noise
17 duckdb:duckdb -7.7% -5.7% -2.1% +24.6% ➖ noise
17 duckdb:vortex-compact -8.2% -5.7% -2.7% +24.6% ➖ noise
17 duckdb:vortex-file-compressed -1.4% -5.7% +4.6% +24.6% ➖ noise
18 datafusion:vortex-compact -14.2% -0.2% -14.0% +24.6% ➖ noise
18 datafusion:vortex-file-compressed -6.7% -0.2% -6.5% +24.6% ➖ noise
18 duckdb:duckdb -3.4% -0.2% -3.2% +24.6% ➖ noise
18 duckdb:vortex-compact -5.0% -0.2% -4.8% +24.6% ➖ noise
18 duckdb:vortex-file-compressed +1.0% -0.2% +1.2% +24.6% ➖ noise
19 datafusion:vortex-compact -5.3% +2.9% -7.9% +24.6% ➖ noise
19 datafusion:vortex-file-compressed +2.5% +2.9% -0.4% +24.6% ➖ noise
19 duckdb:duckdb +1.7% +2.9% -1.1% +24.6% ➖ noise
19 duckdb:vortex-compact -3.3% +2.9% -6.0% +24.6% ➖ noise
19 duckdb:vortex-file-compressed +1.4% +2.9% -1.4% +24.6% ➖ noise
20 datafusion:vortex-compact -8.8% +1.0% -9.7% +24.6% ➖ noise
20 datafusion:vortex-file-compressed +6.5% +1.0% +5.4% +24.6% ➖ noise
20 duckdb:duckdb +3.1% +1.0% +2.1% +24.6% ➖ noise
20 duckdb:vortex-compact -1.8% +1.0% -2.8% +24.6% ➖ noise
20 duckdb:vortex-file-compressed +7.9% +1.0% +6.8% +24.6% ➖ noise
21 datafusion:vortex-compact -11.8% +2.1% -13.6% +24.6% ➖ noise
21 datafusion:vortex-file-compressed +6.8% +2.1% +4.5% +24.6% ➖ noise
21 duckdb:duckdb +2.7% +2.1% +0.6% +24.6% ➖ noise
21 duckdb:vortex-compact -7.3% +2.1% -9.2% +24.6% ➖ noise
21 duckdb:vortex-file-compressed +2.9% +2.1% +0.8% +24.6% ➖ noise
22 datafusion:vortex-compact -6.2% +5.6% -11.1% +24.6% ➖ noise
22 datafusion:vortex-file-compressed +38.9% +5.6% +31.5% +24.6% 🚨 regression
22 duckdb:duckdb +1.1% +5.6% -4.3% +24.6% ➖ noise
22 duckdb:vortex-compact +0.0% +5.6% -5.3% +24.6% ➖ noise
22 duckdb:vortex-file-compressed +0.7% +5.6% -4.6% +24.6% ➖ noise
23 datafusion:vortex-compact -8.3% +2.5% -10.5% +24.6% ➖ noise
23 datafusion:vortex-file-compressed +6.2% +2.5% +3.6% +24.6% ➖ noise
23 duckdb:duckdb +5.0% +2.5% +2.4% +24.6% ➖ noise
23 duckdb:vortex-compact -6.3% +2.5% -8.6% +24.6% ➖ noise
23 duckdb:vortex-file-compressed +4.3% +2.5% +1.7% +24.6% ➖ noise
24 datafusion:vortex-compact -12.6% -1.7% -11.1% +24.6% ➖ noise
24 datafusion:vortex-file-compressed +0.9% -1.7% +2.7% +24.6% ➖ noise
24 duckdb:duckdb +1.7% -1.7% +3.5% +24.6% ➖ noise
24 duckdb:vortex-compact +0.4% -1.7% +2.1% +24.6% ➖ noise
24 duckdb:vortex-file-compressed +0.1% -1.7% +1.8% +24.6% ➖ noise
25 datafusion:vortex-compact -7.5% +1.4% -8.8% +24.6% ➖ noise
25 datafusion:vortex-file-compressed -3.9% +1.4% -5.2% +24.6% ➖ noise
25 duckdb:duckdb +1.7% +1.4% +0.2% +24.6% ➖ noise
25 duckdb:vortex-compact -3.7% +1.4% -5.0% +24.6% ➖ noise
25 duckdb:vortex-file-compressed -0.1% +1.4% -1.6% +24.6% ➖ noise
26 datafusion:vortex-compact -3.8% -0.9% -2.9% +24.6% ➖ noise
26 datafusion:vortex-file-compressed +8.5% -0.9% +9.4% +24.6% ➖ noise
26 duckdb:duckdb +2.4% -0.9% +3.3% +24.6% ➖ noise
26 duckdb:vortex-compact -1.0% -0.9% -0.1% +24.6% ➖ noise
26 duckdb:vortex-file-compressed -2.1% -0.9% -1.2% +24.6% ➖ noise
27 datafusion:vortex-compact -5.0% -1.2% -3.9% +24.6% ➖ noise
27 datafusion:vortex-file-compressed -9.2% -1.2% -8.2% +24.6% ➖ noise
27 duckdb:duckdb +2.8% -1.2% +4.0% +24.6% ➖ noise
27 duckdb:vortex-compact +5.5% -1.2% +6.7% +24.6% ➖ noise
27 duckdb:vortex-file-compressed -1.5% -1.2% -0.3% +24.6% ➖ noise
28 datafusion:vortex-compact +0.5% +1.7% -1.2% +24.6% ➖ noise
28 datafusion:vortex-file-compressed +0.4% +1.7% -1.2% +24.6% ➖ noise
28 duckdb:duckdb +1.4% +1.7% -0.2% +24.6% ➖ noise
28 duckdb:vortex-compact -0.6% +1.7% -2.2% +24.6% ➖ noise
28 duckdb:vortex-file-compressed -5.0% +1.7% -6.5% +24.6% ➖ noise
29 datafusion:vortex-compact -4.4% -6.4% +2.1% +24.6% ➖ noise
29 datafusion:vortex-file-compressed +1.8% -6.4% +8.8% +24.6% ➖ noise
29 duckdb:duckdb +0.3% -6.4% +7.2% +24.6% ➖ noise
29 duckdb:vortex-compact +4.7% -6.4% +11.8% +24.6% ➖ noise
29 duckdb:vortex-file-compressed +4.6% -6.4% +11.8% +24.6% ➖ noise
30 datafusion:vortex-compact +2.4% +1.6% +0.8% +24.6% ➖ noise
30 datafusion:vortex-file-compressed +10.0% +1.6% +8.3% +24.6% ➖ noise
30 duckdb:duckdb +0.6% +1.6% -1.0% +24.6% ➖ noise
30 duckdb:vortex-compact +4.4% +1.6% +2.7% +24.6% ➖ noise
30 duckdb:vortex-file-compressed +5.1% +1.6% +3.4% +24.6% ➖ noise
31 datafusion:vortex-compact +2.7% +0.6% +2.0% +24.6% ➖ noise
31 datafusion:vortex-file-compressed +5.7% +0.6% +5.0% +24.6% ➖ noise
31 duckdb:duckdb +3.1% +0.6% +2.4% +24.6% ➖ noise
31 duckdb:vortex-compact -0.6% +0.6% -1.2% +24.6% ➖ noise
31 duckdb:vortex-file-compressed -1.2% +0.6% -1.8% +24.6% ➖ noise
32 datafusion:vortex-compact -9.5% +5.3% -14.1% +24.6% ➖ noise
32 datafusion:vortex-file-compressed +2.7% +5.3% -2.5% +24.6% ➖ noise
32 duckdb:duckdb +8.0% +5.3% +2.5% +24.6% ➖ noise
32 duckdb:vortex-compact +9.8% +5.3% +4.2% +24.6% ➖ noise
32 duckdb:vortex-file-compressed -2.0% +5.3% -7.0% +24.6% ➖ noise
33 datafusion:vortex-compact -4.1% +1.7% -5.8% +24.6% ➖ noise
33 datafusion:vortex-file-compressed +0.1% +1.7% -1.6% +24.6% ➖ noise
33 duckdb:duckdb +1.6% +1.7% -0.2% +24.6% ➖ noise
33 duckdb:vortex-compact +7.1% +1.7% +5.3% +24.6% ➖ noise
33 duckdb:vortex-file-compressed +0.2% +1.7% -1.5% +24.6% ➖ noise
34 datafusion:vortex-compact -1.4% +1.4% -2.7% +24.6% ➖ noise
34 datafusion:vortex-file-compressed +8.2% +1.4% +6.7% +24.6% ➖ noise
34 duckdb:duckdb +8.7% +1.4% +7.3% +24.6% ➖ noise
34 duckdb:vortex-compact +3.2% +1.4% +1.8% +24.6% ➖ noise
34 duckdb:vortex-file-compressed -3.0% +1.4% -4.3% +24.6% ➖ noise
35 datafusion:vortex-compact +5.0% +3.5% +1.5% +24.6% ➖ noise
35 datafusion:vortex-file-compressed +2.5% +3.5% -1.0% +24.6% ➖ noise
35 duckdb:duckdb +1.3% +3.5% -2.1% +24.6% ➖ noise
35 duckdb:vortex-compact +2.4% +3.5% -1.0% +24.6% ➖ noise
35 duckdb:vortex-file-compressed -0.3% +3.5% -3.6% +24.6% ➖ noise
36 datafusion:vortex-compact -5.8% +1.2% -6.9% +24.6% ➖ noise
36 datafusion:vortex-file-compressed +0.9% +1.2% -0.3% +24.6% ➖ noise
36 duckdb:duckdb +2.7% +1.2% +1.5% +24.6% ➖ noise
36 duckdb:vortex-compact +3.7% +1.2% +2.5% +24.6% ➖ noise
36 duckdb:vortex-file-compressed -2.5% +1.2% -3.6% +24.6% ➖ noise
37 datafusion:vortex-compact -11.0% +7.1% -16.9% +24.6% ➖ noise
37 datafusion:vortex-file-compressed -10.1% +7.1% -16.1% +24.6% ➖ noise
37 duckdb:duckdb -1.8% +7.1% -8.3% +24.6% ➖ noise
37 duckdb:vortex-compact +4.2% +7.1% -2.7% +24.6% ➖ noise
37 duckdb:vortex-file-compressed +4.4% +7.1% -2.5% +24.6% ➖ noise
38 datafusion:vortex-compact +0.7% +3.0% -2.2% +24.6% ➖ noise
38 datafusion:vortex-file-compressed +3.8% +3.0% +0.8% +24.6% ➖ noise
38 duckdb:duckdb +2.4% +3.0% -0.6% +24.6% ➖ noise
38 duckdb:vortex-compact +6.5% +3.0% +3.4% +24.6% ➖ noise
38 duckdb:vortex-file-compressed +2.7% +3.0% -0.3% +24.6% ➖ noise
39 datafusion:vortex-compact -9.4% +3.0% -12.0% +24.6% ➖ noise
39 datafusion:vortex-file-compressed +3.1% +3.0% +0.1% +24.6% ➖ noise
39 duckdb:duckdb -3.8% +3.0% -6.6% +24.6% ➖ noise
39 duckdb:vortex-compact -1.6% +3.0% -4.4% +24.6% ➖ noise
39 duckdb:vortex-file-compressed +1.7% +3.0% -1.2% +24.6% ➖ noise
40 datafusion:vortex-compact -21.4% +2.6% -23.4% +24.6% ✅ faster
40 datafusion:vortex-file-compressed -6.8% +2.6% -9.2% +24.6% ➖ noise
40 duckdb:duckdb +3.5% +2.6% +0.9% +24.6% ➖ noise
40 duckdb:vortex-compact +2.6% +2.6% -0.1% +24.6% ➖ noise
40 duckdb:vortex-file-compressed +6.6% +2.6% +3.9% +24.6% ➖ noise
41 datafusion:vortex-compact -7.2% +9.6% -15.3% +24.6% ➖ noise
41 datafusion:vortex-file-compressed +4.6% +9.6% -4.6% +24.6% ➖ noise
41 duckdb:duckdb +5.8% +9.6% -3.4% +24.6% ➖ noise
41 duckdb:vortex-compact +4.3% +9.6% -4.8% +24.6% ➖ noise
41 duckdb:vortex-file-compressed +2.8% +9.6% -6.1% +24.6% ➖ noise
42 datafusion:vortex-compact -4.5% +3.5% -7.7% +24.6% ➖ noise
42 datafusion:vortex-file-compressed +2.9% +3.5% -0.6% +24.6% ➖ noise
42 duckdb:duckdb +2.3% +3.5% -1.2% +24.6% ➖ noise
42 duckdb:vortex-compact -0.4% +3.5% -3.8% +24.6% ➖ noise
42 duckdb:vortex-file-compressed -0.8% +3.5% -4.2% +24.6% ➖ noise
43 datafusion:vortex-compact -1.6% +3.6% -5.0% +24.6% ➖ noise
43 datafusion:vortex-file-compressed -2.0% +3.6% -5.4% +24.6% ➖ noise
43 duckdb:duckdb +1.8% +3.6% -1.7% +24.6% ➖ noise
43 duckdb:vortex-compact -3.9% +3.6% -7.2% +24.6% ➖ noise
43 duckdb:vortex-file-compressed +3.2% +3.6% -0.4% +24.6% ➖ noise
44 datafusion:vortex-compact -15.4% +3.1% -18.0% +24.6% ➖ noise
44 datafusion:vortex-file-compressed -10.7% +3.1% -13.4% +24.6% ➖ noise
44 duckdb:duckdb +1.8% +3.1% -1.3% +24.6% ➖ noise
44 duckdb:vortex-compact +0.2% +3.1% -2.9% +24.6% ➖ noise
44 duckdb:vortex-file-compressed +1.4% +3.1% -1.7% +24.6% ➖ noise
45 datafusion:vortex-compact -6.8% -1.7% -5.2% +24.6% ➖ noise
45 datafusion:vortex-file-compressed -2.5% -1.7% -0.8% +24.6% ➖ noise
45 duckdb:duckdb +5.3% -1.7% +7.2% +24.6% ➖ noise
45 duckdb:vortex-compact +4.0% -1.7% +5.8% +24.6% ➖ noise
45 duckdb:vortex-file-compressed +5.0% -1.7% +6.8% +24.6% ➖ noise
46 datafusion:vortex-compact -6.2% +1.7% -7.8% +24.6% ➖ noise
46 datafusion:vortex-file-compressed +1.2% +1.7% -0.5% +24.6% ➖ noise
46 duckdb:duckdb +5.0% +1.7% +3.2% +24.6% ➖ noise
46 duckdb:vortex-compact -5.2% +1.7% -6.7% +24.6% ➖ noise
46 duckdb:vortex-file-compressed +3.1% +1.7% +1.4% +24.6% ➖ noise
47 datafusion:vortex-compact -7.1% +3.2% -10.0% +24.6% ➖ noise
47 datafusion:vortex-file-compressed +2.1% +3.2% -1.1% +24.6% ➖ noise
47 duckdb:duckdb +4.6% +3.2% +1.3% +24.6% ➖ noise
47 duckdb:vortex-compact +0.9% +3.2% -2.3% +24.6% ➖ noise
47 duckdb:vortex-file-compressed -11.0% +3.2% -13.8% +24.6% ➖ noise
48 datafusion:vortex-compact +0.6% +3.2% -2.5% +24.6% ➖ noise
48 datafusion:vortex-file-compressed +0.3% +3.2% -2.8% +24.6% ➖ noise
48 duckdb:duckdb -1.5% +3.2% -4.5% +24.6% ➖ noise
48 duckdb:vortex-compact +1.9% +3.2% -1.2% +24.6% ➖ noise
48 duckdb:vortex-file-compressed -5.1% +3.2% -8.0% +24.6% ➖ noise
49 datafusion:vortex-compact -8.0% -0.1% -7.9% +24.6% ➖ noise
49 datafusion:vortex-file-compressed +1.7% -0.1% +1.7% +24.6% ➖ noise
49 duckdb:duckdb -3.3% -0.1% -3.3% +24.6% ➖ noise
49 duckdb:vortex-compact +7.5% -0.1% +7.6% +24.6% ➖ noise
49 duckdb:vortex-file-compressed -4.6% -0.1% -4.5% +24.6% ➖ noise
50 datafusion:vortex-compact -13.4% +1.8% -14.9% +24.6% ➖ noise
50 datafusion:vortex-file-compressed -1.3% +1.8% -3.0% +24.6% ➖ noise
50 duckdb:duckdb +3.3% +1.8% +1.5% +24.6% ➖ noise
50 duckdb:vortex-compact +5.0% +1.8% +3.1% +24.6% ➖ noise
50 duckdb:vortex-file-compressed -8.7% +1.8% -10.3% +24.6% ➖ noise
51 datafusion:vortex-compact -6.2% +1.9% -7.9% +24.6% ➖ noise
51 datafusion:vortex-file-compressed +4.0% +1.9% +2.1% +24.6% ➖ noise
51 duckdb:duckdb -0.1% +1.9% -2.0% +24.6% ➖ noise
51 duckdb:vortex-compact +0.6% +1.9% -1.3% +24.6% ➖ noise
51 duckdb:vortex-file-compressed -5.9% +1.9% -7.7% +24.6% ➖ noise
52 datafusion:vortex-compact -7.7% +5.9% -12.8% +24.6% ➖ noise
52 datafusion:vortex-file-compressed +7.2% +5.9% +1.1% +24.6% ➖ noise
52 duckdb:duckdb +10.2% +5.9% +4.0% +24.6% ➖ noise
52 duckdb:vortex-compact -2.7% +5.9% -8.1% +36.2% ➖ noise
52 duckdb:vortex-file-compressed -12.5% +5.9% -17.4% +24.6% ➖ noise
53 datafusion:vortex-compact -6.6% +1.9% -8.3% +24.6% ➖ noise
53 datafusion:vortex-file-compressed +5.9% +1.9% +3.9% +24.6% ➖ noise
53 duckdb:duckdb +2.4% +1.9% +0.6% +24.6% ➖ noise
53 duckdb:vortex-compact +1.3% +1.9% -0.5% +24.6% ➖ noise
53 duckdb:vortex-file-compressed -10.8% +1.9% -12.5% +24.6% ➖ noise
54 datafusion:vortex-compact -4.8% +2.0% -6.7% +24.6% ➖ noise
54 datafusion:vortex-file-compressed -0.5% +2.0% -2.5% +24.6% ➖ noise
54 duckdb:duckdb -3.5% +2.0% -5.4% +24.6% ➖ noise
54 duckdb:vortex-compact +3.3% +2.0% +1.2% +24.6% ➖ noise
54 duckdb:vortex-file-compressed -13.2% +2.0% -14.9% +24.6% ➖ noise
55 datafusion:vortex-compact -8.8% +2.8% -11.2% +24.6% ➖ noise
55 datafusion:vortex-file-compressed +5.2% +2.8% +2.4% +24.6% ➖ noise
55 duckdb:duckdb +0.2% +2.8% -2.4% +24.6% ➖ noise
55 duckdb:vortex-compact +5.3% +2.8% +2.5% +24.6% ➖ noise
55 duckdb:vortex-file-compressed -5.6% +2.8% -8.1% +24.6% ➖ noise
56 datafusion:vortex-compact -11.8% +3.8% -15.0% +24.6% ➖ noise
56 datafusion:vortex-file-compressed -2.2% +3.8% -5.8% +24.6% ➖ noise
56 duckdb:duckdb +0.4% +3.8% -3.2% +24.6% ➖ noise
56 duckdb:vortex-compact -2.8% +3.8% -6.4% +24.6% ➖ noise
56 duckdb:vortex-file-compressed -7.0% +3.8% -10.4% +24.6% ➖ noise
57 datafusion:vortex-compact -9.9% -0.3% -9.6% +24.6% ➖ noise
57 datafusion:vortex-file-compressed -0.5% -0.3% -0.1% +24.6% ➖ noise
57 duckdb:duckdb +2.3% -0.3% +2.6% +24.6% ➖ noise
57 duckdb:vortex-compact +0.1% -0.3% +0.4% +24.6% ➖ noise
57 duckdb:vortex-file-compressed -7.7% -0.3% -7.4% +24.6% ➖ noise
58 datafusion:vortex-compact -7.6% +7.2% -13.8% +24.6% ➖ noise
58 datafusion:vortex-file-compressed +4.3% +7.2% -2.7% +24.6% ➖ noise
58 duckdb:duckdb +0.8% +7.2% -5.9% +24.6% ➖ noise
58 duckdb:vortex-compact +8.0% +7.2% +0.8% +24.6% ➖ noise
58 duckdb:vortex-file-compressed -7.8% +7.2% -13.9% +24.6% ➖ noise
59 datafusion:vortex-compact -2.8% +4.9% -7.3% +24.6% ➖ noise
59 datafusion:vortex-file-compressed +4.6% +4.9% -0.3% +24.6% ➖ noise
59 duckdb:duckdb -0.1% +4.9% -4.7% +24.6% ➖ noise
59 duckdb:vortex-compact -2.7% +4.9% -7.2% +24.6% ➖ noise
59 duckdb:vortex-file-compressed -2.7% +4.9% -7.2% +24.6% ➖ noise
60 datafusion:vortex-compact -10.2% +3.1% -13.0% +24.6% ➖ noise
60 datafusion:vortex-file-compressed +3.3% +3.1% +0.2% +24.6% ➖ noise
60 duckdb:duckdb +6.6% +3.1% +3.3% +24.6% ➖ noise
60 duckdb:vortex-compact +0.4% +3.1% -2.6% +24.6% ➖ noise
60 duckdb:vortex-file-compressed -11.1% +3.1% -13.8% +24.6% ➖ noise
61 datafusion:vortex-compact -8.6% +3.6% -11.8% +24.6% ➖ noise
61 datafusion:vortex-file-compressed -6.5% +3.6% -9.8% +24.6% ➖ noise
61 duckdb:duckdb +1.8% +3.6% -1.7% +24.6% ➖ noise
61 duckdb:vortex-compact +3.3% +3.6% -0.3% +24.6% ➖ noise
61 duckdb:vortex-file-compressed -14.7% +3.6% -17.6% +24.6% ➖ noise
62 datafusion:vortex-compact -12.4% +17.1% -25.2% +26.3% ✅ faster
62 datafusion:vortex-file-compressed +7.1% +17.1% -8.6% +25.5% ➖ noise
62 duckdb:duckdb +2.5% +17.1% -12.5% +24.6% ➖ noise
62 duckdb:vortex-compact +7.1% +17.1% -8.5% +24.6% ➖ noise
62 duckdb:vortex-file-compressed -6.6% +17.1% -20.2% +24.6% ✅ faster
63 datafusion:vortex-compact -7.1% +2.4% -9.3% +24.6% ➖ noise
63 datafusion:vortex-file-compressed +5.0% +2.4% +2.5% +24.6% ➖ noise
63 duckdb:duckdb +0.8% +2.4% -1.6% +24.6% ➖ noise
63 duckdb:vortex-compact -1.3% +2.4% -3.7% +24.6% ➖ noise
63 duckdb:vortex-file-compressed -12.6% +2.4% -14.6% +24.6% ➖ noise
64 datafusion:vortex-compact -21.4% -21.7% +0.5% +24.6% ➖ noise
64 datafusion:vortex-file-compressed -9.3% -21.7% +15.9% +24.6% ➖ noise
64 duckdb:duckdb -0.2% -21.7% +27.5% +24.6% 🚨 regression
64 duckdb:vortex-compact -0.1% -21.7% +27.6% +24.6% 🚨 regression
64 duckdb:vortex-file-compressed -12.9% -21.7% +11.3% +24.6% ➖ noise
65 datafusion:vortex-compact +6.0% -1.9% +8.1% +24.6% ➖ noise
65 datafusion:vortex-file-compressed +25.9% -1.9% +28.3% +24.6% 🚨 regression
65 duckdb:duckdb -0.3% -1.9% +1.6% +24.6% ➖ noise
65 duckdb:vortex-compact +0.9% -1.9% +2.8% +24.6% ➖ noise
65 duckdb:vortex-file-compressed -8.2% -1.9% -6.4% +24.6% ➖ noise
66 datafusion:vortex-compact -7.9% +0.3% -8.2% +24.6% ➖ noise
66 datafusion:vortex-file-compressed +0.2% +0.3% -0.2% +24.6% ➖ noise
66 duckdb:duckdb +2.7% +0.3% +2.4% +24.6% ➖ noise
66 duckdb:vortex-compact +1.3% +0.3% +1.0% +24.6% ➖ noise
66 duckdb:vortex-file-compressed -8.4% +0.3% -8.7% +24.6% ➖ noise
67 datafusion:vortex-compact -13.4% -0.8% -12.7% +24.6% ➖ noise
67 datafusion:vortex-file-compressed +3.3% -0.8% +4.2% +24.6% ➖ noise
67 duckdb:duckdb -0.0% -0.8% +0.8% +24.6% ➖ noise
67 duckdb:vortex-compact +1.1% -0.8% +1.9% +24.6% ➖ noise
67 duckdb:vortex-file-compressed -16.8% -0.8% -16.2% +24.6% ➖ noise
68 datafusion:vortex-compact -7.6% +2.5% -9.9% +24.6% ➖ noise
68 datafusion:vortex-file-compressed -3.8% +2.5% -6.2% +25.9% ➖ noise
68 duckdb:duckdb -6.5% +2.5% -8.8% +24.6% ➖ noise
68 duckdb:vortex-compact +2.9% +2.5% +0.4% +24.6% ➖ noise
68 duckdb:vortex-file-compressed -14.8% +2.5% -16.9% +24.6% ➖ noise
69 datafusion:vortex-compact -1.1% -0.1% -1.0% +24.6% ➖ noise
69 datafusion:vortex-file-compressed +5.8% -0.1% +5.9% +24.6% ➖ noise
69 duckdb:duckdb +1.9% -0.1% +1.9% +24.6% ➖ noise
69 duckdb:vortex-compact +2.3% -0.1% +2.4% +24.6% ➖ noise
69 duckdb:vortex-file-compressed -18.6% -0.1% -18.5% +24.6% ➖ noise
70 datafusion:vortex-compact +7.5% -40.0% +79.3% +24.6% 🚨 regression
70 datafusion:vortex-file-compressed +18.7% -40.0% +97.9% +24.6% 🚨 regression
70 duckdb:duckdb -2.1% -40.0% +63.2% +24.6% 🚨 regression
70 duckdb:vortex-compact +4.8% -40.0% +74.7% +24.6% 🚨 regression
70 duckdb:vortex-file-compressed -5.7% -40.0% +57.2% +24.6% 🚨 regression
71 datafusion:vortex-compact +4.3% -4.1% +8.8% +24.6% ➖ noise
71 datafusion:vortex-file-compressed +0.4% -4.1% +4.7% +24.6% ➖ noise
71 duckdb:duckdb +5.4% -4.1% +9.9% +24.6% ➖ noise
71 duckdb:vortex-compact -1.7% -4.1% +2.5% +24.6% ➖ noise
71 duckdb:vortex-file-compressed -11.2% -4.1% -7.4% +24.6% ➖ noise
72 datafusion:vortex-compact -3.2% -9.4% +6.9% +24.6% ➖ noise
72 datafusion:vortex-file-compressed -1.8% -9.4% +8.4% +24.6% ➖ noise
72 duckdb:duckdb -2.1% -9.4% +8.1% +24.6% ➖ noise
72 duckdb:vortex-compact +2.1% -9.4% +12.7% +24.6% ➖ noise
72 duckdb:vortex-file-compressed -5.2% -9.4% +4.7% +24.6% ➖ noise
73 datafusion:vortex-compact -1.3% -5.4% +4.3% +24.6% ➖ noise
73 datafusion:vortex-file-compressed +4.3% -5.4% +10.3% +24.6% ➖ noise
73 duckdb:duckdb +3.5% -5.4% +9.4% +24.6% ➖ noise
73 duckdb:vortex-compact -0.4% -5.4% +5.3% +24.6% ➖ noise
73 duckdb:vortex-file-compressed -14.7% -5.4% -9.8% +24.6% ➖ noise
74 datafusion:vortex-compact +3.3% -4.9% +8.7% +24.6% ➖ noise
74 datafusion:vortex-file-compressed -6.4% -4.9% -1.5% +24.6% ➖ noise
74 duckdb:duckdb -2.1% -4.9% +3.0% +24.6% ➖ noise
74 duckdb:vortex-compact +2.4% -4.9% +7.7% +24.6% ➖ noise
74 duckdb:vortex-file-compressed -11.6% -4.9% -7.0% +24.6% ➖ noise
75 datafusion:vortex-compact -2.0% -2.2% +0.2% +24.6% ➖ noise
75 datafusion:vortex-file-compressed +0.3% -2.2% +2.5% +24.6% ➖ noise
75 duckdb:duckdb +4.0% -2.2% +6.4% +24.6% ➖ noise
75 duckdb:vortex-compact +7.0% -2.2% +9.4% +24.6% ➖ noise
75 duckdb:vortex-file-compressed -12.0% -2.2% -10.0% +24.6% ➖ noise
76 datafusion:vortex-compact +2.3% -3.0% +5.5% +24.6% ➖ noise
76 datafusion:vortex-file-compressed +0.2% -3.0% +3.3% +24.6% ➖ noise
76 duckdb:duckdb -0.5% -3.0% +2.6% +24.6% ➖ noise
76 duckdb:vortex-compact +0.4% -3.0% +3.6% +24.6% ➖ noise
76 duckdb:vortex-file-compressed -20.7% -3.0% -18.2% +24.6% ➖ noise
77 datafusion:vortex-compact +1.0% -4.3% +5.6% +24.6% ➖ noise
77 datafusion:vortex-file-compressed -7.6% -4.3% -3.5% +24.6% ➖ noise
77 duckdb:duckdb +3.0% -4.3% +7.6% +24.6% ➖ noise
77 duckdb:vortex-compact -4.6% -4.3% -0.3% +24.6% ➖ noise
77 duckdb:vortex-file-compressed -4.0% -4.3% +0.3% +24.6% ➖ noise
78 datafusion:vortex-compact -7.8% -7.9% +0.1% +24.6% ➖ noise
78 datafusion:vortex-file-compressed -10.5% -7.9% -2.9% +24.6% ➖ noise
78 duckdb:duckdb -1.0% -7.9% +7.5% +24.6% ➖ noise
78 duckdb:vortex-compact -0.1% -7.9% +8.4% +24.6% ➖ noise
78 duckdb:vortex-file-compressed -6.8% -7.9% +1.2% +24.6% ➖ noise
79 datafusion:vortex-compact +3.3% -3.9% +7.5% +24.6% ➖ noise
79 datafusion:vortex-file-compressed -2.2% -3.9% +1.7% +24.6% ➖ noise
79 duckdb:duckdb -0.1% -3.9% +4.0% +24.6% ➖ noise
79 duckdb:vortex-compact +7.6% -3.9% +12.0% +24.6% ➖ noise
79 duckdb:vortex-file-compressed -11.2% -3.9% -7.6% +24.6% ➖ noise
80 datafusion:vortex-compact -8.1% -8.0% -0.2% +24.6% ➖ noise
80 datafusion:vortex-file-compressed -8.7% -8.0% -0.7% +24.6% ➖ noise
80 duckdb:duckdb -1.2% -8.0% +7.4% +24.6% ➖ noise
80 duckdb:vortex-compact +4.2% -8.0% +13.2% +24.6% ➖ noise
80 duckdb:vortex-file-compressed -0.8% -8.0% +7.7% +24.6% ➖ noise
81 datafusion:vortex-compact +5.4% -5.5% +11.6% +24.6% ➖ noise
81 datafusion:vortex-file-compressed +6.1% -5.5% +12.3% +24.6% ➖ noise
81 duckdb:duckdb -2.9% -5.5% +2.8% +24.6% ➖ noise
81 duckdb:vortex-compact +5.9% -5.5% +12.2% +24.6% ➖ noise
81 duckdb:vortex-file-compressed -1.6% -5.5% +4.1% +24.6% ➖ noise
82 datafusion:vortex-compact -7.3% -7.4% +0.1% +24.6% ➖ noise
82 datafusion:vortex-file-compressed -16.0% -7.4% -9.3% +24.6% ➖ noise
82 duckdb:duckdb -1.7% -7.4% +6.2% +24.6% ➖ noise
82 duckdb:vortex-compact +5.3% -7.4% +13.7% +24.6% ➖ noise
82 duckdb:vortex-file-compressed +0.5% -7.4% +8.6% +24.6% ➖ noise
83 datafusion:vortex-compact +8.3% +2.3% +5.9% +24.6% ➖ noise
83 datafusion:vortex-file-compressed +6.9% +2.3% +4.5% +24.6% ➖ noise
83 duckdb:duckdb +3.6% +2.3% +1.3% +24.6% ➖ noise
83 duckdb:vortex-compact -3.2% +2.3% -5.4% +24.6% ➖ noise
83 duckdb:vortex-file-compressed +1.2% +2.3% -1.1% +24.6% ➖ noise
84 datafusion:vortex-compact -3.2% +2.1% -5.2% +24.6% ➖ noise
84 datafusion:vortex-file-compressed +2.7% +2.1% +0.6% +24.6% ➖ noise
84 duckdb:duckdb +1.3% +2.1% -0.7% +24.6% ➖ noise
84 duckdb:vortex-compact -3.1% +2.1% -5.0% +24.6% ➖ noise
84 duckdb:vortex-file-compressed -7.6% +2.1% -9.5% +24.6% ➖ noise
85 datafusion:vortex-compact -2.3% -4.1% +1.8% +24.6% ➖ noise
85 datafusion:vortex-file-compressed -2.1% -4.1% +2.0% +24.6% ➖ noise
85 duckdb:duckdb +1.3% -4.1% +5.5% +24.6% ➖ noise
85 duckdb:vortex-compact +2.8% -4.1% +7.2% +24.6% ➖ noise
85 duckdb:vortex-file-compressed +1.3% -4.1% +5.5% +24.6% ➖ noise
86 datafusion:vortex-compact +12.0% -1.1% +13.2% +24.6% ➖ noise
86 datafusion:vortex-file-compressed -1.1% -1.1% +0.1% +24.6% ➖ noise
86 duckdb:duckdb -1.2% -1.1% -0.0% +24.6% ➖ noise
86 duckdb:vortex-compact +1.4% -1.1% +2.6% +24.6% ➖ noise
86 duckdb:vortex-file-compressed -0.7% -1.1% +0.5% +24.6% ➖ noise
87 datafusion:vortex-compact +8.3% +1.5% +6.8% +24.6% ➖ noise
87 datafusion:vortex-file-compressed +2.5% +1.5% +1.0% +24.6% ➖ noise
87 duckdb:duckdb -1.7% +1.5% -3.1% +24.6% ➖ noise
87 duckdb:vortex-compact +1.6% +1.5% +0.1% +24.6% ➖ noise
87 duckdb:vortex-file-compressed +1.9% +1.5% +0.4% +24.6% ➖ noise
88 datafusion:vortex-compact -0.3% -0.3% +0.0% +24.6% ➖ noise
88 datafusion:vortex-file-compressed +0.1% -0.3% +0.4% +24.6% ➖ noise
88 duckdb:duckdb -2.1% -0.3% -1.8% +24.6% ➖ noise
88 duckdb:vortex-compact -0.8% -0.3% -0.5% +24.6% ➖ noise
88 duckdb:vortex-file-compressed +2.6% -0.3% +2.9% +24.6% ➖ noise
89 datafusion:vortex-compact +1.8% +5.1% -3.1% +24.6% ➖ noise
89 datafusion:vortex-file-compressed -3.7% +5.1% -8.3% +24.6% ➖ noise
89 duckdb:duckdb +1.8% +5.1% -3.1% +24.6% ➖ noise
89 duckdb:vortex-compact -0.2% +5.1% -5.0% +24.6% ➖ noise
89 duckdb:vortex-file-compressed +0.7% +5.1% -4.2% +24.6% ➖ noise
90 datafusion:vortex-compact +5.4% +1.1% +4.3% +24.6% ➖ noise
90 datafusion:vortex-file-compressed -5.0% +1.1% -6.0% +24.6% ➖ noise
90 duckdb:duckdb -0.2% +1.1% -1.3% +24.6% ➖ noise
90 duckdb:vortex-compact +0.4% +1.1% -0.7% +24.6% ➖ noise
90 duckdb:vortex-file-compressed -6.4% +1.1% -7.4% +24.6% ➖ noise
91 datafusion:vortex-compact +1.7% +5.9% -4.0% +24.6% ➖ noise
91 datafusion:vortex-file-compressed +0.2% +5.9% -5.4% +24.6% ➖ noise
91 duckdb:duckdb +3.4% +5.9% -2.4% +24.6% ➖ noise
91 duckdb:vortex-compact +2.1% +5.9% -3.6% +24.6% ➖ noise
91 duckdb:vortex-file-compressed -9.3% +5.9% -14.4% +24.6% ➖ noise
92 datafusion:vortex-compact -5.4% +3.0% -8.1% +24.6% ➖ noise
92 datafusion:vortex-file-compressed +0.9% +3.0% -2.0% +24.6% ➖ noise
92 duckdb:duckdb -4.4% +3.0% -7.1% +24.6% ➖ noise
92 duckdb:vortex-compact +6.3% +3.0% +3.3% +24.6% ➖ noise
92 duckdb:vortex-file-compressed -15.2% +3.0% -17.6% +24.6% ➖ noise
93 datafusion:vortex-compact -6.9% -4.1% -2.9% +24.6% ➖ noise
93 datafusion:vortex-file-compressed +0.9% -4.1% +5.2% +24.6% ➖ noise
93 duckdb:duckdb +1.7% -4.1% +6.1% +24.6% ➖ noise
93 duckdb:vortex-compact +2.3% -4.1% +6.7% +24.6% ➖ noise
93 duckdb:vortex-file-compressed -4.2% -4.1% -0.1% +24.6% ➖ noise
94 datafusion:vortex-compact -2.5% +6.5% -8.4% +24.6% ➖ noise
94 datafusion:vortex-file-compressed -4.6% +6.5% -10.5% +24.6% ➖ noise
94 duckdb:duckdb +0.7% +6.5% -5.4% +24.6% ➖ noise
94 duckdb:vortex-compact +4.9% +6.5% -1.6% +24.6% ➖ noise
94 duckdb:vortex-file-compressed -10.5% +6.5% -16.0% +24.6% ➖ noise
95 datafusion:vortex-compact +2.6% +8.4% -5.3% +24.6% ➖ noise
95 datafusion:vortex-file-compressed -3.7% +8.4% -11.1% +24.6% ➖ noise
95 duckdb:duckdb -13.4% +8.4% -20.0% +24.6% ✅ faster
95 duckdb:vortex-compact +2.0% +8.4% -5.9% +24.6% ➖ noise
95 duckdb:vortex-file-compressed -13.1% +8.4% -19.8% +24.6% ✅ faster
96 datafusion:vortex-compact -0.7% +5.9% -6.2% +24.6% ➖ noise
96 datafusion:vortex-file-compressed -4.4% +5.9% -9.7% +24.6% ➖ noise
96 duckdb:duckdb +0.5% +5.9% -5.0% +24.6% ➖ noise
96 duckdb:vortex-compact -1.1% +5.9% -6.6% +24.6% ➖ noise
96 duckdb:vortex-file-compressed +0.1% +5.9% -5.4% +44.6% ➖ noise
97 datafusion:vortex-compact -1.2% +3.5% -4.6% +24.6% ➖ noise
97 datafusion:vortex-file-compressed -0.2% +3.5% -3.6% +24.6% ➖ noise
97 duckdb:duckdb -1.5% +3.5% -4.8% +24.6% ➖ noise
97 duckdb:vortex-compact +5.3% +3.5% +1.7% +24.6% ➖ noise
97 duckdb:vortex-file-compressed -13.4% +3.5% -16.4% +24.6% ➖ noise
98 datafusion:vortex-compact +2.1% +3.3% -1.1% +24.6% ➖ noise
98 datafusion:vortex-file-compressed +1.8% +3.3% -1.4% +24.6% ➖ noise
98 duckdb:duckdb -0.8% +3.3% -3.9% +24.6% ➖ noise
98 duckdb:vortex-compact +7.4% +3.3% +4.0% +24.6% ➖ noise
98 duckdb:vortex-file-compressed -9.0% +3.3% -11.9% +24.6% ➖ noise
99 datafusion:vortex-compact -11.4% +5.5% -16.0% +24.6% ➖ noise
99 datafusion:vortex-file-compressed +14.9% +5.5% +8.9% +24.6% ➖ noise
99 duckdb:duckdb -1.3% +5.5% -6.4% +24.6% ➖ noise
99 duckdb:vortex-compact +0.1% +5.5% -5.1% +24.6% ➖ noise
99 duckdb:vortex-file-compressed -4.5% +5.5% -9.5% +24.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.981x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.0%


duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12344274 12339454 1.00
statpopgen_q01/duckdb:vortex-file-compressed 27823997 28131692 0.99
statpopgen_q02/duckdb:vortex-file-compressed 540717279 561785263 0.96
statpopgen_q03/duckdb:vortex-file-compressed 1053694991 1069550399 0.99
statpopgen_q04/duckdb:vortex-file-compressed 1077116479 1056909178 1.02
statpopgen_q05/duckdb:vortex-file-compressed 479917927 486166497 0.99
statpopgen_q06/duckdb:vortex-file-compressed 1542189067 1532930911 1.01
statpopgen_q07/duckdb:vortex-file-compressed 206224322 206958509 1.00
statpopgen_q08/duckdb:vortex-file-compressed 240347665 238902259 1.01
statpopgen_q09/duckdb:vortex-file-compressed 850156166 846251353 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2567988103 2556639042 1.00
duckdb / vortex-compact (0.967x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11673622 11659457 1.00
statpopgen_q01/duckdb:vortex-compact 222755483 213581254 1.04
statpopgen_q02/duckdb:vortex-compact 559395015 565296698 0.99
statpopgen_q03/duckdb:vortex-compact 1160115360 1165336806 1.00
statpopgen_q04/duckdb:vortex-compact 1140165066 1234771954 0.92
statpopgen_q05/duckdb:vortex-compact 559885530 589164689 0.95
statpopgen_q06/duckdb:vortex-compact 1505159829 1577209481 0.95
statpopgen_q07/duckdb:vortex-compact 892778303 915163694 0.98
statpopgen_q08/duckdb:vortex-compact 917153650 946346933 0.97
statpopgen_q09/duckdb:vortex-compact 916350070 1000631389 0.92
statpopgen_q10/duckdb:vortex-compact 2587452285 2804233887 0.92
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 307058311 307015130 1.00
statpopgen_q01/duckdb:parquet 386857321 382756387 1.01
statpopgen_q02/duckdb:parquet 764149845 767971751 1.00
statpopgen_q03/duckdb:parquet 1202126617 1206169427 1.00
statpopgen_q04/duckdb:parquet 1195752208 1196236558 1.00
statpopgen_q05/duckdb:parquet 810809665 816374407 0.99
statpopgen_q06/duckdb:parquet 1431455228 1426875387 1.00
statpopgen_q07/duckdb:parquet 862402019 849072910 1.02
statpopgen_q08/duckdb:parquet 875632305 850404760 1.03
statpopgen_q09/duckdb:parquet 1035418636 1034920410 1.00
statpopgen_q10/duckdb:parquet 2190530273 2241858120 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +0.1% +0.0% +0.1% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.0% +0.0% +0.0% +10.0% ➖ noise
1 duckdb:vortex-compact +4.3% +1.1% +3.2% +69.3% ➖ noise
1 duckdb:vortex-file-compressed -1.1% +1.1% -2.1% +216.8% ➖ noise
2 duckdb:vortex-compact -1.0% -0.5% -0.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.8% -0.5% -3.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.4% -0.3% -0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.5% -0.3% -1.2% +10.0% ➖ noise
4 duckdb:vortex-compact -7.7% -0.0% -7.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.9% -0.0% +2.0% +10.0% ➖ noise
5 duckdb:vortex-compact -5.0% -0.7% -4.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.3% -0.7% -0.6% +10.0% ➖ noise
6 duckdb:vortex-compact -4.6% +0.3% -4.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.6% +0.3% +0.3% +10.0% ➖ noise
7 duckdb:vortex-compact -2.4% +1.6% -4.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.4% +1.6% -1.9% +10.0% ➖ noise
8 duckdb:vortex-compact -3.1% +3.0% -5.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.6% +3.0% -2.3% +10.0% ➖ noise
9 duckdb:vortex-compact -8.4% +0.0% -8.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.5% +0.0% +0.4% +10.0% ➖ noise
10 duckdb:vortex-compact -7.7% -2.3% -5.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.4% -2.3% +2.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.984x ➖
Shifts: Parquet (control) -1.6% · Median polish +3.2%


datafusion / vortex-file-compressed (0.908x ➖, 1↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 46582742 34910627 1.33
fineweb_q01/datafusion:vortex-file-compressed 598422614 823808200 0.73
fineweb_q02/datafusion:vortex-file-compressed 🚀 455813736 694761821 0.66
fineweb_q03/datafusion:vortex-file-compressed 1360199195 1581209431 0.86
fineweb_q04/datafusion:vortex-file-compressed 1370458904 1666084598 0.82
fineweb_q05/datafusion:vortex-file-compressed 1358153494 1615600553 0.84
fineweb_q06/datafusion:vortex-file-compressed 1642370146 1998028490 0.82
fineweb_q07/datafusion:vortex-file-compressed 1392494508 1484765446 0.94
fineweb_q08/datafusion:vortex-file-compressed 🚨 754852978 524387099 1.44
datafusion / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 39163702 34996644 1.12
fineweb_q01/datafusion:vortex-compact 456515854 593332445 0.77
fineweb_q02/datafusion:vortex-compact 552526887 586448555 0.94
fineweb_q03/datafusion:vortex-compact 1483725164 1356323703 1.09
fineweb_q04/datafusion:vortex-compact 1703950304 1593041769 1.07
fineweb_q05/datafusion:vortex-compact 1472960726 1390836201 1.06
fineweb_q06/datafusion:vortex-compact 1348341746 1455203849 0.93
fineweb_q07/datafusion:vortex-compact 1151889740 1179549885 0.98
fineweb_q08/datafusion:vortex-compact 378235721 414518955 0.91
datafusion / parquet (0.991x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1241124551 1093154025 1.14
fineweb_q01/datafusion:parquet 2599652385 2093982175 1.24
fineweb_q02/datafusion:parquet 1974122426 2055290789 0.96
fineweb_q03/datafusion:parquet 2130721554 1950131470 1.09
fineweb_q04/datafusion:parquet 1892823258 2029287308 0.93
fineweb_q05/datafusion:parquet 1975981013 2472998207 0.80
fineweb_q06/datafusion:parquet 2015473807 2064942684 0.98
fineweb_q07/datafusion:parquet 1888384578 2297764969 0.82
fineweb_q08/datafusion:parquet 2026940930 1941957460 1.04
duckdb / vortex-file-compressed (1.034x ➖, 1↑ 1↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 88591708 141620144 0.63
fineweb_q01/duckdb:vortex-file-compressed 647695946 699769785 0.93
fineweb_q02/duckdb:vortex-file-compressed 538654448 604007169 0.89
fineweb_q03/duckdb:vortex-file-compressed 1830225672 1452303848 1.26
fineweb_q04/duckdb:vortex-file-compressed 1811906098 1575408762 1.15
fineweb_q05/duckdb:vortex-file-compressed 🚨 2014018355 1488617811 1.35
fineweb_q06/duckdb:vortex-file-compressed 1801085268 1789954385 1.01
fineweb_q07/duckdb:vortex-file-compressed 1713806351 1565014896 1.10
fineweb_q08/duckdb:vortex-file-compressed 727886148 601105084 1.21
duckdb / vortex-compact (1.032x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 86317552 89123232 0.97
fineweb_q01/duckdb:vortex-compact 603633940 605779299 1.00
fineweb_q02/duckdb:vortex-compact 608932204 616786114 0.99
fineweb_q03/duckdb:vortex-compact 1847252735 1675010241 1.10
fineweb_q04/duckdb:vortex-compact 1919662826 1771467496 1.08
fineweb_q05/duckdb:vortex-compact 1806538682 1630036604 1.11
fineweb_q06/duckdb:vortex-compact 1714933406 1577392451 1.09
fineweb_q07/duckdb:vortex-compact 1801826644 1684736289 1.07
fineweb_q08/duckdb:vortex-compact 522831297 578621282 0.90
duckdb / parquet (0.978x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1168450634 1194289956 0.98
fineweb_q01/duckdb:parquet 1475967517 1450955635 1.02
fineweb_q02/duckdb:parquet 1321970105 1597308312 0.83
fineweb_q03/duckdb:parquet 4106781143 4031057040 1.02
fineweb_q04/duckdb:parquet 2137614398 2201375761 0.97
fineweb_q05/duckdb:parquet 2426430219 2140073505 1.13
fineweb_q06/duckdb:parquet 4717510813 4584744140 1.03
fineweb_q07/duckdb:parquet 2800828112 3100414280 0.90
fineweb_q08/duckdb:parquet 1121305950 1180910691 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +11.9% +5.4% +6.2% +211.7% ➖ noise
0 datafusion:vortex-file-compressed +33.4% +5.4% +26.6% +163.6% ➖ noise
0 duckdb:vortex-compact -3.1% +5.4% -8.1% +76.5% ➖ noise
0 duckdb:vortex-file-compressed -37.4% +5.4% -40.6% +47.8% ✅ faster
1 datafusion:vortex-compact -23.1% +12.4% -31.5% +63.3% ➖ noise
1 datafusion:vortex-file-compressed -27.4% +12.4% -35.4% +68.6% ➖ noise
1 duckdb:vortex-compact -0.4% +12.4% -11.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -7.4% +12.4% -17.6% +72.9% ➖ noise
2 datafusion:vortex-compact -5.8% -10.8% +5.7% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -34.4% -10.8% -26.4% +83.5% ➖ noise
2 duckdb:vortex-compact -1.3% -10.8% +10.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -10.8% -10.8% +0.0% +48.4% ➖ noise
3 datafusion:vortex-compact +9.4% +5.5% +3.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -14.0% +5.5% -18.5% +30.0% ➖ noise
3 duckdb:vortex-compact +10.3% +5.5% +4.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +26.0% +5.5% +19.4% +30.0% ➖ noise
4 datafusion:vortex-compact +7.0% -4.8% +12.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -17.7% -4.8% -13.6% +30.0% ➖ noise
4 duckdb:vortex-compact +8.4% -4.8% +13.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +15.0% -4.8% +20.8% +30.0% ➖ noise
5 datafusion:vortex-compact +5.9% -4.8% +11.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -15.9% -4.8% -11.7% +30.0% ➖ noise
5 duckdb:vortex-compact +10.8% -4.8% +16.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +35.3% -4.8% +42.1% +30.0% 🚨 regression
6 datafusion:vortex-compact -7.3% +0.2% -7.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -17.8% +0.2% -18.0% +30.0% ➖ noise
6 duckdb:vortex-compact +8.7% +0.2% +8.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +0.6% +0.2% +0.4% +30.0% ➖ noise
7 datafusion:vortex-compact -2.3% -13.8% +13.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -6.2% -13.8% +8.8% +30.0% ➖ noise
7 duckdb:vortex-compact +7.0% -13.8% +24.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +9.5% -13.8% +27.1% +30.0% ➖ noise
8 datafusion:vortex-compact -8.8% -0.4% -8.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +43.9% -0.4% +44.6% +56.5% ➖ noise
8 duckdb:vortex-compact -9.6% -0.4% -9.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +21.1% -0.4% +21.6% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.2%
Vortex (geomean): 0.947x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -5.3%


datafusion / vortex-file-compressed (0.892x ✅, 17↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 506034013 417651941 1.21
tpch_q02/datafusion:vortex-file-compressed 🚨 128816100 114502330 1.13
tpch_q03/datafusion:vortex-file-compressed 🚀 201176001 235000102 0.86
tpch_q04/datafusion:vortex-file-compressed 🚀 100259802 120575203 0.83
tpch_q05/datafusion:vortex-file-compressed 🚀 332073438 404717704 0.82
tpch_q06/datafusion:vortex-file-compressed 36125353 38306021 0.94
tpch_q07/datafusion:vortex-file-compressed 🚀 447617759 551327407 0.81
tpch_q08/datafusion:vortex-file-compressed 🚀 333684169 386443180 0.86
tpch_q09/datafusion:vortex-file-compressed 🚀 564816941 688910635 0.82
tpch_q10/datafusion:vortex-file-compressed 🚀 220778221 246261554 0.90
tpch_q11/datafusion:vortex-file-compressed 🚀 74735495 87259896 0.86
tpch_q12/datafusion:vortex-file-compressed 🚀 109623637 126497270 0.87
tpch_q13/datafusion:vortex-file-compressed 🚀 197900833 228697426 0.87
tpch_q14/datafusion:vortex-file-compressed 🚀 49217706 55088215 0.89
tpch_q15/datafusion:vortex-file-compressed 95441324 104906069 0.91
tpch_q16/datafusion:vortex-file-compressed 🚀 73569986 82144025 0.90
tpch_q17/datafusion:vortex-file-compressed 🚀 558522648 694413374 0.80
tpch_q18/datafusion:vortex-file-compressed 🚀 795915246 929904241 0.86
tpch_q19/datafusion:vortex-file-compressed 77108031 72269234 1.07
tpch_q20/datafusion:vortex-file-compressed 🚀 155434883 180649646 0.86
tpch_q21/datafusion:vortex-file-compressed 🚀 601339349 730628057 0.82
tpch_q22/datafusion:vortex-file-compressed 🚀 56650186 66527757 0.85
datafusion / vortex-compact (0.949x ➖, 9↑ 3↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 449207857 459356114 0.98
tpch_q02/datafusion:vortex-compact 🚀 103410972 118807622 0.87
tpch_q03/datafusion:vortex-compact 🚀 200544402 246056631 0.82
tpch_q04/datafusion:vortex-compact 🚀 110974741 131659824 0.84
tpch_q05/datafusion:vortex-compact 🚀 366028192 427417805 0.86
tpch_q06/datafusion:vortex-compact 🚨 71782136 63651991 1.13
tpch_q07/datafusion:vortex-compact 613981032 577308528 1.06
tpch_q08/datafusion:vortex-compact 🚨 448219492 399099671 1.12
tpch_q09/datafusion:vortex-compact 🚀 596624743 704389696 0.85
tpch_q10/datafusion:vortex-compact 241817035 259159659 0.93
tpch_q11/datafusion:vortex-compact 🚀 77623529 87710013 0.89
tpch_q12/datafusion:vortex-compact 154727488 162235545 0.95
tpch_q13/datafusion:vortex-compact 249386047 272619335 0.91
tpch_q14/datafusion:vortex-compact 66447281 72501948 0.92
tpch_q15/datafusion:vortex-compact 151931173 158369261 0.96
tpch_q16/datafusion:vortex-compact 80041754 82114267 0.97
tpch_q17/datafusion:vortex-compact 🚀 575676409 676660705 0.85
tpch_q18/datafusion:vortex-compact 818317318 884647423 0.93
tpch_q19/datafusion:vortex-compact 🚨 210232805 123319657 1.70
tpch_q20/datafusion:vortex-compact 180051259 198384678 0.91
tpch_q21/datafusion:vortex-compact 🚀 606258386 694624532 0.87
tpch_q22/datafusion:vortex-compact 🚀 62637117 73481063 0.85
datafusion / parquet (0.971x ➖, 6↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 520277584 485584481 1.07
tpch_q02/datafusion:parquet 173346992 182973737 0.95
tpch_q03/datafusion:parquet 🚀 258212054 296483495 0.87
tpch_q04/datafusion:parquet 🚀 120728339 134618584 0.90
tpch_q05/datafusion:parquet 🚀 398213225 468809629 0.85
tpch_q06/datafusion:parquet 128936534 124521939 1.04
tpch_q07/datafusion:parquet 🚀 555301723 653902524 0.85
tpch_q08/datafusion:parquet 445526796 493224025 0.90
tpch_q09/datafusion:parquet 🚀 716529638 798154006 0.90
tpch_q10/datafusion:parquet 557139876 525424806 1.06
tpch_q11/datafusion:parquet 119017513 123052082 0.97
tpch_q12/datafusion:parquet 210504809 198607862 1.06
tpch_q13/datafusion:parquet 346033650 344238337 1.01
tpch_q14/datafusion:parquet 151488204 163050106 0.93
tpch_q15/datafusion:parquet 253070094 260347682 0.97
tpch_q16/datafusion:parquet 120925680 132138582 0.92
tpch_q17/datafusion:parquet 🚀 656777529 743260961 0.88
tpch_q18/datafusion:parquet 877866561 938898569 0.93
tpch_q19/datafusion:parquet 🚨 323714524 264158485 1.23
tpch_q20/datafusion:parquet 🚨 354686916 304379103 1.17
tpch_q21/datafusion:parquet 790918864 744567684 1.06
tpch_q22/datafusion:parquet 214647623 221067293 0.97
datafusion / arrow (0.904x ➖, 10↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 701061853 648494283 1.08
tpch_q02/datafusion:arrow 🚀 113902548 174837840 0.65
tpch_q03/datafusion:arrow 512726946 526516370 0.97
tpch_q04/datafusion:arrow 368746048 382806236 0.96
tpch_q05/datafusion:arrow 🚀 746123949 1021984926 0.73
tpch_q06/datafusion:arrow 335059748 314917132 1.06
tpch_q07/datafusion:arrow 1151731173 1272988698 0.90
tpch_q08/datafusion:arrow 🚀 961051246 1244484314 0.77
tpch_q09/datafusion:arrow 🚀 1301140931 1450524906 0.90
tpch_q10/datafusion:arrow 🚨 815638179 660525395 1.23
tpch_q11/datafusion:arrow 🚀 112621685 147742445 0.76
tpch_q12/datafusion:arrow 🚨 1454967077 816213153 1.78
tpch_q13/datafusion:arrow 469888396 518488457 0.91
tpch_q14/datafusion:arrow 357832525 365487889 0.98
tpch_q15/datafusion:arrow 726723925 799126954 0.91
tpch_q16/datafusion:arrow 🚀 80975813 111864938 0.72
tpch_q17/datafusion:arrow 🚀 934729702 1476891841 0.63
tpch_q18/datafusion:arrow 🚀 1727534938 2087063357 0.83
tpch_q19/datafusion:arrow 540796200 543942448 0.99
tpch_q20/datafusion:arrow 🚀 493502154 549861671 0.90
tpch_q21/datafusion:arrow 3125080159 3207757830 0.97
tpch_q22/datafusion:arrow 🚀 108956938 143298512 0.76
duckdb / vortex-file-compressed (0.959x ➖, 1↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171991646 174497732 0.99
tpch_q02/duckdb:vortex-file-compressed 53706187 55283956 0.97
tpch_q03/duckdb:vortex-file-compressed 124029737 133374977 0.93
tpch_q04/duckdb:vortex-file-compressed 160002429 170922495 0.94
tpch_q05/duckdb:vortex-file-compressed 136815489 144814287 0.94
tpch_q06/duckdb:vortex-file-compressed 🚀 32430273 38280452 0.85
tpch_q07/duckdb:vortex-file-compressed 136770977 142145940 0.96
tpch_q08/duckdb:vortex-file-compressed 168488277 178839871 0.94
tpch_q09/duckdb:vortex-file-compressed 390059786 401838532 0.97
tpch_q10/duckdb:vortex-file-compressed 189026059 198284045 0.95
tpch_q11/duckdb:vortex-file-compressed 33155875 34175990 0.97
tpch_q12/duckdb:vortex-file-compressed 99724105 103831776 0.96
tpch_q13/duckdb:vortex-file-compressed 228012247 239303860 0.95
tpch_q14/duckdb:vortex-file-compressed 56437323 57044498 0.99
tpch_q15/duckdb:vortex-file-compressed 90229775 96144906 0.94
tpch_q16/duckdb:vortex-file-compressed 77886931 82729465 0.94
tpch_q17/duckdb:vortex-file-compressed 94668800 96764670 0.98
tpch_q18/duckdb:vortex-file-compressed 290429295 297554233 0.98
tpch_q19/duckdb:vortex-file-compressed 78826753 80672776 0.98
tpch_q20/duckdb:vortex-file-compressed 150862331 160685624 0.94
tpch_q21/duckdb:vortex-file-compressed 490221386 512128358 0.96
tpch_q22/duckdb:vortex-file-compressed 72754365 66528387 1.09
duckdb / vortex-compact (0.992x ➖, 0↑ 3↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 255281354 229540960 1.11
tpch_q02/duckdb:vortex-compact 🚨 66495776 60408683 1.10
tpch_q03/duckdb:vortex-compact 🚨 165956652 145847271 1.14
tpch_q04/duckdb:vortex-compact 192058219 183780226 1.05
tpch_q05/duckdb:vortex-compact 164395120 171049256 0.96
tpch_q06/duckdb:vortex-compact 61382249 56253987 1.09
tpch_q07/duckdb:vortex-compact 172455470 179121454 0.96
tpch_q08/duckdb:vortex-compact 192260554 196669588 0.98
tpch_q09/duckdb:vortex-compact 432018565 445574969 0.97
tpch_q10/duckdb:vortex-compact 220534254 227504139 0.97
tpch_q11/duckdb:vortex-compact 39070635 40689455 0.96
tpch_q12/duckdb:vortex-compact 164961137 167574612 0.98
tpch_q13/duckdb:vortex-compact 280454394 289985397 0.97
tpch_q14/duckdb:vortex-compact 75409981 75986245 0.99
tpch_q15/duckdb:vortex-compact 113366479 120430933 0.94
tpch_q16/duckdb:vortex-compact 81848133 82756874 0.99
tpch_q17/duckdb:vortex-compact 109648109 115222301 0.95
tpch_q18/duckdb:vortex-compact 287940128 302378781 0.95
tpch_q19/duckdb:vortex-compact 96895115 99447522 0.97
tpch_q20/duckdb:vortex-compact 182943145 195762568 0.93
tpch_q21/duckdb:vortex-compact 516954863 557533009 0.93
tpch_q22/duckdb:vortex-compact 70913955 74235454 0.96
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 264059678 270354898 0.98
tpch_q02/duckdb:parquet 101637992 102726354 0.99
tpch_q03/duckdb:parquet 212607762 214197350 0.99
tpch_q04/duckdb:parquet 134002129 136120465 0.98
tpch_q05/duckdb:parquet 224910397 231040944 0.97
tpch_q06/duckdb:parquet 74930430 75755237 0.99
tpch_q07/duckdb:parquet 183090101 191230859 0.96
tpch_q08/duckdb:parquet 258471252 268410103 0.96
tpch_q09/duckdb:parquet 471850799 492733093 0.96
tpch_q10/duckdb:parquet 665447210 647592390 1.03
tpch_q11/duckdb:parquet 69299993 65939511 1.05
tpch_q12/duckdb:parquet 145991449 135612458 1.08
tpch_q13/duckdb:parquet 443711051 432354404 1.03
tpch_q14/duckdb:parquet 180083041 181520687 0.99
tpch_q15/duckdb:parquet 106262083 106369712 1.00
tpch_q16/duckdb:parquet 170431982 169843707 1.00
tpch_q17/duckdb:parquet 198650734 184088102 1.08
tpch_q18/duckdb:parquet 397076014 367312047 1.08
tpch_q19/duckdb:parquet 282244914 291955579 0.97
tpch_q20/duckdb:parquet 229293477 234171635 0.98
tpch_q21/duckdb:parquet 546897007 580693640 0.94
tpch_q22/duckdb:parquet 295018008 297475919 0.99
duckdb / duckdb (0.969x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 121281385 121127520 1.00
tpch_q02/duckdb:duckdb 47987730 50776477 0.95
tpch_q03/duckdb:duckdb 103910939 107009337 0.97
tpch_q04/duckdb:duckdb 138306598 144240577 0.96
tpch_q05/duckdb:duckdb 119203479 123261986 0.97
tpch_q06/duckdb:duckdb 44435280 45257323 0.98
tpch_q07/duckdb:duckdb 90578127 93374177 0.97
tpch_q08/duckdb:duckdb 117521917 122251602 0.96
tpch_q09/duckdb:duckdb 279832250 289727370 0.97
tpch_q10/duckdb:duckdb 212546745 221794217 0.96
tpch_q11/duckdb:duckdb 19336665 19481314 0.99
tpch_q12/duckdb:duckdb 89888161 91245584 0.99
tpch_q13/duckdb:duckdb 229357031 244415497 0.94
tpch_q14/duckdb:duckdb 77119968 80229558 0.96
tpch_q15/duckdb:duckdb 82294773 83394514 0.99
tpch_q16/duckdb:duckdb 75300037 78986475 0.95
tpch_q17/duckdb:duckdb 87116643 88687476 0.98
tpch_q18/duckdb:duckdb 235193250 247016735 0.95
tpch_q19/duckdb:duckdb 123397266 126545643 0.98
tpch_q20/duckdb:duckdb 117173473 119548274 0.98
tpch_q21/duckdb:duckdb 300319818 309689284 0.97
tpch_q22/duckdb:duckdb 69165231 72380134 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +8.1% +2.3% +5.7% +14.6% ➖ noise
1 datafusion:vortex-compact -2.2% +2.3% -4.4% +14.6% ➖ noise
1 datafusion:vortex-file-compressed +21.2% +2.3% +18.4% +14.6% 🚨 regression
1 duckdb:duckdb +0.1% +2.3% -2.1% +14.6% ➖ noise
1 duckdb:vortex-compact +11.2% +2.3% +8.7% +14.6% ➖ noise
1 duckdb:vortex-file-compressed -1.4% +2.3% -3.7% +14.6% ➖ noise
2 datafusion:arrow -34.9% -3.2% -32.7% +14.6% ✅ faster
2 datafusion:vortex-compact -13.0% -3.2% -10.1% +14.6% ➖ noise
2 datafusion:vortex-file-compressed +12.5% -3.2% +16.2% +14.6% 🚨 regression
2 duckdb:duckdb -5.5% -3.2% -2.4% +14.6% ➖ noise
2 duckdb:vortex-compact +10.1% -3.2% +13.7% +14.6% ➖ noise
2 duckdb:vortex-file-compressed -2.9% -3.2% +0.3% +14.6% ➖ noise
3 datafusion:arrow -2.6% -7.0% +4.7% +14.6% ➖ noise
3 datafusion:vortex-compact -18.5% -7.0% -12.3% +14.6% ➖ noise
3 datafusion:vortex-file-compressed -14.4% -7.0% -7.9% +14.6% ➖ noise
3 duckdb:duckdb -2.9% -7.0% +4.4% +14.6% ➖ noise
3 duckdb:vortex-compact +13.8% -7.0% +22.4% +14.6% 🚨 regression
3 duckdb:vortex-file-compressed -7.0% -7.0% +0.0% +14.6% ➖ noise
4 datafusion:arrow -3.7% -6.0% +2.5% +14.6% ➖ noise
4 datafusion:vortex-compact -15.7% -6.0% -10.3% +14.6% ➖ noise
4 datafusion:vortex-file-compressed -16.8% -6.0% -11.5% +14.6% ➖ noise
4 duckdb:duckdb -4.1% -6.0% +2.0% +14.6% ➖ noise
4 duckdb:vortex-compact +4.5% -6.0% +11.2% +14.6% ➖ noise
4 duckdb:vortex-file-compressed -6.4% -6.0% -0.4% +14.6% ➖ noise
5 datafusion:arrow -27.0% -9.1% -19.7% +14.6% ✅ faster
5 datafusion:vortex-compact -14.4% -9.1% -5.8% +14.6% ➖ noise
5 datafusion:vortex-file-compressed -17.9% -9.1% -9.8% +14.6% ➖ noise
5 duckdb:duckdb -3.3% -9.1% +6.4% +14.6% ➖ noise
5 duckdb:vortex-compact -3.9% -9.1% +5.7% +14.6% ➖ noise
5 duckdb:vortex-file-compressed -5.5% -9.1% +3.9% +14.6% ➖ noise
6 datafusion:arrow +6.4% +1.2% +5.1% +14.6% ➖ noise
6 datafusion:vortex-compact +12.8% +1.2% +11.4% +14.6% ➖ noise
6 datafusion:vortex-file-compressed -5.7% +1.2% -6.8% +14.6% ➖ noise
6 duckdb:duckdb -1.8% +1.2% -3.0% +14.6% ➖ noise
6 duckdb:vortex-compact +9.1% +1.2% +7.8% +14.6% ➖ noise
6 duckdb:vortex-file-compressed -15.3% +1.2% -16.3% +14.6% ✅ faster
7 datafusion:arrow -9.5% -9.8% +0.3% +14.6% ➖ noise
7 datafusion:vortex-compact +6.4% -9.8% +17.9% +14.6% 🚨 regression
7 datafusion:vortex-file-compressed -18.8% -9.8% -10.0% +14.6% ➖ noise
7 duckdb:duckdb -3.0% -9.8% +7.6% +14.6% ➖ noise
7 duckdb:vortex-compact -3.7% -9.8% +6.8% +14.6% ➖ noise
7 duckdb:vortex-file-compressed -3.8% -9.8% +6.7% +14.6% ➖ noise
8 datafusion:arrow -22.8% -6.7% -17.2% +14.6% ✅ faster
8 datafusion:vortex-compact +12.3% -6.7% +20.4% +14.6% 🚨 regression
8 datafusion:vortex-file-compressed -13.7% -6.7% -7.4% +14.6% ➖ noise
8 duckdb:duckdb -3.9% -6.7% +3.1% +14.6% ➖ noise
8 duckdb:vortex-compact -2.2% -6.7% +4.8% +14.6% ➖ noise
8 duckdb:vortex-file-compressed -5.8% -6.7% +1.0% +14.6% ➖ noise
9 datafusion:arrow -10.3% -7.3% -3.3% +14.6% ➖ noise
9 datafusion:vortex-compact -15.3% -7.3% -8.6% +14.6% ➖ noise
9 datafusion:vortex-file-compressed -18.0% -7.3% -11.6% +14.6% ➖ noise
9 duckdb:duckdb -3.4% -7.3% +4.2% +14.6% ➖ noise
9 duckdb:vortex-compact -3.0% -7.3% +4.6% +14.6% ➖ noise
9 duckdb:vortex-file-compressed -2.9% -7.3% +4.7% +14.6% ➖ noise
10 datafusion:arrow +23.5% +4.4% +18.3% +14.6% 🚨 regression
10 datafusion:vortex-compact -6.7% +4.4% -10.6% +14.6% ➖ noise
10 datafusion:vortex-file-compressed -10.3% +4.4% -14.1% +14.6% ✅ faster
10 duckdb:duckdb -4.2% +4.4% -8.2% +14.6% ➖ noise
10 duckdb:vortex-compact -3.1% +4.4% -7.1% +14.6% ➖ noise
10 duckdb:vortex-file-compressed -4.7% +4.4% -8.7% +14.6% ➖ noise
11 datafusion:arrow -23.8% +0.8% -24.4% +14.6% ✅ faster
11 datafusion:vortex-compact -11.5% +0.8% -12.2% +14.6% ➖ noise
11 datafusion:vortex-file-compressed -14.4% +0.8% -15.1% +14.6% ✅ faster
11 duckdb:duckdb -0.7% +0.8% -1.6% +14.6% ➖ noise
11 duckdb:vortex-compact -4.0% +0.8% -4.8% +14.6% ➖ noise
11 duckdb:vortex-file-compressed -3.0% +0.8% -3.8% +14.6% ➖ noise
12 datafusion:arrow +78.3% +6.8% +66.9% +34.8% 🚨 regression
12 datafusion:vortex-compact -4.6% +6.8% -10.7% +14.6% ➖ noise
12 datafusion:vortex-file-compressed -13.3% +6.8% -18.9% +14.6% ✅ faster
12 duckdb:duckdb -1.5% +6.8% -7.8% +14.6% ➖ noise
12 duckdb:vortex-compact -1.6% +6.8% -7.8% +14.6% ➖ noise
12 duckdb:vortex-file-compressed -4.0% +6.8% -10.1% +14.6% ➖ noise
13 datafusion:arrow -9.4% +1.6% -10.8% +14.6% ➖ noise
13 datafusion:vortex-compact -8.5% +1.6% -9.9% +14.6% ➖ noise
13 datafusion:vortex-file-compressed -13.5% +1.6% -14.8% +14.6% ✅ faster
13 duckdb:duckdb -6.2% +1.6% -7.6% +14.6% ➖ noise
13 duckdb:vortex-compact -3.3% +1.6% -4.8% +14.6% ➖ noise
13 duckdb:vortex-file-compressed -4.7% +1.6% -6.2% +14.6% ➖ noise
14 datafusion:arrow -2.1% -4.0% +2.0% +14.6% ➖ noise
14 datafusion:vortex-compact -8.4% -4.0% -4.5% +14.6% ➖ noise
14 datafusion:vortex-file-compressed -10.7% -4.0% -6.9% +14.6% ➖ noise
14 duckdb:duckdb -3.9% -4.0% +0.1% +14.6% ➖ noise
14 duckdb:vortex-compact -0.8% -4.0% +3.4% +14.6% ➖ noise
14 duckdb:vortex-file-compressed -1.1% -4.0% +3.1% +14.6% ➖ noise
15 datafusion:arrow -9.1% -1.5% -7.7% +14.6% ➖ noise
15 datafusion:vortex-compact -4.1% -1.5% -2.6% +14.6% ➖ noise
15 datafusion:vortex-file-compressed -9.0% -1.5% -7.7% +14.6% ➖ noise
15 duckdb:duckdb -1.3% -1.5% +0.1% +14.6% ➖ noise
15 duckdb:vortex-compact -5.9% -1.5% -4.5% +14.6% ➖ noise
15 duckdb:vortex-file-compressed -6.2% -1.5% -4.8% +14.6% ➖ noise
16 datafusion:arrow -27.6% -4.2% -24.5% +14.6% ✅ faster
16 datafusion:vortex-compact -2.5% -4.2% +1.7% +14.6% ➖ noise
16 datafusion:vortex-file-compressed -10.4% -4.2% -6.5% +14.6% ➖ noise
16 duckdb:duckdb -4.7% -4.2% -0.5% +14.6% ➖ noise
16 duckdb:vortex-compact -1.1% -4.2% +3.2% +14.6% ➖ noise
16 duckdb:vortex-file-compressed -5.9% -4.2% -1.8% +14.6% ➖ noise
17 datafusion:arrow -36.7% -2.4% -35.2% +14.6% ✅ faster
17 datafusion:vortex-compact -14.9% -2.4% -12.9% +14.6% ✅ faster
17 datafusion:vortex-file-compressed -19.6% -2.4% -17.6% +14.6% ✅ faster
17 duckdb:duckdb -1.8% -2.4% +0.6% +14.6% ➖ noise
17 duckdb:vortex-compact -4.8% -2.4% -2.5% +14.6% ➖ noise
17 duckdb:vortex-file-compressed -2.2% -2.4% +0.2% +14.6% ➖ noise
18 datafusion:arrow -17.2% +0.5% -17.7% +14.6% ✅ faster
18 datafusion:vortex-compact -7.5% +0.5% -8.0% +14.6% ➖ noise
18 datafusion:vortex-file-compressed -14.4% +0.5% -14.9% +14.6% ✅ faster
18 duckdb:duckdb -4.8% +0.5% -5.3% +14.6% ➖ noise
18 duckdb:vortex-compact -4.8% +0.5% -5.3% +14.6% ➖ noise
18 duckdb:vortex-file-compressed -2.4% +0.5% -2.9% +14.6% ➖ noise
19 datafusion:arrow -0.6% +8.8% -8.7% +14.6% ➖ noise
19 datafusion:vortex-compact +70.5% +8.8% +56.6% +14.6% 🚨 regression
19 datafusion:vortex-file-compressed +6.7% +8.8% -2.0% +14.6% ➖ noise
19 duckdb:duckdb -2.5% +8.8% -10.4% +14.6% ➖ noise
19 duckdb:vortex-compact -2.6% +8.8% -10.5% +14.6% ➖ noise
19 duckdb:vortex-file-compressed -2.3% +8.8% -10.2% +14.6% ➖ noise
20 datafusion:arrow -10.2% +6.8% -16.0% +14.6% ✅ faster
20 datafusion:vortex-compact -9.2% +6.8% -15.0% +14.6% ✅ faster
20 datafusion:vortex-file-compressed -14.0% +6.8% -19.4% +14.6% ✅ faster
20 duckdb:duckdb -2.0% +6.8% -8.2% +14.6% ➖ noise
20 duckdb:vortex-compact -6.5% +6.8% -12.5% +14.6% ➖ noise
20 duckdb:vortex-file-compressed -6.1% +6.8% -12.1% +14.6% ➖ noise
21 datafusion:arrow -2.6% +0.0% -2.6% +14.6% ➖ noise
21 datafusion:vortex-compact -12.7% +0.0% -12.7% +14.6% ➖ noise
21 datafusion:vortex-file-compressed -17.7% +0.0% -17.7% +14.6% ✅ faster
21 duckdb:duckdb -3.0% +0.0% -3.0% +14.6% ➖ noise
21 duckdb:vortex-compact -7.3% +0.0% -7.3% +14.6% ➖ noise
21 duckdb:vortex-file-compressed -4.3% +0.0% -4.3% +14.6% ➖ noise
22 datafusion:arrow -24.0% -1.9% -22.5% +14.6% ✅ faster
22 datafusion:vortex-compact -14.8% -1.9% -13.1% +14.6% ✅ faster
22 datafusion:vortex-file-compressed -14.8% -1.9% -13.2% +14.6% ✅ faster
22 duckdb:duckdb -4.4% -1.9% -2.6% +14.6% ➖ noise
22 duckdb:vortex-compact -4.5% -1.9% -2.7% +14.6% ➖ noise
22 duckdb:vortex-file-compressed +9.4% -1.9% +11.4% +14.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.6%
Vortex (geomean): 0.948x ➖
Parquet (geomean): 1.061x ➖
Shifts: Parquet (control) +6.1% · Median polish +0.5%


datafusion / vortex-file-compressed (0.881x ✅, 18↑ 5↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 3352405 1621496 2.07
clickbench_q01/datafusion:vortex-file-compressed 🚨 22531120 18359622 1.23
clickbench_q02/datafusion:vortex-file-compressed 37864145 38565984 0.98
clickbench_q03/datafusion:vortex-file-compressed 43168999 41867916 1.03
clickbench_q04/datafusion:vortex-file-compressed 🚀 236416886 283614393 0.83
clickbench_q05/datafusion:vortex-file-compressed 303066525 302957278 1.00
clickbench_q06/datafusion:vortex-file-compressed 🚨 3282877 1673948 1.96
clickbench_q07/datafusion:vortex-file-compressed 🚨 26045056 22064397 1.18
clickbench_q08/datafusion:vortex-file-compressed 332849932 354604522 0.94
clickbench_q09/datafusion:vortex-file-compressed 🚀 446559238 547143442 0.82
clickbench_q10/datafusion:vortex-file-compressed 70969757 76494101 0.93
clickbench_q11/datafusion:vortex-file-compressed 80749336 84860205 0.95
clickbench_q12/datafusion:vortex-file-compressed 254886174 269418816 0.95
clickbench_q13/datafusion:vortex-file-compressed 405847663 406634094 1.00
clickbench_q14/datafusion:vortex-file-compressed 250161735 248029845 1.01
clickbench_q15/datafusion:vortex-file-compressed 🚀 277800991 321844749 0.86
clickbench_q16/datafusion:vortex-file-compressed 645128445 637407471 1.01
clickbench_q17/datafusion:vortex-file-compressed 647563110 638827369 1.01
clickbench_q18/datafusion:vortex-file-compressed 1316537729 1273381764 1.03
clickbench_q19/datafusion:vortex-file-compressed 🚨 36351482 30709996 1.18
clickbench_q20/datafusion:vortex-file-compressed 350413483 343938407 1.02
clickbench_q21/datafusion:vortex-file-compressed 375881534 369275909 1.02
clickbench_q22/datafusion:vortex-file-compressed 455881067 449074289 1.02
clickbench_q23/datafusion:vortex-file-compressed 🚀 533744167 609933266 0.88
clickbench_q24/datafusion:vortex-file-compressed 🚀 39286892 43887562 0.90
clickbench_q25/datafusion:vortex-file-compressed 73396773 75232353 0.98
clickbench_q26/datafusion:vortex-file-compressed 41956152 44690487 0.94
clickbench_q27/datafusion:vortex-file-compressed 707533039 718548268 0.98
clickbench_q28/datafusion:vortex-file-compressed 🚀 2512480110 6611386107 0.38
clickbench_q29/datafusion:vortex-file-compressed 🚀 48470567 245739867 0.20
clickbench_q30/datafusion:vortex-file-compressed 🚀 220404730 251963427 0.87
clickbench_q31/datafusion:vortex-file-compressed 🚀 237938206 292373563 0.81
clickbench_q32/datafusion:vortex-file-compressed 🚀 1013582008 1332396325 0.76
clickbench_q33/datafusion:vortex-file-compressed 1376479898 1492602054 0.92
clickbench_q34/datafusion:vortex-file-compressed 1367017446 1504413826 0.91
clickbench_q35/datafusion:vortex-file-compressed 🚀 237085316 509236055 0.47
clickbench_q36/datafusion:vortex-file-compressed 🚀 55021653 80682161 0.68
clickbench_q37/datafusion:vortex-file-compressed 🚀 25820100 37274049 0.69
clickbench_q38/datafusion:vortex-file-compressed 🚀 15074200 19953456 0.76
clickbench_q39/datafusion:vortex-file-compressed 🚀 118189283 144189628 0.82
clickbench_q40/datafusion:vortex-file-compressed 🚀 12163354 17874011 0.68
clickbench_q41/datafusion:vortex-file-compressed 🚀 11945073 16067508 0.74
clickbench_q42/datafusion:vortex-file-compressed 🚀 13244551 18189817 0.73
datafusion / parquet (1.164x ❌, 6↑ 12↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 25575781 1637078 15.62
clickbench_q01/datafusion:parquet 🚨 41996331 19662048 2.14
clickbench_q02/datafusion:parquet 🚨 67354160 47672431 1.41
clickbench_q03/datafusion:parquet 🚨 57102470 38217072 1.49
clickbench_q04/datafusion:parquet 280744377 293974902 0.95
clickbench_q05/datafusion:parquet 328026879 344749018 0.95
clickbench_q06/datafusion:parquet 🚨 25512920 1578711 16.16
clickbench_q07/datafusion:parquet 🚨 43883259 22547674 1.95
clickbench_q08/datafusion:parquet 347962530 363555778 0.96
clickbench_q09/datafusion:parquet 🚀 483118916 602196321 0.80
clickbench_q10/datafusion:parquet 111780172 103196686 1.08
clickbench_q11/datafusion:parquet 134841285 126719621 1.06
clickbench_q12/datafusion:parquet 318628220 345196184 0.92
clickbench_q13/datafusion:parquet 472566525 505268116 0.94
clickbench_q14/datafusion:parquet 328768239 334440900 0.98
clickbench_q15/datafusion:parquet 🚀 290926655 332433818 0.88
clickbench_q16/datafusion:parquet 654442337 660323539 0.99
clickbench_q17/datafusion:parquet 638284133 655004671 0.97
clickbench_q18/datafusion:parquet 1328303554 1349402494 0.98
clickbench_q19/datafusion:parquet 🚨 56008918 30712784 1.82
clickbench_q20/datafusion:parquet 575287779 596307858 0.96
clickbench_q21/datafusion:parquet 635100059 663883934 0.96
clickbench_q22/datafusion:parquet 908546925 972524816 0.93
clickbench_q23/datafusion:parquet 3958918895 3601921966 1.10
clickbench_q24/datafusion:parquet 76611479 76969337 1.00
clickbench_q25/datafusion:parquet 🚨 152477287 130252418 1.17
clickbench_q26/datafusion:parquet 77397799 85191416 0.91
clickbench_q27/datafusion:parquet 939950920 1022751434 0.92
clickbench_q28/datafusion:parquet 🚀 2641463972 6553014238 0.40
clickbench_q29/datafusion:parquet 🚀 69246884 241213419 0.29
clickbench_q30/datafusion:parquet 334310338 320826989 1.04
clickbench_q31/datafusion:parquet 365438704 359061343 1.02
clickbench_q32/datafusion:parquet 1088108637 1153437234 0.94
clickbench_q33/datafusion:parquet 1509848772 1466147363 1.03
clickbench_q34/datafusion:parquet 1496374856 1459465088 1.03
clickbench_q35/datafusion:parquet 🚀 268616884 459373404 0.58
clickbench_q36/datafusion:parquet 127963160 140782259 0.91
clickbench_q37/datafusion:parquet 🚨 67563698 56490017 1.20
clickbench_q38/datafusion:parquet 86486196 81705774 1.06
clickbench_q39/datafusion:parquet 🚀 225400183 256354198 0.88
clickbench_q40/datafusion:parquet 🚨 47877589 29682843 1.61
clickbench_q41/datafusion:parquet 🚨 46944318 27556069 1.70
clickbench_q42/datafusion:parquet 🚨 48107128 29250707 1.64
duckdb / vortex-file-compressed (1.020x ➖, 0↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6410752 7009411 0.91
clickbench_q01/duckdb:vortex-file-compressed 12352604 11996200 1.03
clickbench_q02/duckdb:vortex-file-compressed 26347692 24416071 1.08
clickbench_q03/duckdb:vortex-file-compressed 29883665 30741284 0.97
clickbench_q04/duckdb:vortex-file-compressed 190207813 187507891 1.01
clickbench_q05/duckdb:vortex-file-compressed 182040251 171706898 1.06
clickbench_q06/duckdb:vortex-file-compressed 20786430 20042896 1.04
clickbench_q07/duckdb:vortex-file-compressed 15575661 15486823 1.01
clickbench_q08/duckdb:vortex-file-compressed 270621743 265913206 1.02
clickbench_q09/duckdb:vortex-file-compressed 340572056 341669342 1.00
clickbench_q10/duckdb:vortex-file-compressed 69832814 68481151 1.02
clickbench_q11/duckdb:vortex-file-compressed 78494980 76944416 1.02
clickbench_q12/duckdb:vortex-file-compressed 199993852 192809405 1.04
clickbench_q13/duckdb:vortex-file-compressed 409642163 406133918 1.01
clickbench_q14/duckdb:vortex-file-compressed 233669938 227843640 1.03
clickbench_q15/duckdb:vortex-file-compressed 243077203 242345464 1.00
clickbench_q16/duckdb:vortex-file-compressed 537737898 520860821 1.03
clickbench_q17/duckdb:vortex-file-compressed 436051356 420464675 1.04
clickbench_q18/duckdb:vortex-file-compressed 960365413 933457401 1.03
clickbench_q19/duckdb:vortex-file-compressed 22286721 21031584 1.06
clickbench_q20/duckdb:vortex-file-compressed 338977168 330231413 1.03
clickbench_q21/duckdb:vortex-file-compressed 361263350 360958251 1.00
clickbench_q22/duckdb:vortex-file-compressed 🚨 633837769 573316181 1.11
clickbench_q23/duckdb:vortex-file-compressed 190153670 198986871 0.96
clickbench_q24/duckdb:vortex-file-compressed 🚨 37739569 33898990 1.11
clickbench_q25/duckdb:vortex-file-compressed 73904888 70419226 1.05
clickbench_q26/duckdb:vortex-file-compressed 41999228 39216738 1.07
clickbench_q27/duckdb:vortex-file-compressed 479730794 471726177 1.02
clickbench_q28/duckdb:vortex-file-compressed 3019623502 2989248247 1.01
clickbench_q29/duckdb:vortex-file-compressed 28620792 27893311 1.03
clickbench_q30/duckdb:vortex-file-compressed 192587461 189537047 1.02
clickbench_q31/duckdb:vortex-file-compressed 285392627 283473561 1.01
clickbench_q32/duckdb:vortex-file-compressed 1121294241 1101054201 1.02
clickbench_q33/duckdb:vortex-file-compressed 1077911664 1061904032 1.02
clickbench_q34/duckdb:vortex-file-compressed 1179300566 1151975415 1.02
clickbench_q35/duckdb:vortex-file-compressed 375492591 378938811 0.99
clickbench_q36/duckdb:vortex-file-compressed 27447448 26966191 1.02
clickbench_q37/duckdb:vortex-file-compressed 20640256 19315380 1.07
clickbench_q38/duckdb:vortex-file-compressed 21116394 20231143 1.04
clickbench_q39/duckdb:vortex-file-compressed 41453451 44863244 0.92
clickbench_q40/duckdb:vortex-file-compressed 19939520 20515240 0.97
clickbench_q41/duckdb:vortex-file-compressed 19685239 19331254 1.02
clickbench_q42/duckdb:vortex-file-compressed 21646450 21498392 1.01
duckdb / parquet (0.967x ➖, 2↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23704773 23068802 1.03
clickbench_q01/duckdb:parquet 30501030 30492473 1.00
clickbench_q02/duckdb:parquet 49517720 52961872 0.93
clickbench_q03/duckdb:parquet 39816960 42159098 0.94
clickbench_q04/duckdb:parquet 204159238 219022756 0.93
clickbench_q05/duckdb:parquet 260650741 280495528 0.93
clickbench_q06/duckdb:parquet 46525488 48739330 0.95
clickbench_q07/duckdb:parquet 31643645 31769329 1.00
clickbench_q08/duckdb:parquet 276689060 297070787 0.93
clickbench_q09/duckdb:parquet 406877783 438040309 0.93
clickbench_q10/duckdb:parquet 82462340 89108984 0.93
clickbench_q11/duckdb:parquet 100708204 108898739 0.92
clickbench_q12/duckdb:parquet 284325183 306811075 0.93
clickbench_q13/duckdb:parquet 477212342 523129712 0.91
clickbench_q14/duckdb:parquet 320055387 346458731 0.92
clickbench_q15/duckdb:parquet 261169567 287412163 0.91
clickbench_q16/duckdb:parquet 🚀 597028280 665697177 0.90
clickbench_q17/duckdb:parquet 502423063 556702280 0.90
clickbench_q18/duckdb:parquet 1052507230 1150327748 0.91
clickbench_q19/duckdb:parquet 28502264 29696019 0.96
clickbench_q20/duckdb:parquet 🚀 415762131 462206528 0.90
clickbench_q21/duckdb:parquet 530252736 585841131 0.91
clickbench_q22/duckdb:parquet 917441882 989001393 0.93
clickbench_q23/duckdb:parquet 269304211 281467078 0.96
clickbench_q24/duckdb:parquet 71345710 73195977 0.97
clickbench_q25/duckdb:parquet 163493702 171980366 0.95
clickbench_q26/duckdb:parquet 58689120 57611308 1.02
clickbench_q27/duckdb:parquet 654837350 680914648 0.96
clickbench_q28/duckdb:parquet 4912503387 4875219396 1.01
clickbench_q29/duckdb:parquet 42774241 42281313 1.01
clickbench_q30/duckdb:parquet 315198247 311396756 1.01
clickbench_q31/duckdb:parquet 375963606 375431707 1.00
clickbench_q32/duckdb:parquet 1112404010 1107624417 1.00
clickbench_q33/duckdb:parquet 1116439955 1100481490 1.01
clickbench_q34/duckdb:parquet 1161600844 1143427097 1.02
clickbench_q35/duckdb:parquet 373435234 380584860 0.98
clickbench_q36/duckdb:parquet 49619387 51040427 0.97
clickbench_q37/duckdb:parquet 33230707 33779160 0.98
clickbench_q38/duckdb:parquet 36115623 35386313 1.02
clickbench_q39/duckdb:parquet 79366727 78076742 1.02
clickbench_q40/duckdb:parquet 20941038 19867702 1.05
clickbench_q41/duckdb:parquet 21594248 20101770 1.07
clickbench_q42/duckdb:parquet 23647661 21675246 1.09
duckdb / duckdb (1.014x ➖, 1↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 18958448 17078497 1.11
clickbench_q01/duckdb:duckdb 36360924 34326300 1.06
clickbench_q02/duckdb:duckdb 54421119 51843871 1.05
clickbench_q03/duckdb:duckdb 57373011 55881705 1.03
clickbench_q04/duckdb:duckdb 219533246 210591713 1.04
clickbench_q05/duckdb:duckdb 284399891 283269299 1.00
clickbench_q06/duckdb:duckdb 36031741 33408997 1.08
clickbench_q07/duckdb:duckdb 36159245 35206844 1.03
clickbench_q08/duckdb:duckdb 278355119 274064208 1.02
clickbench_q09/duckdb:duckdb 394359877 393751779 1.00
clickbench_q10/duckdb:duckdb 117266786 117353149 1.00
clickbench_q11/duckdb:duckdb 126004423 126459402 1.00
clickbench_q12/duckdb:duckdb 263048847 258267766 1.02
clickbench_q13/duckdb:duckdb 442574833 444678476 1.00
clickbench_q14/duckdb:duckdb 288245704 286447663 1.01
clickbench_q15/duckdb:duckdb 247174108 245831174 1.01
clickbench_q16/duckdb:duckdb 563611426 566090488 1.00
clickbench_q17/duckdb:duckdb 475532046 473031952 1.01
clickbench_q18/duckdb:duckdb 989495097 1013333029 0.98
clickbench_q19/duckdb:duckdb 35727155 35152081 1.02
clickbench_q20/duckdb:duckdb 465658352 494766069 0.94
clickbench_q21/duckdb:duckdb 473320327 478654973 0.99
clickbench_q22/duckdb:duckdb 556351163 545126313 1.02
clickbench_q23/duckdb:duckdb 257793669 253558172 1.02
clickbench_q24/duckdb:duckdb 62169102 61588400 1.01
clickbench_q25/duckdb:duckdb 150178707 148528529 1.01
clickbench_q26/duckdb:duckdb 62967636 63425621 0.99
clickbench_q27/duckdb:duckdb 555076077 551130379 1.01
clickbench_q28/duckdb:duckdb 4541618196 4494283221 1.01
clickbench_q29/duckdb:duckdb 51789840 50332612 1.03
clickbench_q30/duckdb:duckdb 278390919 279489195 1.00
clickbench_q31/duckdb:duckdb 368933860 366936733 1.01
clickbench_q32/duckdb:duckdb 1132282552 1123687041 1.01
clickbench_q33/duckdb:duckdb 1135589584 1116587522 1.02
clickbench_q34/duckdb:duckdb 1212540520 1197337413 1.01
clickbench_q35/duckdb:duckdb 302779418 304007432 1.00
clickbench_q36/duckdb:duckdb 🚀 49058422 54616221 0.90
clickbench_q37/duckdb:duckdb 29658295 28964508 1.02
clickbench_q38/duckdb:duckdb 34350341 33207349 1.03
clickbench_q39/duckdb:duckdb 80367099 78990989 1.02
clickbench_q40/duckdb:duckdb 28768964 28073795 1.02
clickbench_q41/duckdb:duckdb 28460038 27111167 1.05
clickbench_q42/duckdb:duckdb 🚨 32079781 29094209 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +106.7% +300.7% -48.4% +482.6% ➖ noise
0 duckdb:duckdb +11.0% +300.7% -72.3% +160.5% ✅ faster
0 duckdb:vortex-file-compressed -8.5% +300.7% -77.2% +322.1% ✅ faster
1 datafusion:vortex-file-compressed +22.7% +46.2% -16.0% +144.3% ➖ noise
1 duckdb:duckdb +5.9% +46.2% -27.5% +144.3% ➖ noise
1 duckdb:vortex-file-compressed +3.0% +46.2% -29.6% +144.3% ➖ noise
2 datafusion:vortex-file-compressed -1.8% +14.9% -14.6% +144.3% ➖ noise
2 duckdb:duckdb +5.0% +14.9% -8.7% +144.3% ➖ noise
2 duckdb:vortex-file-compressed +7.9% +14.9% -6.1% +144.3% ➖ noise
3 datafusion:vortex-file-compressed +3.1% +18.8% -13.2% +144.3% ➖ noise
3 duckdb:duckdb +2.7% +18.8% -13.6% +144.3% ➖ noise
3 duckdb:vortex-file-compressed -2.8% +18.8% -18.2% +144.3% ➖ noise
4 datafusion:vortex-file-compressed -16.6% -5.7% -11.6% +144.3% ➖ noise
4 duckdb:duckdb +4.2% -5.7% +10.5% +144.3% ➖ noise
4 duckdb:vortex-file-compressed +1.4% -5.7% +7.5% +144.3% ➖ noise
5 datafusion:vortex-file-compressed +0.0% -6.0% +6.4% +144.3% ➖ noise
5 duckdb:duckdb +0.4% -6.0% +6.8% +144.3% ➖ noise
5 duckdb:vortex-file-compressed +6.0% -6.0% +12.7% +144.3% ➖ noise
6 datafusion:vortex-file-compressed +96.1% +292.8% -50.1% +144.3% ➖ noise
6 duckdb:duckdb +7.9% +292.8% -72.5% +144.3% ✅ faster
6 duckdb:vortex-file-compressed +3.7% +292.8% -73.6% +144.3% ✅ faster
7 datafusion:vortex-file-compressed +18.0% +39.2% -15.2% +144.3% ➖ noise
7 duckdb:duckdb +2.7% +39.2% -26.2% +144.3% ➖ noise
7 duckdb:vortex-file-compressed +0.6% +39.2% -27.8% +144.3% ➖ noise
8 datafusion:vortex-file-compressed -6.1% -5.6% -0.6% +144.3% ➖ noise
8 duckdb:duckdb +1.6% -5.6% +7.6% +144.3% ➖ noise
8 duckdb:vortex-file-compressed +1.8% -5.6% +7.8% +144.3% ➖ noise
9 datafusion:vortex-file-compressed -18.4% -13.7% -5.5% +144.3% ➖ noise
9 duckdb:duckdb +0.2% -13.7% +16.0% +144.3% ➖ noise
9 duckdb:vortex-file-compressed -0.3% -13.7% +15.5% +144.3% ➖ noise
10 datafusion:vortex-file-compressed -7.2% +0.1% -7.3% +144.3% ➖ noise
10 duckdb:duckdb -0.1% +0.1% -0.2% +144.3% ➖ noise
10 duckdb:vortex-file-compressed +2.0% +0.1% +1.9% +144.3% ➖ noise
11 datafusion:vortex-file-compressed -4.8% -0.8% -4.1% +144.3% ➖ noise
11 duckdb:duckdb -0.4% -0.8% +0.4% +144.3% ➖ noise
11 duckdb:vortex-file-compressed +2.0% -0.8% +2.8% +144.3% ➖ noise
12 datafusion:vortex-file-compressed -5.4% -7.5% +2.3% +144.3% ➖ noise
12 duckdb:duckdb +1.9% -7.5% +10.1% +144.3% ➖ noise
12 duckdb:vortex-file-compressed +3.7% -7.5% +12.2% +144.3% ➖ noise
13 datafusion:vortex-file-compressed -0.2% -7.6% +8.1% +144.3% ➖ noise
13 duckdb:duckdb -0.5% -7.6% +7.8% +144.3% ➖ noise
13 duckdb:vortex-file-compressed +0.9% -7.6% +9.2% +144.3% ➖ noise
14 datafusion:vortex-file-compressed +0.9% -4.7% +5.8% +144.3% ➖ noise
14 duckdb:duckdb +0.6% -4.7% +5.6% +144.3% ➖ noise
14 duckdb:vortex-file-compressed +2.6% -4.7% +7.6% +144.3% ➖ noise
15 datafusion:vortex-file-compressed -13.7% -10.8% -3.2% +144.3% ➖ noise
15 duckdb:duckdb +0.5% -10.8% +12.8% +144.3% ➖ noise
15 duckdb:vortex-file-compressed +0.3% -10.8% +12.5% +144.3% ➖ noise
16 datafusion:vortex-file-compressed +1.2% -5.7% +7.4% +144.3% ➖ noise
16 duckdb:duckdb -0.4% -5.7% +5.6% +144.3% ➖ noise
16 duckdb:vortex-file-compressed +3.2% -5.7% +9.5% +144.3% ➖ noise
17 datafusion:vortex-file-compressed +1.4% -6.2% +8.1% +144.3% ➖ noise
17 duckdb:duckdb +0.5% -6.2% +7.2% +144.3% ➖ noise
17 duckdb:vortex-file-compressed +3.7% -6.2% +10.6% +144.3% ➖ noise
18 datafusion:vortex-file-compressed +3.4% -5.1% +8.9% +144.3% ➖ noise
18 duckdb:duckdb -2.4% -5.1% +2.9% +144.3% ➖ noise
18 duckdb:vortex-file-compressed +2.9% -5.1% +8.4% +144.3% ➖ noise
19 datafusion:vortex-file-compressed +18.4% +32.3% -10.5% +144.3% ➖ noise
19 duckdb:duckdb +1.6% +32.3% -23.2% +144.3% ➖ noise
19 duckdb:vortex-file-compressed +6.0% +32.3% -19.9% +144.3% ➖ noise
20 datafusion:vortex-file-compressed +1.9% -6.8% +9.4% +203.5% ➖ noise
20 duckdb:duckdb -5.9% -6.8% +1.0% +144.3% ➖ noise
20 duckdb:vortex-file-compressed +2.6% -6.8% +10.2% +144.3% ➖ noise
21 datafusion:vortex-file-compressed +1.8% -6.9% +9.4% +144.3% ➖ noise
21 duckdb:duckdb -1.1% -6.9% +6.3% +144.3% ➖ noise
21 duckdb:vortex-file-compressed +0.1% -6.9% +7.6% +144.3% ➖ noise
22 datafusion:vortex-file-compressed +1.5% -6.9% +9.0% +144.3% ➖ noise
22 duckdb:duckdb +2.1% -6.9% +9.6% +144.3% ➖ noise
22 duckdb:vortex-file-compressed +10.6% -6.9% +18.8% +144.3% ➖ noise
23 datafusion:vortex-file-compressed -12.5% +2.5% -14.7% +144.3% ➖ noise
23 duckdb:duckdb +1.7% +2.5% -0.9% +144.3% ➖ noise
23 duckdb:vortex-file-compressed -4.4% +2.5% -6.8% +144.3% ➖ noise
24 datafusion:vortex-file-compressed -10.5% -1.5% -9.1% +144.3% ➖ noise
24 duckdb:duckdb +0.9% -1.5% +2.5% +144.3% ➖ noise
24 duckdb:vortex-file-compressed +11.3% -1.5% +13.0% +144.3% ➖ noise
25 datafusion:vortex-file-compressed -2.4% +5.5% -7.5% +144.3% ➖ noise
25 duckdb:duckdb +1.1% +5.5% -4.2% +144.3% ➖ noise
25 duckdb:vortex-file-compressed +4.9% +5.5% -0.5% +144.3% ➖ noise
26 datafusion:vortex-file-compressed -6.1% -3.8% -2.4% +144.3% ➖ noise
26 duckdb:duckdb -0.7% -3.8% +3.2% +144.3% ➖ noise
26 duckdb:vortex-file-compressed +7.1% -3.8% +11.3% +144.3% ➖ noise
27 datafusion:vortex-file-compressed -1.5% -6.0% +4.7% +144.3% ➖ noise
27 duckdb:duckdb +0.7% -6.0% +7.1% +144.3% ➖ noise
27 duckdb:vortex-file-compressed +1.7% -6.0% +8.2% +144.3% ➖ noise
28 datafusion:vortex-file-compressed -62.0% -36.3% -40.4% +144.3% ➖ noise
28 duckdb:duckdb +1.1% -36.3% +58.6% +144.3% ➖ noise
28 duckdb:vortex-file-compressed +1.0% -36.3% +58.5% +144.3% ➖ noise
29 datafusion:vortex-file-compressed -80.3% -46.1% -63.4% +144.3% ✅ faster
29 duckdb:duckdb +2.9% -46.1% +90.9% +144.3% ➖ noise
29 duckdb:vortex-file-compressed +2.6% -46.1% +90.4% +144.3% ➖ noise
30 datafusion:vortex-file-compressed -12.5% +2.7% -14.8% +144.3% ➖ noise
30 duckdb:duckdb -0.4% +2.7% -3.0% +144.3% ➖ noise
30 duckdb:vortex-file-compressed +1.6% +2.7% -1.1% +144.3% ➖ noise
31 datafusion:vortex-file-compressed -18.6% +1.0% -19.4% +144.3% ➖ noise
31 duckdb:duckdb +0.5% +1.0% -0.4% +144.3% ➖ noise
31 duckdb:vortex-file-compressed +0.7% +1.0% -0.3% +144.3% ➖ noise
32 datafusion:vortex-file-compressed -23.9% -2.7% -21.8% +144.3% ➖ noise
32 duckdb:duckdb +0.8% -2.7% +3.5% +144.3% ➖ noise
32 duckdb:vortex-file-compressed +1.8% -2.7% +4.6% +144.3% ➖ noise
33 datafusion:vortex-file-compressed -7.8% +2.2% -9.8% +144.3% ➖ noise
33 duckdb:duckdb +1.7% +2.2% -0.5% +144.3% ➖ noise
33 duckdb:vortex-file-compressed +1.5% +2.2% -0.7% +144.3% ➖ noise
34 datafusion:vortex-file-compressed -9.1% +2.1% -11.0% +144.3% ➖ noise
34 duckdb:duckdb +1.3% +2.1% -0.8% +144.3% ➖ noise
34 duckdb:vortex-file-compressed +2.4% +2.1% +0.3% +144.3% ➖ noise
35 datafusion:vortex-file-compressed -53.4% -24.3% -38.5% +144.3% ➖ noise
35 duckdb:duckdb -0.4% -24.3% +31.5% +144.3% ➖ noise
35 duckdb:vortex-file-compressed -0.9% -24.3% +30.8% +144.3% ➖ noise
36 datafusion:vortex-file-compressed -31.8% -6.0% -27.5% +144.3% ➖ noise
36 duckdb:duckdb -10.2% -6.0% -4.4% +144.3% ➖ noise
36 duckdb:vortex-file-compressed +1.8% -6.0% +8.3% +144.3% ➖ noise
37 datafusion:vortex-file-compressed -30.7% +8.5% -36.1% +144.3% ➖ noise
37 duckdb:duckdb +2.4% +8.5% -5.6% +144.3% ➖ noise
37 duckdb:vortex-file-compressed +6.9% +8.5% -1.5% +144.3% ➖ noise
38 datafusion:vortex-file-compressed -24.5% +3.9% -27.3% +144.3% ➖ noise
38 duckdb:duckdb +3.4% +3.9% -0.5% +144.3% ➖ noise
38 duckdb:vortex-file-compressed +4.4% +3.9% +0.4% +144.3% ➖ noise
39 datafusion:vortex-file-compressed -18.0% -5.5% -13.3% +144.3% ➖ noise
39 duckdb:duckdb +1.7% -5.5% +7.6% +144.3% ➖ noise
39 duckdb:vortex-file-compressed -7.6% -5.5% -2.3% +144.3% ➖ noise
40 datafusion:vortex-file-compressed -31.9% +30.4% -47.8% +144.3% ➖ noise
40 duckdb:duckdb +2.5% +30.4% -21.4% +144.3% ➖ noise
40 duckdb:vortex-file-compressed -2.8% +30.4% -25.5% +144.3% ➖ noise
41 datafusion:vortex-file-compressed -25.7% +35.3% -45.0% +144.3% ➖ noise
41 duckdb:duckdb +5.0% +35.3% -22.4% +144.3% ➖ noise
41 duckdb:vortex-file-compressed +1.8% +35.3% -24.7% +144.3% ➖ noise
42 datafusion:vortex-file-compressed -27.2% +34.0% -45.6% +144.3% ➖ noise
42 duckdb:duckdb +10.3% +34.0% -17.7% +144.3% ➖ noise
42 duckdb:vortex-file-compressed +0.7% +34.0% -24.8% +144.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on S3 failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 0.965x ➖
Parquet (geomean): 0.959x ➖
Shifts: Parquet (control) -4.1% · Median polish -4.0%


datafusion / vortex-file-compressed (0.907x ➖, 1↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 724164549 802088693 0.90
tpch_q02/datafusion:vortex-file-compressed 821624399 1167635077 0.70
tpch_q03/datafusion:vortex-file-compressed 825373914 1065009998 0.77
tpch_q04/datafusion:vortex-file-compressed 600587991 630625506 0.95
tpch_q05/datafusion:vortex-file-compressed 1126250909 1065655473 1.06
tpch_q06/datafusion:vortex-file-compressed 681276701 615599881 1.11
tpch_q07/datafusion:vortex-file-compressed 966892211 1194168733 0.81
tpch_q08/datafusion:vortex-file-compressed 1291633910 1563737489 0.83
tpch_q09/datafusion:vortex-file-compressed 🚀 1188242587 1729928757 0.69
tpch_q10/datafusion:vortex-file-compressed 955031519 1167227750 0.82
tpch_q11/datafusion:vortex-file-compressed 535393492 596746146 0.90
tpch_q12/datafusion:vortex-file-compressed 741295137 872706293 0.85
tpch_q13/datafusion:vortex-file-compressed 399828710 455585409 0.88
tpch_q14/datafusion:vortex-file-compressed 461600673 578106369 0.80
tpch_q15/datafusion:vortex-file-compressed 868676294 1038603163 0.84
tpch_q16/datafusion:vortex-file-compressed 437012186 480801412 0.91
tpch_q17/datafusion:vortex-file-compressed 1508704421 1222660048 1.23
tpch_q18/datafusion:vortex-file-compressed 1497841780 1318682835 1.14
tpch_q19/datafusion:vortex-file-compressed 1030737999 915210011 1.13
tpch_q20/datafusion:vortex-file-compressed 1024779748 970044998 1.06
tpch_q21/datafusion:vortex-file-compressed 1762157612 1636351065 1.08
tpch_q22/datafusion:vortex-file-compressed 446726550 581119412 0.77
datafusion / vortex-compact (1.036x ➖, 0↑ 2↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 703772307 728966770 0.97
tpch_q02/datafusion:vortex-compact 🚨 877479048 650149861 1.35
tpch_q03/datafusion:vortex-compact 762164998 786559542 0.97
tpch_q04/datafusion:vortex-compact 409940953 510635311 0.80
tpch_q05/datafusion:vortex-compact 758826071 900974173 0.84
tpch_q06/datafusion:vortex-compact 573657961 570174722 1.01
tpch_q07/datafusion:vortex-compact 1220027086 1062280630 1.15
tpch_q08/datafusion:vortex-compact 1236925919 1191421137 1.04
tpch_q09/datafusion:vortex-compact 1180635092 1388983387 0.85
tpch_q10/datafusion:vortex-compact 1070766296 1002085738 1.07
tpch_q11/datafusion:vortex-compact 496242143 536677009 0.92
tpch_q12/datafusion:vortex-compact 915455208 808604858 1.13
tpch_q13/datafusion:vortex-compact 548756414 452884222 1.21
tpch_q14/datafusion:vortex-compact 692427381 700600540 0.99
tpch_q15/datafusion:vortex-compact 968989822 1074286468 0.90
tpch_q16/datafusion:vortex-compact 405240429 352103926 1.15
tpch_q17/datafusion:vortex-compact 1064947531 1215636172 0.88
tpch_q18/datafusion:vortex-compact 1089130754 1089707941 1.00
tpch_q19/datafusion:vortex-compact 985474583 819058677 1.20
tpch_q20/datafusion:vortex-compact 856994998 814773240 1.05
tpch_q21/datafusion:vortex-compact 1635135653 1580882373 1.03
tpch_q22/datafusion:vortex-compact 🚨 733386936 471848194 1.55
datafusion / parquet (0.965x ➖, 2↑ 3↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 872582935 887707491 0.98
tpch_q02/datafusion:parquet 958259034 1031290799 0.93
tpch_q03/datafusion:parquet 1229831553 1608415199 0.76
tpch_q04/datafusion:parquet 562790407 509692466 1.10
tpch_q05/datafusion:parquet 1279485607 1295490183 0.99
tpch_q06/datafusion:parquet 625486964 551172254 1.13
tpch_q07/datafusion:parquet 1250366752 1388553484 0.90
tpch_q08/datafusion:parquet 1556393074 1986285622 0.78
tpch_q09/datafusion:parquet 1859064390 1797089119 1.03
tpch_q10/datafusion:parquet 2429996767 2783172322 0.87
tpch_q11/datafusion:parquet 938161342 1008131667 0.93
tpch_q12/datafusion:parquet 🚨 1068903351 765994008 1.40
tpch_q13/datafusion:parquet 🚨 1093976490 766180379 1.43
tpch_q14/datafusion:parquet 🚨 1236003023 768411822 1.61
tpch_q15/datafusion:parquet 1411361358 1349647557 1.05
tpch_q16/datafusion:parquet 394413826 440646888 0.90
tpch_q17/datafusion:parquet 1377478055 1520496579 0.91
tpch_q18/datafusion:parquet 1567861997 1755300656 0.89
tpch_q19/datafusion:parquet 1060378976 1254284506 0.85
tpch_q20/datafusion:parquet 🚀 1332223530 2059969235 0.65
tpch_q21/datafusion:parquet 1992861120 1926869838 1.03
tpch_q22/datafusion:parquet 🚀 813578477 1251174405 0.65
duckdb / vortex-file-compressed (0.947x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 603130669 597454905 1.01
tpch_q02/duckdb:vortex-file-compressed 1253881900 1259950064 1.00
tpch_q03/duckdb:vortex-file-compressed 987270606 946821311 1.04
tpch_q04/duckdb:vortex-file-compressed 834361355 794538877 1.05
tpch_q05/duckdb:vortex-file-compressed 1270291449 1248537504 1.02
tpch_q06/duckdb:vortex-file-compressed 601713896 600810078 1.00
tpch_q07/duckdb:vortex-file-compressed 1291484365 1361006118 0.95
tpch_q08/duckdb:vortex-file-compressed 1507248631 1643194393 0.92
tpch_q09/duckdb:vortex-file-compressed 1835821456 1840778769 1.00
tpch_q10/duckdb:vortex-file-compressed 1181587413 1281592228 0.92
tpch_q11/duckdb:vortex-file-compressed 700130940 874906703 0.80
tpch_q12/duckdb:vortex-file-compressed 1320520455 1396709782 0.95
tpch_q13/duckdb:vortex-file-compressed 983610591 1106071152 0.89
tpch_q14/duckdb:vortex-file-compressed 647927014 686502170 0.94
tpch_q15/duckdb:vortex-file-compressed 517725887 568873976 0.91
tpch_q16/duckdb:vortex-file-compressed 444703520 525489281 0.85
tpch_q17/duckdb:vortex-file-compressed 1050648048 1046061172 1.00
tpch_q18/duckdb:vortex-file-compressed 964801334 1114873116 0.87
tpch_q19/duckdb:vortex-file-compressed 759408947 800588684 0.95
tpch_q20/duckdb:vortex-file-compressed 1127509533 1190983818 0.95
tpch_q21/duckdb:vortex-file-compressed 2041229362 2006416543 1.02
tpch_q22/duckdb:vortex-file-compressed 523608223 600025013 0.87
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 580110698 613302464 0.95
tpch_q02/duckdb:vortex-compact 1082537924 1081169439 1.00
tpch_q03/duckdb:vortex-compact 848999781 921455955 0.92
tpch_q04/duckdb:vortex-compact 638794639 590893301 1.08
tpch_q05/duckdb:vortex-compact 1109958476 1240345548 0.89
tpch_q06/duckdb:vortex-compact 596784864 570259737 1.05
tpch_q07/duckdb:vortex-compact 1137524997 1273797203 0.89
tpch_q08/duckdb:vortex-compact 1470404025 1583728124 0.93
tpch_q09/duckdb:vortex-compact 1701325360 1643759682 1.04
tpch_q10/duckdb:vortex-compact 1047883157 1156450252 0.91
tpch_q11/duckdb:vortex-compact 721330880 829682981 0.87
tpch_q12/duckdb:vortex-compact 1266710605 1139948932 1.11
tpch_q13/duckdb:vortex-compact 924489585 857548772 1.08
tpch_q14/duckdb:vortex-compact 715197857 659757473 1.08
tpch_q15/duckdb:vortex-compact 537233948 570488368 0.94
tpch_q16/duckdb:vortex-compact 379176621 447701294 0.85
tpch_q17/duckdb:vortex-compact 954292510 921779902 1.04
tpch_q18/duckdb:vortex-compact 905879611 880479288 1.03
tpch_q19/duckdb:vortex-compact 801646605 730404261 1.10
tpch_q20/duckdb:vortex-compact 1236962776 1359623339 0.91
tpch_q21/duckdb:vortex-compact 1685079347 1829194981 0.92
tpch_q22/duckdb:vortex-compact 469268933 494095764 0.95
duckdb / parquet (0.952x ➖, 0↑ 0↓)
name PR dfd1f68 (ns) base 19a1fb3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 986204800 955126078 1.03
tpch_q02/duckdb:parquet 1362153586 1567557222 0.87
tpch_q03/duckdb:parquet 1894102973 2168441766 0.87
tpch_q04/duckdb:parquet 1270659518 1255316499 1.01
tpch_q05/duckdb:parquet 1966227598 1900564966 1.03
tpch_q06/duckdb:parquet 971724328 1023179895 0.95
tpch_q07/duckdb:parquet 1960743963 2224210921 0.88
tpch_q08/duckdb:parquet 2744018739 2792549772 0.98
tpch_q09/duckdb:parquet 2702315055 3034564509 0.89
tpch_q10/duckdb:parquet 3312049967 3410610694 0.97
tpch_q11/duckdb:parquet 1047119907 1098153555 0.95
tpch_q12/duckdb:parquet 1269188309 1427622071 0.89
tpch_q13/duckdb:parquet 1378962897 1529464021 0.90
tpch_q14/duckdb:parquet 1485737359 1339188513 1.11
tpch_q15/duckdb:parquet 1037567457 975773955 1.06
tpch_q16/duckdb:parquet 876532745 1036440175 0.85
tpch_q17/duckdb:parquet 1307862865 1476077325 0.89
tpch_q18/duckdb:parquet 1676846048 1675199948 1.00
tpch_q19/duckdb:parquet 1557024499 1705803014 0.91
tpch_q20/duckdb:parquet 2167893981 2017698474 1.07
tpch_q21/duckdb:parquet 1997010847 2015520176 0.99
tpch_q22/duckdb:parquet 1134460159 1270433044 0.89
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.5% +0.7% -4.2% +43.3% ➖ noise
1 datafusion:vortex-file-compressed -9.7% +0.7% -10.4% +42.4% ➖ noise
1 duckdb:vortex-compact -5.4% +0.7% -6.1% +38.3% ➖ noise
1 duckdb:vortex-file-compressed +0.9% +0.7% +0.2% +38.3% ➖ noise
2 datafusion:vortex-compact +35.0% -10.1% +50.2% +38.3% 🚨 regression
2 datafusion:vortex-file-compressed -29.6% -10.1% -21.7% +38.3% ➖ noise
2 duckdb:vortex-compact +0.1% -10.1% +11.4% +38.3% ➖ noise
2 duckdb:vortex-file-compressed -0.5% -10.1% +10.8% +38.3% ➖ noise
3 datafusion:vortex-compact -3.1% -18.3% +18.6% +50.0% ➖ noise
3 datafusion:vortex-file-compressed -22.5% -18.3% -5.2% +46.4% ➖ noise
3 duckdb:vortex-compact -7.9% -18.3% +12.7% +41.7% ➖ noise
3 duckdb:vortex-file-compressed +4.3% -18.3% +27.6% +41.6% ➖ noise
4 datafusion:vortex-compact -19.7% +5.7% -24.1% +38.3% ➖ noise
4 datafusion:vortex-file-compressed -4.8% +5.7% -9.9% +67.8% ➖ noise
4 duckdb:vortex-compact +8.1% +5.7% +2.3% +38.3% ➖ noise
4 duckdb:vortex-file-compressed +5.0% +5.7% -0.7% +38.3% ➖ noise
5 datafusion:vortex-compact -15.8% +1.1% -16.7% +38.3% ➖ noise
5 datafusion:vortex-file-compressed +5.7% +1.1% +4.6% +38.3% ➖ noise
5 duckdb:vortex-compact -10.5% +1.1% -11.5% +38.3% ➖ noise
5 duckdb:vortex-file-compressed +1.7% +1.1% +0.7% +38.3% ➖ noise
6 datafusion:vortex-compact +0.6% +3.8% -3.1% +38.3% ➖ noise
6 datafusion:vortex-file-compressed +10.7% +3.8% +6.6% +38.3% ➖ noise
6 duckdb:vortex-compact +4.7% +3.8% +0.8% +38.3% ➖ noise
6 duckdb:vortex-file-compressed +0.2% +3.8% -3.5% +38.3% ➖ noise
7 datafusion:vortex-compact +14.8% -10.9% +28.9% +38.3% ➖ noise
7 datafusion:vortex-file-compressed -19.0% -10.9% -9.1% +38.3% ➖ noise
7 duckdb:vortex-compact -10.7% -10.9% +0.2% +38.3% ➖ noise
7 duckdb:vortex-file-compressed -5.1% -10.9% +6.5% +38.3% ➖ noise
8 datafusion:vortex-compact +3.8% -12.3% +18.3% +38.3% ➖ noise
8 datafusion:vortex-file-compressed -17.4% -12.3% -5.9% +38.3% ➖ noise
8 duckdb:vortex-compact -7.2% -12.3% +5.8% +38.3% ➖ noise
8 duckdb:vortex-file-compressed -8.3% -12.3% +4.5% +51.0% ➖ noise
9 datafusion:vortex-compact -15.0% -4.0% -11.4% +38.3% ➖ noise
9 datafusion:vortex-file-compressed -31.3% -4.0% -28.4% +38.3% ✅ faster
9 duckdb:vortex-compact +3.5% -4.0% +7.8% +38.3% ➖ noise
9 duckdb:vortex-file-compressed -0.3% -4.0% +3.9% +38.3% ➖ noise
10 datafusion:vortex-compact +6.9% -7.9% +16.0% +38.3% ➖ noise
10 datafusion:vortex-file-compressed -18.2% -7.9% -11.1% +38.3% ➖ noise
10 duckdb:vortex-compact -9.4% -7.9% -1.6% +38.3% ➖ noise
10 duckdb:vortex-file-compressed -7.8% -7.9% +0.1% +38.3% ➖ noise
11 datafusion:vortex-compact -7.5% -5.8% -1.8% +38.3% ➖ noise
11 datafusion:vortex-file-compressed -10.3% -5.8% -4.8% +38.3% ➖ noise
11 duckdb:vortex-compact -13.1% -5.8% -7.7% +38.3% ➖ noise
11 duckdb:vortex-file-compressed -20.0% -5.8% -15.0% +38.3% ➖ noise
12 datafusion:vortex-compact +13.2% +11.4% +1.6% +38.3% ➖ noise
12 datafusion:vortex-file-compressed -15.1% +11.4% -23.7% +38.3% ➖ noise
12 duckdb:vortex-compact +11.1% +11.4% -0.2% +38.3% ➖ noise
12 duckdb:vortex-file-compressed -5.5% +11.4% -15.1% +38.3% ➖ noise
13 datafusion:vortex-compact +21.2% +13.5% +6.8% +59.5% ➖ noise
13 datafusion:vortex-file-compressed -12.2% +13.5% -22.7% +38.3% ➖ noise
13 duckdb:vortex-compact +7.8% +13.5% -5.0% +38.3% ➖ noise
13 duckdb:vortex-file-compressed -11.1% +13.5% -21.6% +38.3% ➖ noise
14 datafusion:vortex-compact -1.2% +33.6% -26.0% +38.3% ➖ noise
14 datafusion:vortex-file-compressed -20.2% +33.6% -40.2% +38.3% ✅ faster
14 duckdb:vortex-compact +8.4% +33.6% -18.9% +38.3% ➖ noise
14 duckdb:vortex-file-compressed -5.6% +33.6% -29.3% +38.3% ✅ faster
15 datafusion:vortex-compact -9.8% +5.4% -14.5% +38.3% ➖ noise
15 datafusion:vortex-file-compressed -16.4% +5.4% -20.7% +38.3% ➖ noise
15 duckdb:vortex-compact -5.8% +5.4% -10.7% +38.3% ➖ noise
15 duckdb:vortex-file-compressed -9.0% +5.4% -13.7% +38.3% ➖ noise
16 datafusion:vortex-compact +15.1% -13.0% +32.3% +38.3% ➖ noise
16 datafusion:vortex-file-compressed -9.1% -13.0% +4.5% +38.3% ➖ noise
16 duckdb:vortex-compact -15.3% -13.0% -2.7% +38.3% ➖ noise
16 duckdb:vortex-file-compressed -15.4% -13.0% -2.7% +38.3% ➖ noise
17 datafusion:vortex-compact -12.4% -10.4% -2.2% +38.3% ➖ noise
17 datafusion:vortex-file-compressed +23.4% -10.4% +37.7% +38.3% ➖ noise
17 duckdb:vortex-compact +3.5% -10.4% +15.6% +38.3% ➖ noise
17 duckdb:vortex-file-compressed +0.4% -10.4% +12.1% +38.3% ➖ noise
18 datafusion:vortex-compact -0.1% -5.4% +5.7% +38.3% ➖ noise
18 datafusion:vortex-file-compressed +13.6% -5.4% +20.1% +38.3% ➖ noise
18 duckdb:vortex-compact +2.9% -5.4% +8.8% +38.8% ➖ noise
18 duckdb:vortex-file-compressed -13.5% -5.4% -8.5% +38.3% ➖ noise
19 datafusion:vortex-compact +20.3% -12.2% +37.0% +38.3% ➖ noise
19 datafusion:vortex-file-compressed +12.6% -12.2% +28.2% +38.3% ➖ noise
19 duckdb:vortex-compact +9.8% -12.2% +24.9% +38.3% ➖ noise
19 duckdb:vortex-file-compressed -5.1% -12.2% +8.0% +38.3% ➖ noise
20 datafusion:vortex-compact +5.2% -16.6% +26.2% +38.3% ➖ noise
20 datafusion:vortex-file-compressed +5.6% -16.6% +26.7% +38.3% ➖ noise
20 duckdb:vortex-compact -9.0% -16.6% +9.1% +38.3% ➖ noise
20 duckdb:vortex-file-compressed -5.3% -16.6% +13.6% +38.3% ➖ noise
21 datafusion:vortex-compact +3.4% +1.2% +2.2% +38.3% ➖ noise
21 datafusion:vortex-file-compressed +7.7% +1.2% +6.4% +38.3% ➖ noise
21 duckdb:vortex-compact -7.9% +1.2% -9.0% +38.3% ➖ noise
21 duckdb:vortex-file-compressed +1.7% +1.2% +0.5% +38.3% ➖ noise
22 datafusion:vortex-compact +55.4% -23.8% +104.0% +38.3% 🚨 regression
22 datafusion:vortex-file-compressed -23.1% -23.8% +0.9% +38.3% ➖ noise
22 duckdb:vortex-compact -5.0% -23.8% +24.6% +38.3% ➖ noise
22 duckdb:vortex-file-compressed -12.7% -23.8% +14.5% +38.3% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 20, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ext/datafusion Relates to the DataFusion integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant