Skip to content

interned identifiers#7412

Draft
joseph-isaacs wants to merge 15 commits intodevelopfrom
ji/extern-array-id
Draft

interned identifiers#7412
joseph-isaacs wants to merge 15 commits intodevelopfrom
ji/extern-array-id

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Signed-off-by: Nicholas Gates nick@nickgates.com<!--
Thank you for submitting a pull request! We appreciate your time and effort.

Please make sure to provide enough information so that we can review your pull
request. The Summary and Testing sections below contain guidance on what to
include.
-->

Summary

Closes: #000

Testing

gatesn and others added 9 commits March 19, 2026 06:03
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-layout/src/layouts/dict/reader.rs
u
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 13, 2026

Merging this PR will degrade performance by 33.85%

⚡ 12 improved benchmarks
❌ 5 regressed benchmarks
✅ 1106 untouched benchmarks
⏩ 1455 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_constant_utf8_append_to_builder[("hi", 1000, 10)] 143.3 µs 105.6 µs +35.61%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 10, 10)] 151.2 µs 180.9 µs -16.46%
Simulation encode_varbin[(1000, 4)] 169.5 µs 148.3 µs +14.33%
Simulation encode_varbin[(1000, 8)] 174.1 µs 149 µs +16.86%
Simulation encode_varbin[(1000, 32)] 173.5 µs 154.8 µs +12.05%
Simulation encode_varbin[(1000, 2)] 168.7 µs 147.3 µs +14.56%
Simulation case_when_fragmented[100] 154 µs 124.2 µs +24%
Simulation dict_canonicalize_zipfian[16, 1000] 60.2 µs 91 µs -33.85%
Simulation varbinview_zip_fragmented_mask 7.1 ms 6.4 ms +11.74%
Simulation varbinview_zip_block_mask 3.7 ms 2.9 ms +27.69%
Simulation patched_take_10k_random 298.2 µs 269.8 µs +10.53%
Simulation patched_take_10k_contiguous_patches 286 µs 257.6 µs +11.04%
Simulation patched_take_10k_contiguous_not_patches 286.3 µs 257.9 µs +11.02%
Simulation new_raw_prim_test_between[i32, 2048] 38.3 µs 33.4 µs +14.61%
Simulation null_count_run_end[(10000, 4, 0.01)] 104.5 µs 129.6 µs -19.36%
Simulation decode_bool_nullable[10000_10_alternating_mostly_valid] 91.6 µs 124.5 µs -26.41%
Simulation decompress_rd[f32, (10000, 0.0)] 199.7 µs 244.7 µs -18.39%

Comparing ji/extern-array-id (a759303) with develop (3fd9f26)

Open in CodSpeed

Footnotes

  1. 1455 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 13, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 13, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 22d305a 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 48dce08 1 Explore Profiling Data
🟢 Done c60a089 1 Explore Profiling Data

Powered by Polar Signals Cloud

u
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.015x ➖


datafusion / vortex-file-compressed (1.015x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123080968 121375256 1.01
polarsignals_q01/datafusion:vortex-file-compressed 360184842 373009552 0.97
polarsignals_q02/datafusion:vortex-file-compressed 22009851 21374032 1.03
polarsignals_q03/datafusion:vortex-file-compressed 367140376 371306256 0.99
polarsignals_q04/datafusion:vortex-file-compressed 10839515 11015537 0.98
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16403563 14759585 1.11
polarsignals_q06/datafusion:vortex-file-compressed 18407548 17670273 1.04
polarsignals_q07/datafusion:vortex-file-compressed 12744652 13151632 0.97
polarsignals_q08/datafusion:vortex-file-compressed 459615665 452444319 1.02
polarsignals_q09/datafusion:vortex-file-compressed 11316663 10890770 1.04

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.907x ➖
Parquet (geomean): 0.944x ➖
Shifts: Parquet (control) -5.6% · Median polish -6.7%


datafusion / vortex-file-compressed (0.885x ✅, 16↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 47649341 56440372 0.84
tpch_q02/datafusion:vortex-file-compressed 🚀 31939170 36993863 0.86
tpch_q03/datafusion:vortex-file-compressed 🚀 26078003 31554663 0.83
tpch_q04/datafusion:vortex-file-compressed 17958987 19534969 0.92
tpch_q05/datafusion:vortex-file-compressed 🚀 52742878 59979961 0.88
tpch_q06/datafusion:vortex-file-compressed 🚀 10136042 11294678 0.90
tpch_q07/datafusion:vortex-file-compressed 🚀 62269560 70887929 0.88
tpch_q08/datafusion:vortex-file-compressed 43399639 47845041 0.91
tpch_q09/datafusion:vortex-file-compressed 🚀 54158585 62395104 0.87
tpch_q10/datafusion:vortex-file-compressed 🚀 44202488 49495114 0.89
tpch_q11/datafusion:vortex-file-compressed 🚀 17703692 21395301 0.83
tpch_q12/datafusion:vortex-file-compressed 🚀 21476301 24804384 0.87
tpch_q13/datafusion:vortex-file-compressed 🚀 26781128 30415788 0.88
tpch_q14/datafusion:vortex-file-compressed 🚀 15596705 18029977 0.87
tpch_q15/datafusion:vortex-file-compressed 25015515 27497827 0.91
tpch_q16/datafusion:vortex-file-compressed 🚀 23985134 27173162 0.88
tpch_q17/datafusion:vortex-file-compressed 🚀 63314245 75008054 0.84
tpch_q18/datafusion:vortex-file-compressed 77324663 83919921 0.92
tpch_q19/datafusion:vortex-file-compressed 22452578 22352485 1.00
tpch_q20/datafusion:vortex-file-compressed 🚀 31933355 35626014 0.90
tpch_q21/datafusion:vortex-file-compressed 🚀 73806097 83043824 0.89
tpch_q22/datafusion:vortex-file-compressed 15944351 17359188 0.92
datafusion / vortex-compact (0.913x ➖, 8↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59758331 63094367 0.95
tpch_q02/datafusion:vortex-compact 36874357 40678382 0.91
tpch_q03/datafusion:vortex-compact 🚀 31011900 35727054 0.87
tpch_q04/datafusion:vortex-compact 23039747 25177661 0.92
tpch_q05/datafusion:vortex-compact 🚀 56180569 64980515 0.86
tpch_q06/datafusion:vortex-compact 13654093 12455064 1.10
tpch_q07/datafusion:vortex-compact 69445408 73689915 0.94
tpch_q08/datafusion:vortex-compact 48449353 53525327 0.91
tpch_q09/datafusion:vortex-compact 60404930 66147974 0.91
tpch_q10/datafusion:vortex-compact 🚀 51705107 57943512 0.89
tpch_q11/datafusion:vortex-compact 🚀 19200315 22612767 0.85
tpch_q12/datafusion:vortex-compact 32490855 35286800 0.92
tpch_q13/datafusion:vortex-compact 36896251 39775625 0.93
tpch_q14/datafusion:vortex-compact 20994398 22808582 0.92
tpch_q15/datafusion:vortex-compact 🚀 32370685 36309335 0.89
tpch_q16/datafusion:vortex-compact 29888161 32444016 0.92
tpch_q17/datafusion:vortex-compact 69244842 72122478 0.96
tpch_q18/datafusion:vortex-compact 85541159 92224336 0.93
tpch_q19/datafusion:vortex-compact 32831259 35232818 0.93
tpch_q20/datafusion:vortex-compact 🚀 38408286 44157580 0.87
tpch_q21/datafusion:vortex-compact 🚀 85394008 98966767 0.86
tpch_q22/datafusion:vortex-compact 🚀 16976157 19271165 0.88
datafusion / parquet (0.938x ➖, 4↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 95760167 94141432 1.02
tpch_q02/datafusion:parquet 69338564 70933399 0.98
tpch_q03/datafusion:parquet 75093091 75960179 0.99
tpch_q04/datafusion:parquet 49645603 50874647 0.98
tpch_q05/datafusion:parquet 104014779 104985437 0.99
tpch_q06/datafusion:parquet 41686142 45516322 0.92
tpch_q07/datafusion:parquet 110934095 116708940 0.95
tpch_q08/datafusion:parquet 🚀 95442939 109495431 0.87
tpch_q09/datafusion:parquet 130647087 140546587 0.93
tpch_q10/datafusion:parquet 119407119 122171834 0.98
tpch_q11/datafusion:parquet 47221613 50159478 0.94
tpch_q12/datafusion:parquet 80973535 85325555 0.95
tpch_q13/datafusion:parquet 🚀 203936422 239331976 0.85
tpch_q14/datafusion:parquet 50713975 50708299 1.00
tpch_q15/datafusion:parquet 70476601 71811226 0.98
tpch_q16/datafusion:parquet 🚀 49948984 59919047 0.83
tpch_q17/datafusion:parquet 🚀 138216371 166664708 0.83
tpch_q18/datafusion:parquet 170856737 184519153 0.93
tpch_q19/datafusion:parquet 68059646 74887488 0.91
tpch_q20/datafusion:parquet 77903020 80586188 0.97
tpch_q21/datafusion:parquet 147034562 151695244 0.97
tpch_q22/datafusion:parquet 34730356 37598285 0.92
datafusion / arrow (0.955x ➖, 3↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 50817392 57115496 0.89
tpch_q02/datafusion:arrow 21234365 21523677 0.99
tpch_q03/datafusion:arrow 31950290 33635921 0.95
tpch_q04/datafusion:arrow 🚀 25653598 29175086 0.88
tpch_q05/datafusion:arrow 🚀 73155809 83487285 0.88
tpch_q06/datafusion:arrow 19667917 21415883 0.92
tpch_q07/datafusion:arrow 108918534 117221750 0.93
tpch_q08/datafusion:arrow 42328751 43566321 0.97
tpch_q09/datafusion:arrow 66616151 68663090 0.97
tpch_q10/datafusion:arrow 49154949 53970385 0.91
tpch_q11/datafusion:arrow 11185256 11863007 0.94
tpch_q12/datafusion:arrow 60035596 56598946 1.06
tpch_q13/datafusion:arrow 🚨 57746108 49207428 1.17
tpch_q14/datafusion:arrow 22826548 23683702 0.96
tpch_q15/datafusion:arrow 43292239 45471644 0.95
tpch_q16/datafusion:arrow 20048785 21401628 0.94
tpch_q17/datafusion:arrow 71943715 71550463 1.01
tpch_q18/datafusion:arrow 139393098 145605702 0.96
tpch_q19/datafusion:arrow 41499816 43229798 0.96
tpch_q20/datafusion:arrow 37252319 41027280 0.91
tpch_q21/datafusion:arrow 150375206 158172404 0.95
tpch_q22/datafusion:arrow 19207917 20139088 0.95
duckdb / vortex-file-compressed (0.904x ➖, 11↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33463360 35681084 0.94
tpch_q02/duckdb:vortex-file-compressed 🚀 26535060 31352798 0.85
tpch_q03/duckdb:vortex-file-compressed 28649002 31296753 0.92
tpch_q04/duckdb:vortex-file-compressed 🚀 28151797 32487648 0.87
tpch_q05/duckdb:vortex-file-compressed 34827264 36381091 0.96
tpch_q06/duckdb:vortex-file-compressed 10719456 11536752 0.93
tpch_q07/duckdb:vortex-file-compressed 🚀 37355464 43061240 0.87
tpch_q08/duckdb:vortex-file-compressed 🚀 40003203 44562115 0.90
tpch_q09/duckdb:vortex-file-compressed 🚀 75532798 88041418 0.86
tpch_q10/duckdb:vortex-file-compressed 35043146 37325698 0.94
tpch_q11/duckdb:vortex-file-compressed 16223467 16332992 0.99
tpch_q12/duckdb:vortex-file-compressed 22238314 24695564 0.90
tpch_q13/duckdb:vortex-file-compressed 🚀 37576783 42458227 0.89
tpch_q14/duckdb:vortex-file-compressed 🚀 21466363 25793135 0.83
tpch_q15/duckdb:vortex-file-compressed 🚀 16003007 18421237 0.87
tpch_q16/duckdb:vortex-file-compressed 30867413 29951373 1.03
tpch_q17/duckdb:vortex-file-compressed 25096701 26495537 0.95
tpch_q18/duckdb:vortex-file-compressed 46913918 49948020 0.94
tpch_q19/duckdb:vortex-file-compressed 🚀 31450474 37116156 0.85
tpch_q20/duckdb:vortex-file-compressed 🚀 34018618 40256306 0.85
tpch_q21/duckdb:vortex-file-compressed 🚀 101939324 116364350 0.88
tpch_q22/duckdb:vortex-file-compressed 18474367 19682710 0.94
duckdb / vortex-compact (0.925x ➖, 6↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38213330 39560767 0.97
tpch_q02/duckdb:vortex-compact 38188521 41183390 0.93
tpch_q03/duckdb:vortex-compact 32401009 35801903 0.91
tpch_q04/duckdb:vortex-compact 34644199 35388093 0.98
tpch_q05/duckdb:vortex-compact 36607400 39064415 0.94
tpch_q06/duckdb:vortex-compact 14273520 14326974 1.00
tpch_q07/duckdb:vortex-compact 42290162 44615332 0.95
tpch_q08/duckdb:vortex-compact 🚀 44337038 51119286 0.87
tpch_q09/duckdb:vortex-compact 91460724 90212289 1.01
tpch_q10/duckdb:vortex-compact 39835527 43318406 0.92
tpch_q11/duckdb:vortex-compact 20160049 21642924 0.93
tpch_q12/duckdb:vortex-compact 35609819 38483652 0.93
tpch_q13/duckdb:vortex-compact 🚀 45679175 52649407 0.87
tpch_q14/duckdb:vortex-compact 🚀 29564458 33451717 0.88
tpch_q15/duckdb:vortex-compact 19177875 20638642 0.93
tpch_q16/duckdb:vortex-compact 36474026 37525413 0.97
tpch_q17/duckdb:vortex-compact 30538370 32765401 0.93
tpch_q18/duckdb:vortex-compact 50222847 55759456 0.90
tpch_q19/duckdb:vortex-compact 🚀 36431944 42391178 0.86
tpch_q20/duckdb:vortex-compact 42923104 45165713 0.95
tpch_q21/duckdb:vortex-compact 🚀 109098857 121685340 0.90
tpch_q22/duckdb:vortex-compact 🚀 20329196 23382896 0.87
duckdb / parquet (0.949x ➖, 7↑ 2↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 80456605 76846853 1.05
tpch_q02/duckdb:parquet 39856874 41192684 0.97
tpch_q03/duckdb:parquet 68860636 71786032 0.96
tpch_q04/duckdb:parquet 🚀 46439595 56603414 0.82
tpch_q05/duckdb:parquet 67648322 71180336 0.95
tpch_q06/duckdb:parquet 20606357 21121890 0.98
tpch_q07/duckdb:parquet 77083592 74967193 1.03
tpch_q08/duckdb:parquet 🚀 81407746 100745152 0.81
tpch_q09/duckdb:parquet 🚀 131368562 147671518 0.89
tpch_q10/duckdb:parquet 125881260 139596256 0.90
tpch_q11/duckdb:parquet 22714012 23244429 0.98
tpch_q12/duckdb:parquet 🚀 45206761 57450780 0.79
tpch_q13/duckdb:parquet 🚀 260576142 306191849 0.85
tpch_q14/duckdb:parquet 56722939 52180415 1.09
tpch_q15/duckdb:parquet 🚨 29598441 26424662 1.12
tpch_q16/duckdb:parquet 55336663 57880177 0.96
tpch_q17/duckdb:parquet 🚨 65405386 51005916 1.28
tpch_q18/duckdb:parquet 120934109 120634207 1.00
tpch_q19/duckdb:parquet 🚀 67374087 78388194 0.86
tpch_q20/duckdb:parquet 62909947 66719288 0.94
tpch_q21/duckdb:parquet 🚀 173779918 199824324 0.87
tpch_q22/duckdb:parquet 50534142 54680839 0.92
duckdb / duckdb (0.967x ➖, 2↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15961397 16216349 0.98
tpch_q02/duckdb:duckdb 12323204 12699131 0.97
tpch_q03/duckdb:duckdb 19545255 20134272 0.97
tpch_q04/duckdb:duckdb 19394700 20217656 0.96
tpch_q05/duckdb:duckdb 21218535 19826153 1.07
tpch_q06/duckdb:duckdb 5171314 5465857 0.95
tpch_q07/duckdb:duckdb 22388217 23343379 0.96
tpch_q08/duckdb:duckdb 20768961 21603380 0.96
tpch_q09/duckdb:duckdb 🚀 51530451 57384319 0.90
tpch_q10/duckdb:duckdb 44015366 45974871 0.96
tpch_q11/duckdb:duckdb 5571897 5871504 0.95
tpch_q12/duckdb:duckdb 13751393 13988289 0.98
tpch_q13/duckdb:duckdb 🚀 37397674 43462055 0.86
tpch_q14/duckdb:duckdb 15594949 16700094 0.93
tpch_q15/duckdb:duckdb 11925324 11717171 1.02
tpch_q16/duckdb:duckdb 22108336 22878712 0.97
tpch_q17/duckdb:duckdb 13427908 13511668 0.99
tpch_q18/duckdb:duckdb 37372624 39142351 0.95
tpch_q19/duckdb:duckdb 25525795 26140784 0.98
tpch_q20/duckdb:duckdb 22295452 23262002 0.96
tpch_q21/duckdb:duckdb 56134266 55452448 1.01
tpch_q22/duckdb:duckdb 23909546 23838636 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -11.0% +3.2% -13.8% +26.1% ➖ noise
1 datafusion:vortex-compact -5.3% +3.2% -8.2% +26.3% ➖ noise
1 datafusion:vortex-file-compressed -15.6% +3.2% -18.2% +28.4% ➖ noise
1 duckdb:duckdb -1.6% +3.2% -4.6% +24.3% ➖ noise
1 duckdb:vortex-compact -3.4% +3.2% -6.4% +24.7% ➖ noise
1 duckdb:vortex-file-compressed -6.2% +3.2% -9.1% +24.1% ➖ noise
2 datafusion:arrow -1.3% -2.7% +1.4% +18.1% ➖ noise
2 datafusion:vortex-compact -9.4% -2.7% -6.8% +18.1% ➖ noise
2 datafusion:vortex-file-compressed -13.7% -2.7% -11.2% +18.1% ➖ noise
2 duckdb:duckdb -3.0% -2.7% -0.2% +18.1% ➖ noise
2 duckdb:vortex-compact -7.3% -2.7% -4.7% +18.1% ➖ noise
2 duckdb:vortex-file-compressed -15.4% -2.7% -13.0% +18.1% ➖ noise
3 datafusion:arrow -5.0% -2.6% -2.5% +18.1% ➖ noise
3 datafusion:vortex-compact -13.2% -2.6% -10.9% +18.1% ➖ noise
3 datafusion:vortex-file-compressed -17.4% -2.6% -15.1% +18.1% ➖ noise
3 duckdb:duckdb -2.9% -2.6% -0.3% +18.1% ➖ noise
3 duckdb:vortex-compact -9.5% -2.6% -7.1% +18.1% ➖ noise
3 duckdb:vortex-file-compressed -8.5% -2.6% -6.0% +22.9% ➖ noise
4 datafusion:arrow -12.1% -10.5% -1.7% +18.1% ➖ noise
4 datafusion:vortex-compact -8.5% -10.5% +2.3% +18.1% ➖ noise
4 datafusion:vortex-file-compressed -8.1% -10.5% +2.7% +18.1% ➖ noise
4 duckdb:duckdb -4.1% -10.5% +7.2% +18.1% ➖ noise
4 duckdb:vortex-compact -2.1% -10.5% +9.4% +18.1% ➖ noise
4 duckdb:vortex-file-compressed -13.3% -10.5% -3.2% +18.1% ➖ noise
5 datafusion:arrow -12.4% -3.0% -9.7% +18.1% ➖ noise
5 datafusion:vortex-compact -13.5% -3.0% -10.9% +18.1% ➖ noise
5 datafusion:vortex-file-compressed -12.1% -3.0% -9.4% +18.1% ➖ noise
5 duckdb:duckdb +7.0% -3.0% +10.3% +18.1% ➖ noise
5 duckdb:vortex-compact -6.3% -3.0% -3.4% +18.1% ➖ noise
5 duckdb:vortex-file-compressed -4.3% -3.0% -1.3% +18.1% ➖ noise
6 datafusion:arrow -8.2% -5.5% -2.8% +18.1% ➖ noise
6 datafusion:vortex-compact +9.6% -5.5% +16.0% +19.0% ➖ noise
6 datafusion:vortex-file-compressed -10.3% -5.5% -5.1% +21.9% ➖ noise
6 duckdb:duckdb -5.4% -5.5% +0.1% +21.2% ➖ noise
6 duckdb:vortex-compact -0.4% -5.5% +5.4% +22.5% ➖ noise
6 duckdb:vortex-file-compressed -7.1% -5.5% -1.7% +20.2% ➖ noise
7 datafusion:arrow -7.1% -1.1% -6.0% +18.1% ➖ noise
7 datafusion:vortex-compact -5.8% -1.1% -4.7% +18.1% ➖ noise
7 datafusion:vortex-file-compressed -12.2% -1.1% -11.1% +18.1% ➖ noise
7 duckdb:duckdb -4.1% -1.1% -3.0% +18.1% ➖ noise
7 duckdb:vortex-compact -5.2% -1.1% -4.1% +18.1% ➖ noise
7 duckdb:vortex-file-compressed -13.3% -1.1% -12.3% +18.1% ➖ noise
8 datafusion:arrow -2.8% -16.1% +15.8% +18.1% ➖ noise
8 datafusion:vortex-compact -9.5% -16.1% +7.9% +18.1% ➖ noise
8 datafusion:vortex-file-compressed -9.3% -16.1% +8.1% +18.1% ➖ noise
8 duckdb:duckdb -3.9% -16.1% +14.6% +18.1% ➖ noise
8 duckdb:vortex-compact -13.3% -16.1% +3.3% +18.1% ➖ noise
8 duckdb:vortex-file-compressed -10.2% -16.1% +7.0% +18.1% ➖ noise
9 datafusion:arrow -3.0% -9.1% +6.7% +18.1% ➖ noise
9 datafusion:vortex-compact -8.7% -9.1% +0.4% +18.1% ➖ noise
9 datafusion:vortex-file-compressed -13.2% -9.1% -4.5% +18.1% ➖ noise
9 duckdb:duckdb -10.2% -9.1% -1.3% +18.1% ➖ noise
9 duckdb:vortex-compact +1.4% -9.1% +11.5% +18.1% ➖ noise
9 duckdb:vortex-file-compressed -14.2% -9.1% -5.7% +18.1% ➖ noise
10 datafusion:arrow -8.9% -6.1% -3.0% +18.1% ➖ noise
10 datafusion:vortex-compact -10.8% -6.1% -4.9% +18.1% ➖ noise
10 datafusion:vortex-file-compressed -10.7% -6.1% -4.9% +18.1% ➖ noise
10 duckdb:duckdb -4.3% -6.1% +2.0% +18.8% ➖ noise
10 duckdb:vortex-compact -8.0% -6.1% -2.0% +18.1% ➖ noise
10 duckdb:vortex-file-compressed -6.1% -6.1% +0.0% +18.1% ➖ noise
11 datafusion:arrow -5.7% -4.1% -1.7% +18.1% ➖ noise
11 datafusion:vortex-compact -15.1% -4.1% -11.5% +18.1% ➖ noise
11 datafusion:vortex-file-compressed -17.3% -4.1% -13.7% +18.1% ➖ noise
11 duckdb:duckdb -5.1% -4.1% -1.1% +18.1% ➖ noise
11 duckdb:vortex-compact -6.9% -4.1% -2.9% +18.1% ➖ noise
11 duckdb:vortex-file-compressed -0.7% -4.1% +3.6% +18.1% ➖ noise
12 datafusion:arrow +6.1% -13.6% +22.7% +18.6% 🚨 regression
12 datafusion:vortex-compact -7.9% -13.6% +6.6% +18.1% ➖ noise
12 datafusion:vortex-file-compressed -13.4% -13.6% +0.2% +18.1% ➖ noise
12 duckdb:duckdb -1.7% -13.6% +13.8% +18.1% ➖ noise
12 duckdb:vortex-compact -7.5% -13.6% +7.1% +18.1% ➖ noise
12 duckdb:vortex-file-compressed -10.0% -13.6% +4.2% +18.1% ➖ noise
13 datafusion:arrow +17.4% -14.8% +37.8% +18.1% 🚨 regression
13 datafusion:vortex-compact -7.2% -14.8% +8.9% +18.1% ➖ noise
13 datafusion:vortex-file-compressed -11.9% -14.8% +3.4% +18.1% ➖ noise
13 duckdb:duckdb -14.0% -14.8% +1.0% +18.1% ➖ noise
13 duckdb:vortex-compact -13.2% -14.8% +1.9% +18.1% ➖ noise
13 duckdb:vortex-file-compressed -11.5% -14.8% +3.9% +18.1% ➖ noise
14 datafusion:arrow -3.6% +4.3% -7.6% +18.1% ➖ noise
14 datafusion:vortex-compact -8.0% +4.3% -11.7% +18.1% ➖ noise
14 datafusion:vortex-file-compressed -13.5% +4.3% -17.0% +18.1% ✅ faster
14 duckdb:duckdb -6.6% +4.3% -10.4% +23.6% ➖ noise
14 duckdb:vortex-compact -11.6% +4.3% -15.2% +18.1% ➖ noise
14 duckdb:vortex-file-compressed -16.8% +4.3% -20.2% +18.1% ✅ faster
15 datafusion:arrow -4.8% +4.8% -9.2% +18.1% ➖ noise
15 datafusion:vortex-compact -10.8% +4.8% -15.0% +18.1% ➖ noise
15 datafusion:vortex-file-compressed -9.0% +4.8% -13.2% +18.1% ➖ noise
15 duckdb:duckdb +1.8% +4.8% -2.9% +18.1% ➖ noise
15 duckdb:vortex-compact -7.1% +4.8% -11.4% +18.1% ➖ noise
15 duckdb:vortex-file-compressed -13.1% +4.8% -17.1% +18.1% ✅ faster
16 datafusion:arrow -6.3% -10.7% +4.9% +18.1% ➖ noise
16 datafusion:vortex-compact -7.9% -10.7% +3.2% +18.1% ➖ noise
16 datafusion:vortex-file-compressed -11.7% -10.7% -1.1% +18.1% ➖ noise
16 duckdb:duckdb -3.4% -10.7% +8.2% +18.1% ➖ noise
16 duckdb:vortex-compact -2.8% -10.7% +8.9% +18.1% ➖ noise
16 duckdb:vortex-file-compressed +3.1% -10.7% +15.4% +18.1% ➖ noise
17 datafusion:arrow +0.5% +3.1% -2.5% +18.1% ➖ noise
17 datafusion:vortex-compact -4.0% +3.1% -6.9% +19.5% ➖ noise
17 datafusion:vortex-file-compressed -15.6% +3.1% -18.1% +19.5% ✅ faster
17 duckdb:duckdb -0.6% +3.1% -3.6% +18.7% ➖ noise
17 duckdb:vortex-compact -6.8% +3.1% -9.6% +18.1% ➖ noise
17 duckdb:vortex-file-compressed -5.3% +3.1% -8.1% +19.7% ➖ noise
18 datafusion:arrow -4.3% -3.7% -0.6% +18.1% ➖ noise
18 datafusion:vortex-compact -7.2% -3.7% -3.7% +18.1% ➖ noise
18 datafusion:vortex-file-compressed -7.9% -3.7% -4.4% +18.1% ➖ noise
18 duckdb:duckdb -4.5% -3.7% -0.9% +18.1% ➖ noise
18 duckdb:vortex-compact -9.9% -3.7% -6.5% +18.1% ➖ noise
18 duckdb:vortex-file-compressed -6.1% -3.7% -2.5% +18.1% ➖ noise
19 datafusion:arrow -4.0% -11.6% +8.6% +18.1% ➖ noise
19 datafusion:vortex-compact -6.8% -11.6% +5.4% +18.1% ➖ noise
19 datafusion:vortex-file-compressed +0.4% -11.6% +13.7% +18.1% ➖ noise
19 duckdb:duckdb -2.4% -11.6% +10.5% +19.4% ➖ noise
19 duckdb:vortex-compact -14.1% -11.6% -2.8% +18.1% ➖ noise
19 duckdb:vortex-file-compressed -15.3% -11.6% -4.1% +18.1% ➖ noise
20 datafusion:arrow -9.2% -4.5% -4.9% +18.1% ➖ noise
20 datafusion:vortex-compact -13.0% -4.5% -8.9% +18.1% ➖ noise
20 datafusion:vortex-file-compressed -10.4% -4.5% -6.1% +18.1% ➖ noise
20 duckdb:duckdb -4.2% -4.5% +0.4% +18.1% ➖ noise
20 duckdb:vortex-compact -5.0% -4.5% -0.5% +18.1% ➖ noise
20 duckdb:vortex-file-compressed -15.5% -4.5% -11.5% +20.5% ➖ noise
21 datafusion:arrow -4.9% -8.2% +3.5% +18.1% ➖ noise
21 datafusion:vortex-compact -13.7% -8.2% -6.0% +18.1% ➖ noise
21 datafusion:vortex-file-compressed -11.1% -8.2% -3.2% +18.1% ➖ noise
21 duckdb:duckdb +1.2% -8.2% +10.3% +18.1% ➖ noise
21 duckdb:vortex-compact -10.3% -8.2% -2.3% +18.1% ➖ noise
21 duckdb:vortex-file-compressed -12.4% -8.2% -4.6% +18.1% ➖ noise
22 datafusion:arrow -4.6% -7.6% +3.2% +18.1% ➖ noise
22 datafusion:vortex-compact -11.9% -7.6% -4.7% +18.1% ➖ noise
22 datafusion:vortex-file-compressed -8.2% -7.6% -0.6% +18.1% ➖ noise
22 duckdb:duckdb +0.3% -7.6% +8.6% +18.1% ➖ noise
22 duckdb:vortex-compact -13.1% -7.6% -5.9% +18.1% ➖ noise
22 duckdb:vortex-file-compressed -6.1% -7.6% +1.6% +18.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

File Sizes: TPC-H SF=1 on NVME

File Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)
File Scale Format Base HEAD Change %
lineitem_18.vortex 100 vortex-file-compressed 148.20 MB 0 B 148.20 MB -100.0%
orders_0.vortex 100 vortex-file-compressed 179.57 MB 0 B 179.57 MB -100.0%
lineitem_119.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
orders_14.vortex 100 vortex-file-compressed 179.74 MB 0 B 179.74 MB -100.0%
lineitem_79.vortex 100 vortex-file-compressed 148.82 MB 0 B 148.82 MB -100.0%
lineitem_63.vortex 100 vortex-file-compressed 148.99 MB 0 B 148.99 MB -100.0%
lineitem_3.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
part_2.vortex 100 vortex-file-compressed 28.39 MB 0 B 28.39 MB -100.0%
partsupp_7.vortex 100 vortex-file-compressed 190.87 MB 0 B 190.87 MB -100.0%
lineitem_37.vortex 100 vortex-file-compressed 148.12 MB 0 B 148.12 MB -100.0%
lineitem_10.vortex 100 vortex-file-compressed 148.72 MB 0 B 148.72 MB -100.0%
lineitem_85.vortex 100 vortex-file-compressed 148.44 MB 0 B 148.44 MB -100.0%
customer_3.vortex 100 vortex-file-compressed 261.33 MB 0 B 261.33 MB -100.0%
lineitem_33.vortex 100 vortex-file-compressed 148.30 MB 0 B 148.30 MB -100.0%
lineitem_35.vortex 100 vortex-file-compressed 148.79 MB 0 B 148.79 MB -100.0%
lineitem_92.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
orders_4.vortex 100 vortex-file-compressed 179.97 MB 0 B 179.97 MB -100.0%
orders_20.vortex 100 vortex-file-compressed 179.42 MB 0 B 179.42 MB -100.0%
orders_17.vortex 100 vortex-file-compressed 179.59 MB 0 B 179.59 MB -100.0%
lineitem_47.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
customer_2.vortex 100 vortex-file-compressed 261.23 MB 0 B 261.23 MB -100.0%
lineitem_60.vortex 100 vortex-file-compressed 148.96 MB 0 B 148.96 MB -100.0%
lineitem_36.vortex 100 vortex-file-compressed 148.27 MB 0 B 148.27 MB -100.0%
lineitem_68.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
lineitem_5.vortex 100 vortex-file-compressed 148.64 MB 0 B 148.64 MB -100.0%
lineitem_49.vortex 100 vortex-file-compressed 148.86 MB 0 B 148.86 MB -100.0%
lineitem_104.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
lineitem_43.vortex 100 vortex-file-compressed 148.40 MB 0 B 148.40 MB -100.0%
lineitem_46.vortex 100 vortex-file-compressed 148.32 MB 0 B 148.32 MB -100.0%
duckdb.db 100 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem_100.vortex 100 vortex-file-compressed 148.57 MB 0 B 148.57 MB -100.0%
lineitem_17.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
lineitem_89.vortex 100 vortex-file-compressed 148.51 MB 0 B 148.51 MB -100.0%
nation_0.vortex 100 vortex-file-compressed 8.10 KB 0 B 8.10 KB -100.0%
part_8.vortex 100 vortex-file-compressed 28.36 MB 0 B 28.36 MB -100.0%
part_9.vortex 100 vortex-file-compressed 28.33 MB 0 B 28.33 MB -100.0%
lineitem_87.vortex 100 vortex-file-compressed 148.12 MB 0 B 148.12 MB -100.0%
lineitem_34.vortex 100 vortex-file-compressed 149.17 MB 0 B 149.17 MB -100.0%
part_6.vortex 100 vortex-file-compressed 28.36 MB 0 B 28.36 MB -100.0%
orders_2.vortex 100 vortex-file-compressed 179.91 MB 0 B 179.91 MB -100.0%
partsupp_18.vortex 100 vortex-file-compressed 190.65 MB 0 B 190.65 MB -100.0%
partsupp_0.vortex 100 vortex-file-compressed 190.64 MB 0 B 190.64 MB -100.0%
lineitem_0.vortex 100 vortex-file-compressed 149.03 MB 0 B 149.03 MB -100.0%
lineitem_101.vortex 100 vortex-file-compressed 148.77 MB 0 B 148.77 MB -100.0%
lineitem_74.vortex 100 vortex-file-compressed 148.21 MB 0 B 148.21 MB -100.0%
partsupp_14.vortex 100 vortex-file-compressed 190.89 MB 0 B 190.89 MB -100.0%
orders_5.vortex 100 vortex-file-compressed 179.60 MB 0 B 179.60 MB -100.0%
part_4.vortex 100 vortex-file-compressed 28.34 MB 0 B 28.34 MB -100.0%
lineitem_66.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
region_0.vortex 100 vortex-file-compressed 4.50 KB 0 B 4.50 KB -100.0%
lineitem_113.vortex 100 vortex-file-compressed 148.17 MB 0 B 148.17 MB -100.0%
lineitem_109.vortex 100 vortex-file-compressed 148.55 MB 0 B 148.55 MB -100.0%
lineitem_6.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
orders_16.vortex 100 vortex-file-compressed 179.44 MB 0 B 179.44 MB -100.0%
part_7.vortex 100 vortex-file-compressed 28.34 MB 0 B 28.34 MB -100.0%
part_3.vortex 100 vortex-file-compressed 28.35 MB 0 B 28.35 MB -100.0%
orders_3.vortex 100 vortex-file-compressed 179.68 MB 0 B 179.68 MB -100.0%
lineitem_117.vortex 100 vortex-file-compressed 148.67 MB 0 B 148.67 MB -100.0%
part_10.vortex 100 vortex-file-compressed 28.35 MB 0 B 28.35 MB -100.0%
partsupp_6.vortex 100 vortex-file-compressed 190.65 MB 0 B 190.65 MB -100.0%
orders_19.vortex 100 vortex-file-compressed 179.62 MB 0 B 179.62 MB -100.0%
lineitem_52.vortex 100 vortex-file-compressed 147.76 MB 0 B 147.76 MB -100.0%
lineitem_24.vortex 100 vortex-file-compressed 148.15 MB 0 B 148.15 MB -100.0%
lineitem_73.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
lineitem_14.vortex 100 vortex-file-compressed 148.36 MB 0 B 148.36 MB -100.0%
orders_18.vortex 100 vortex-file-compressed 180.03 MB 0 B 180.03 MB -100.0%
lineitem_22.vortex 100 vortex-file-compressed 148.04 MB 0 B 148.04 MB -100.0%
orders_26.vortex 100 vortex-file-compressed 179.54 MB 0 B 179.54 MB -100.0%
lineitem_120.vortex 100 vortex-file-compressed 147.85 MB 0 B 147.85 MB -100.0%
orders_13.vortex 100 vortex-file-compressed 179.40 MB 0 B 179.40 MB -100.0%
lineitem_21.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
orders_27.vortex 100 vortex-file-compressed 179.35 MB 0 B 179.35 MB -100.0%
partsupp_2.vortex 100 vortex-file-compressed 190.66 MB 0 B 190.66 MB -100.0%
lineitem_25.vortex 100 vortex-file-compressed 148.88 MB 0 B 148.88 MB -100.0%
partsupp_16.vortex 100 vortex-file-compressed 190.52 MB 0 B 190.52 MB -100.0%
lineitem_51.vortex 100 vortex-file-compressed 148.81 MB 0 B 148.81 MB -100.0%
orders_15.vortex 100 vortex-file-compressed 179.78 MB 0 B 179.78 MB -100.0%
supplier_0.vortex 100 vortex-file-compressed 66.58 MB 0 B 66.58 MB -100.0%
lineitem_42.vortex 100 vortex-file-compressed 148.80 MB 0 B 148.80 MB -100.0%
lineitem_111.vortex 100 vortex-file-compressed 148.34 MB 0 B 148.34 MB -100.0%
lineitem_99.vortex 100 vortex-file-compressed 147.97 MB 0 B 147.97 MB -100.0%
orders_21.vortex 100 vortex-file-compressed 179.45 MB 0 B 179.45 MB -100.0%
orders_22.vortex 100 vortex-file-compressed 179.61 MB 0 B 179.61 MB -100.0%
lineitem_32.vortex 100 vortex-file-compressed 149.15 MB 0 B 149.15 MB -100.0%
lineitem_12.vortex 100 vortex-file-compressed 148.66 MB 0 B 148.66 MB -100.0%
partsupp_8.vortex 100 vortex-file-compressed 190.76 MB 0 B 190.76 MB -100.0%
orders_1.vortex 100 vortex-file-compressed 179.50 MB 0 B 179.50 MB -100.0%
lineitem_50.vortex 100 vortex-file-compressed 149.12 MB 0 B 149.12 MB -100.0%
lineitem_48.vortex 100 vortex-file-compressed 148.66 MB 0 B 148.66 MB -100.0%
lineitem_56.vortex 100 vortex-file-compressed 148.30 MB 0 B 148.30 MB -100.0%
lineitem_40.vortex 100 vortex-file-compressed 148.48 MB 0 B 148.48 MB -100.0%
partsupp_1.vortex 100 vortex-file-compressed 190.96 MB 0 B 190.96 MB -100.0%
lineitem_16.vortex 100 vortex-file-compressed 148.50 MB 0 B 148.50 MB -100.0%
part_18.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
orders_8.vortex 100 vortex-file-compressed 179.77 MB 0 B 179.77 MB -100.0%
lineitem_72.vortex 100 vortex-file-compressed 148.52 MB 0 B 148.52 MB -100.0%
lineitem_112.vortex 100 vortex-file-compressed 148.06 MB 0 B 148.06 MB -100.0%
lineitem_81.vortex 100 vortex-file-compressed 148.32 MB 0 B 148.32 MB -100.0%
lineitem_75.vortex 100 vortex-file-compressed 148.40 MB 0 B 148.40 MB -100.0%
partsupp_17.vortex 100 vortex-file-compressed 190.76 MB 0 B 190.76 MB -100.0%
orders_7.vortex 100 vortex-file-compressed 179.70 MB 0 B 179.70 MB -100.0%
part_0.vortex 100 vortex-file-compressed 28.37 MB 0 B 28.37 MB -100.0%
lineitem_78.vortex 100 vortex-file-compressed 148.04 MB 0 B 148.04 MB -100.0%
partsupp_12.vortex 100 vortex-file-compressed 190.77 MB 0 B 190.77 MB -100.0%
part_16.vortex 100 vortex-file-compressed 28.34 MB 0 B 28.34 MB -100.0%
lineitem_83.vortex 100 vortex-file-compressed 148.97 MB 0 B 148.97 MB -100.0%
partsupp_10.vortex 100 vortex-file-compressed 190.86 MB 0 B 190.86 MB -100.0%
lineitem_57.vortex 100 vortex-file-compressed 148.79 MB 0 B 148.79 MB -100.0%
lineitem_26.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
partsupp_4.vortex 100 vortex-file-compressed 190.67 MB 0 B 190.67 MB -100.0%
lineitem_96.vortex 100 vortex-file-compressed 148.51 MB 0 B 148.51 MB -100.0%
lineitem_118.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_69.vortex 100 vortex-file-compressed 148.58 MB 0 B 148.58 MB -100.0%
part_12.vortex 100 vortex-file-compressed 28.35 MB 0 B 28.35 MB -100.0%
partsupp_9.vortex 100 vortex-file-compressed 190.76 MB 0 B 190.76 MB -100.0%
partsupp_5.vortex 100 vortex-file-compressed 190.67 MB 0 B 190.67 MB -100.0%
lineitem_95.vortex 100 vortex-file-compressed 148.14 MB 0 B 148.14 MB -100.0%
lineitem_94.vortex 100 vortex-file-compressed 148.77 MB 0 B 148.77 MB -100.0%
lineitem_59.vortex 100 vortex-file-compressed 148.81 MB 0 B 148.81 MB -100.0%
part_15.vortex 100 vortex-file-compressed 28.40 MB 0 B 28.40 MB -100.0%
lineitem_102.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_110.vortex 100 vortex-file-compressed 148.80 MB 0 B 148.80 MB -100.0%
lineitem_53.vortex 100 vortex-file-compressed 148.66 MB 0 B 148.66 MB -100.0%
customer_1.vortex 100 vortex-file-compressed 261.31 MB 0 B 261.31 MB -100.0%
lineitem_115.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
lineitem_8.vortex 100 vortex-file-compressed 148.90 MB 0 B 148.90 MB -100.0%
lineitem_97.vortex 100 vortex-file-compressed 148.58 MB 0 B 148.58 MB -100.0%
partsupp_3.vortex 100 vortex-file-compressed 190.63 MB 0 B 190.63 MB -100.0%
lineitem_80.vortex 100 vortex-file-compressed 148.17 MB 0 B 148.17 MB -100.0%
orders_10.vortex 100 vortex-file-compressed 179.70 MB 0 B 179.70 MB -100.0%
lineitem_44.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
lineitem_107.vortex 100 vortex-file-compressed 148.52 MB 0 B 148.52 MB -100.0%
lineitem_67.vortex 100 vortex-file-compressed 149.09 MB 0 B 149.09 MB -100.0%
lineitem_91.vortex 100 vortex-file-compressed 148.69 MB 0 B 148.69 MB -100.0%
orders_25.vortex 100 vortex-file-compressed 179.39 MB 0 B 179.39 MB -100.0%
lineitem_13.vortex 100 vortex-file-compressed 148.69 MB 0 B 148.69 MB -100.0%
lineitem_98.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
lineitem_2.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
part_1.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
lineitem_20.vortex 100 vortex-file-compressed 149.06 MB 0 B 149.06 MB -100.0%
lineitem_29.vortex 100 vortex-file-compressed 149.04 MB 0 B 149.04 MB -100.0%
lineitem_93.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
lineitem_11.vortex 100 vortex-file-compressed 148.96 MB 0 B 148.96 MB -100.0%
lineitem_88.vortex 100 vortex-file-compressed 149.00 MB 0 B 149.00 MB -100.0%
lineitem_39.vortex 100 vortex-file-compressed 148.04 MB 0 B 148.04 MB -100.0%
lineitem_45.vortex 100 vortex-file-compressed 147.67 MB 0 B 147.67 MB -100.0%
lineitem_86.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_90.vortex 100 vortex-file-compressed 148.38 MB 0 B 148.38 MB -100.0%
lineitem_31.vortex 100 vortex-file-compressed 148.87 MB 0 B 148.87 MB -100.0%
orders_24.vortex 100 vortex-file-compressed 179.13 MB 0 B 179.13 MB -100.0%
orders_9.vortex 100 vortex-file-compressed 179.68 MB 0 B 179.68 MB -100.0%
part_13.vortex 100 vortex-file-compressed 28.36 MB 0 B 28.36 MB -100.0%
lineitem_1.vortex 100 vortex-file-compressed 148.90 MB 0 B 148.90 MB -100.0%
lineitem_105.vortex 100 vortex-file-compressed 148.13 MB 0 B 148.13 MB -100.0%
lineitem_106.vortex 100 vortex-file-compressed 148.54 MB 0 B 148.54 MB -100.0%
lineitem_108.vortex 100 vortex-file-compressed 147.99 MB 0 B 147.99 MB -100.0%
partsupp_15.vortex 100 vortex-file-compressed 190.79 MB 0 B 190.79 MB -100.0%
lineitem_114.vortex 100 vortex-file-compressed 148.13 MB 0 B 148.13 MB -100.0%
orders_6.vortex 100 vortex-file-compressed 179.39 MB 0 B 179.39 MB -100.0%
lineitem_4.vortex 100 vortex-file-compressed 147.97 MB 0 B 147.97 MB -100.0%
lineitem_27.vortex 100 vortex-file-compressed 148.82 MB 0 B 148.82 MB -100.0%
lineitem_77.vortex 100 vortex-file-compressed 148.67 MB 0 B 148.67 MB -100.0%
lineitem_41.vortex 100 vortex-file-compressed 147.56 MB 0 B 147.56 MB -100.0%
lineitem_58.vortex 100 vortex-file-compressed 149.01 MB 0 B 149.01 MB -100.0%
partsupp_11.vortex 100 vortex-file-compressed 190.69 MB 0 B 190.69 MB -100.0%
lineitem_71.vortex 100 vortex-file-compressed 148.46 MB 0 B 148.46 MB -100.0%
orders_11.vortex 100 vortex-file-compressed 179.64 MB 0 B 179.64 MB -100.0%
lineitem_61.vortex 100 vortex-file-compressed 148.30 MB 0 B 148.30 MB -100.0%
lineitem_7.vortex 100 vortex-file-compressed 148.39 MB 0 B 148.39 MB -100.0%
orders_12.vortex 100 vortex-file-compressed 179.89 MB 0 B 179.89 MB -100.0%
part_17.vortex 100 vortex-file-compressed 28.33 MB 0 B 28.33 MB -100.0%
part_5.vortex 100 vortex-file-compressed 28.31 MB 0 B 28.31 MB -100.0%
lineitem_76.vortex 100 vortex-file-compressed 148.05 MB 0 B 148.05 MB -100.0%
lineitem_84.vortex 100 vortex-file-compressed 148.45 MB 0 B 148.45 MB -100.0%
part_14.vortex 100 vortex-file-compressed 28.38 MB 0 B 28.38 MB -100.0%
lineitem_15.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
customer_0.vortex 100 vortex-file-compressed 261.34 MB 0 B 261.34 MB -100.0%
lineitem_82.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
lineitem_54.vortex 100 vortex-file-compressed 149.31 MB 0 B 149.31 MB -100.0%
orders_23.vortex 100 vortex-file-compressed 179.50 MB 0 B 179.50 MB -100.0%
partsupp_13.vortex 100 vortex-file-compressed 190.61 MB 0 B 190.61 MB -100.0%
lineitem_64.vortex 100 vortex-file-compressed 148.28 MB 0 B 148.28 MB -100.0%
lineitem_62.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
part_11.vortex 100 vortex-file-compressed 28.37 MB 0 B 28.37 MB -100.0%
lineitem_55.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_38.vortex 100 vortex-file-compressed 149.30 MB 0 B 149.30 MB -100.0%
lineitem_70.vortex 100 vortex-file-compressed 148.41 MB 0 B 148.41 MB -100.0%
lineitem_116.vortex 100 vortex-file-compressed 148.63 MB 0 B 148.63 MB -100.0%
lineitem_30.vortex 100 vortex-file-compressed 148.12 MB 0 B 148.12 MB -100.0%
lineitem_9.vortex 100 vortex-file-compressed 149.12 MB 0 B 149.12 MB -100.0%
lineitem_65.vortex 100 vortex-file-compressed 148.17 MB 0 B 148.17 MB -100.0%
lineitem_19.vortex 100 vortex-file-compressed 149.06 MB 0 B 149.06 MB -100.0%
lineitem_23.vortex 100 vortex-file-compressed 148.65 MB 0 B 148.65 MB -100.0%
lineitem_28.vortex 100 vortex-file-compressed 149.00 MB 0 B 149.00 MB -100.0%
lineitem_103.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%

Totals:

  • vortex-compact: 194.43 MB → 194.43 MB (0.0%)
  • vortex-file-compressed: 27.88 GB → 266.83 MB (-99.1%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 1.006x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%


datafusion / vortex-file-compressed (1.022x ➖, 0↑ 2↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5657513 4886768 1.16
fineweb_q01/datafusion:vortex-file-compressed 25873902 26164679 0.99
fineweb_q02/datafusion:vortex-file-compressed 28226252 28902735 0.98
fineweb_q03/datafusion:vortex-file-compressed 75878193 78227370 0.97
fineweb_q04/datafusion:vortex-file-compressed 257420120 267437355 0.96
fineweb_q05/datafusion:vortex-file-compressed 231864929 229936429 1.01
fineweb_q06/datafusion:vortex-file-compressed 70681211 70114592 1.01
fineweb_q07/datafusion:vortex-file-compressed 70030080 69222375 1.01
fineweb_q08/datafusion:vortex-file-compressed 🚨 26169988 23015964 1.14
datafusion / vortex-compact (0.983x ➖, 1↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 4882140 5445734 0.90
fineweb_q01/datafusion:vortex-compact 163252262 162835497 1.00
fineweb_q02/datafusion:vortex-compact 164377741 163024990 1.01
fineweb_q03/datafusion:vortex-compact 1438095359 1445717281 0.99
fineweb_q04/datafusion:vortex-compact 1565335683 1556608682 1.01
fineweb_q05/datafusion:vortex-compact 1244171520 1229426795 1.01
fineweb_q06/datafusion:vortex-compact 687842683 693715510 0.99
fineweb_q07/datafusion:vortex-compact 732994709 733379448 1.00
fineweb_q08/datafusion:vortex-compact 21421667 22694624 0.94
datafusion / parquet (0.997x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6427487 6500170 0.99
fineweb_q01/datafusion:parquet 281059890 286175616 0.98
fineweb_q02/datafusion:parquet 279311341 285165637 0.98
fineweb_q03/datafusion:parquet 288030342 279318607 1.03
fineweb_q04/datafusion:parquet 296602655 290680612 1.02
fineweb_q05/datafusion:parquet 292242401 290718953 1.01
fineweb_q06/datafusion:parquet 283584034 293877560 0.96
fineweb_q07/datafusion:parquet 279170830 279120527 1.00
fineweb_q08/datafusion:parquet 276926959 276327133 1.00
duckdb / vortex-file-compressed (1.019x ➖, 1↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3380755 3431485 0.99
fineweb_q01/duckdb:vortex-file-compressed 🚀 24349437 27219565 0.89
fineweb_q02/duckdb:vortex-file-compressed 26177219 26451180 0.99
fineweb_q03/duckdb:vortex-file-compressed 🚨 169168252 126465455 1.34
fineweb_q04/duckdb:vortex-file-compressed 235272546 229495929 1.03
fineweb_q05/duckdb:vortex-file-compressed 216549059 220148523 0.98
fineweb_q06/duckdb:vortex-file-compressed 65584745 61221693 1.07
fineweb_q07/duckdb:vortex-file-compressed 62737403 68489089 0.92
fineweb_q08/duckdb:vortex-file-compressed 24709472 24010711 1.03
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4099217 4087238 1.00
fineweb_q01/duckdb:vortex-compact 108475453 109298792 0.99
fineweb_q02/duckdb:vortex-compact 117510050 118234610 0.99
fineweb_q03/duckdb:vortex-compact 880722755 850881714 1.04
fineweb_q04/duckdb:vortex-compact 907314803 904064010 1.00
fineweb_q05/duckdb:vortex-compact 839808404 803239834 1.05
fineweb_q06/duckdb:vortex-compact 468153478 465283401 1.01
fineweb_q07/duckdb:vortex-compact 472841323 479489083 0.99
fineweb_q08/duckdb:vortex-compact 21719096 23413793 0.93
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36012458 35958620 1.00
fineweb_q01/duckdb:parquet 91721497 93938384 0.98
fineweb_q02/duckdb:parquet 96890594 95996517 1.01
fineweb_q03/duckdb:parquet 306268801 307436052 1.00
fineweb_q04/duckdb:parquet 441001032 439450653 1.00
fineweb_q05/duckdb:parquet 408550253 409848941 1.00
fineweb_q06/duckdb:parquet 196556186 198519685 0.99
fineweb_q07/duckdb:parquet 207900702 208633287 1.00
fineweb_q08/duckdb:parquet 57527845 56549472 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -10.3% -0.5% -9.9% +34.8% ➖ noise
0 datafusion:vortex-file-compressed +15.8% -0.5% +16.3% +64.6% ➖ noise
0 duckdb:vortex-compact +0.3% -0.5% +0.8% +34.6% ➖ noise
0 duckdb:vortex-file-compressed -1.5% -0.5% -1.0% +48.8% ➖ noise
1 datafusion:vortex-compact +0.3% -2.1% +2.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -1.1% -2.1% +1.0% +26.1% ➖ noise
1 duckdb:vortex-compact -0.8% -2.1% +1.3% +14.3% ➖ noise
1 duckdb:vortex-file-compressed -10.5% -2.1% -8.6% +44.2% ➖ noise
2 datafusion:vortex-compact +0.8% -0.6% +1.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.3% -0.6% -1.8% +13.6% ➖ noise
2 duckdb:vortex-compact -0.6% -0.6% -0.0% +13.1% ➖ noise
2 duckdb:vortex-file-compressed -1.0% -0.6% -0.5% +13.5% ➖ noise
3 datafusion:vortex-compact -0.5% +1.4% -1.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -3.0% +1.4% -4.3% +14.4% ➖ noise
3 duckdb:vortex-compact +3.5% +1.4% +2.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +33.8% +1.4% +32.0% +30.3% 🚨 regression
4 datafusion:vortex-compact +0.6% +1.2% -0.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.7% +1.2% -4.9% +10.0% ➖ noise
4 duckdb:vortex-compact +0.4% +1.2% -0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.5% +1.2% +1.3% +10.0% ➖ noise
5 datafusion:vortex-compact +1.2% +0.1% +1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.8% +0.1% +0.7% +10.0% ➖ noise
5 duckdb:vortex-compact +4.6% +0.1% +4.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.6% +0.1% -1.7% +10.0% ➖ noise
6 datafusion:vortex-compact -0.8% -2.3% +1.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.8% -2.3% +3.1% +21.0% ➖ noise
6 duckdb:vortex-compact +0.6% -2.3% +2.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +7.1% -2.3% +9.6% +12.9% ➖ noise
7 datafusion:vortex-compact -0.1% -0.2% +0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.2% -0.2% +1.3% +14.8% ➖ noise
7 duckdb:vortex-compact -1.4% -0.2% -1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -8.4% -0.2% -8.2% +10.0% ➖ noise
8 datafusion:vortex-compact -5.6% +1.0% -6.5% +15.3% ➖ noise
8 datafusion:vortex-file-compressed +13.7% +1.0% +12.6% +34.1% ➖ noise
8 duckdb:vortex-compact -7.2% +1.0% -8.1% +19.7% ➖ noise
8 duckdb:vortex-file-compressed +2.9% +1.0% +1.9% +17.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +1.0%


datafusion / vortex-file-compressed (1.022x ➖, 1↑ 2↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27236959 27265768 1.00
tpcds_q02/datafusion:vortex-file-compressed 54708584 52046053 1.05
tpcds_q03/datafusion:vortex-file-compressed 19926498 19857098 1.00
tpcds_q04/datafusion:vortex-file-compressed 307162361 288355666 1.07
tpcds_q05/datafusion:vortex-file-compressed 53260639 55623425 0.96
tpcds_q06/datafusion:vortex-file-compressed 50542928 51949396 0.97
tpcds_q07/datafusion:vortex-file-compressed 50971570 53628972 0.95
tpcds_q08/datafusion:vortex-file-compressed 38387819 36850240 1.04
tpcds_q09/datafusion:vortex-file-compressed 48675663 49285747 0.99
tpcds_q10/datafusion:vortex-file-compressed 44681822 43657588 1.02
tpcds_q11/datafusion:vortex-file-compressed 166884883 163352874 1.02
tpcds_q12/datafusion:vortex-file-compressed 24301226 22802315 1.07
tpcds_q13/datafusion:vortex-file-compressed 54444111 53079000 1.03
tpcds_q14/datafusion:vortex-file-compressed 207842367 202326043 1.03
tpcds_q15/datafusion:vortex-file-compressed 35474593 34278135 1.03
tpcds_q16/datafusion:vortex-file-compressed 27940740 27852034 1.00
tpcds_q17/datafusion:vortex-file-compressed 66746307 66863372 1.00
tpcds_q18/datafusion:vortex-file-compressed 78008168 76195624 1.02
tpcds_q19/datafusion:vortex-file-compressed 29946393 29883872 1.00
tpcds_q20/datafusion:vortex-file-compressed 26223542 25578248 1.03
tpcds_q21/datafusion:vortex-file-compressed 142821081 135447813 1.05
tpcds_q22/datafusion:vortex-file-compressed 58553015 58207048 1.01
tpcds_q23/datafusion:vortex-file-compressed 148112116 145812135 1.02
tpcds_q24/datafusion:vortex-file-compressed 110422720 111042267 0.99
tpcds_q25/datafusion:vortex-file-compressed 69844670 66962812 1.04
tpcds_q26/datafusion:vortex-file-compressed 37260233 36593944 1.02
tpcds_q27/datafusion:vortex-file-compressed 119224227 118912787 1.00
tpcds_q28/datafusion:vortex-file-compressed 46076778 42578162 1.08
tpcds_q29/datafusion:vortex-file-compressed 66088659 64668571 1.02
tpcds_q30/datafusion:vortex-file-compressed 31222292 30597180 1.02
tpcds_q31/datafusion:vortex-file-compressed 95586052 91778124 1.04
tpcds_q32/datafusion:vortex-file-compressed 21800910 21329978 1.02
tpcds_q33/datafusion:vortex-file-compressed 38792035 39259705 0.99
tpcds_q34/datafusion:vortex-file-compressed 31716489 32409004 0.98
tpcds_q35/datafusion:vortex-file-compressed 54715474 54757177 1.00
tpcds_q36/datafusion:vortex-file-compressed 75824190 73984657 1.02
tpcds_q37/datafusion:vortex-file-compressed 33890577 32820118 1.03
tpcds_q38/datafusion:vortex-file-compressed 52662008 52095132 1.01
tpcds_q39/datafusion:vortex-file-compressed 🚀 137421674 154403021 0.89
tpcds_q40/datafusion:vortex-file-compressed 53209185 52580221 1.01
tpcds_q41/datafusion:vortex-file-compressed 18891927 18558627 1.02
tpcds_q42/datafusion:vortex-file-compressed 19017546 18312768 1.04
tpcds_q43/datafusion:vortex-file-compressed 33107630 31816068 1.04
tpcds_q44/datafusion:vortex-file-compressed 43039205 42614295 1.01
tpcds_q45/datafusion:vortex-file-compressed 34013422 34060660 1.00
tpcds_q46/datafusion:vortex-file-compressed 47014336 46437402 1.01
tpcds_q47/datafusion:vortex-file-compressed 207262951 206667465 1.00
tpcds_q48/datafusion:vortex-file-compressed 43517265 40629951 1.07
tpcds_q49/datafusion:vortex-file-compressed 71383711 66556970 1.07
tpcds_q50/datafusion:vortex-file-compressed 47923002 43914048 1.09
tpcds_q51/datafusion:vortex-file-compressed 89219891 89710052 0.99
tpcds_q52/datafusion:vortex-file-compressed 19099240 18277154 1.04
tpcds_q53/datafusion:vortex-file-compressed 🚨 28686079 25134542 1.14
tpcds_q54/datafusion:vortex-file-compressed 45088688 43642053 1.03
tpcds_q55/datafusion:vortex-file-compressed 18427176 17815029 1.03
tpcds_q56/datafusion:vortex-file-compressed 🚨 44175809 38965673 1.13
tpcds_q57/datafusion:vortex-file-compressed 136479839 126984821 1.07
tpcds_q58/datafusion:vortex-file-compressed 70122397 70451871 1.00
tpcds_q59/datafusion:vortex-file-compressed 72109622 71135376 1.01
tpcds_q60/datafusion:vortex-file-compressed 43082392 41218186 1.05
tpcds_q61/datafusion:vortex-file-compressed 50910695 50580175 1.01
tpcds_q62/datafusion:vortex-file-compressed 30999188 31373531 0.99
tpcds_q63/datafusion:vortex-file-compressed 25920842 25455101 1.02
tpcds_q64/datafusion:vortex-file-compressed 475093883 467981931 1.02
tpcds_q65/datafusion:vortex-file-compressed 51425399 48303884 1.06
tpcds_q66/datafusion:vortex-file-compressed 90491466 91214887 0.99
tpcds_q67/datafusion:vortex-file-compressed 123920643 121762134 1.02
tpcds_q68/datafusion:vortex-file-compressed 47695333 45305047 1.05
tpcds_q69/datafusion:vortex-file-compressed 43721629 40846789 1.07
tpcds_q70/datafusion:vortex-file-compressed 110543164 109244869 1.01
tpcds_q71/datafusion:vortex-file-compressed 30072680 30674061 0.98
tpcds_q72/datafusion:vortex-file-compressed 2662047671 2588703100 1.03
tpcds_q73/datafusion:vortex-file-compressed 35226714 34188516 1.03
tpcds_q74/datafusion:vortex-file-compressed 117981127 114932058 1.03
tpcds_q75/datafusion:vortex-file-compressed 118497416 118541125 1.00
tpcds_q76/datafusion:vortex-file-compressed 33787029 33959117 0.99
tpcds_q77/datafusion:vortex-file-compressed 51567241 50174099 1.03
tpcds_q78/datafusion:vortex-file-compressed 122707270 120774237 1.02
tpcds_q79/datafusion:vortex-file-compressed 37446820 36988088 1.01
tpcds_q80/datafusion:vortex-file-compressed 112979063 111444140 1.01
tpcds_q81/datafusion:vortex-file-compressed 38441616 36435619 1.06
tpcds_q82/datafusion:vortex-file-compressed 36386023 36279056 1.00
tpcds_q83/datafusion:vortex-file-compressed 52651902 49905379 1.06
tpcds_q84/datafusion:vortex-file-compressed 16204950 15454832 1.05
tpcds_q85/datafusion:vortex-file-compressed 104353872 100233820 1.04
tpcds_q86/datafusion:vortex-file-compressed 19177659 18080573 1.06
tpcds_q87/datafusion:vortex-file-compressed 54540691 52266296 1.04
tpcds_q88/datafusion:vortex-file-compressed 73102747 73009227 1.00
tpcds_q89/datafusion:vortex-file-compressed 35789155 34959043 1.02
tpcds_q90/datafusion:vortex-file-compressed 17642800 18561510 0.95
tpcds_q91/datafusion:vortex-file-compressed 25572132 24849967 1.03
tpcds_q92/datafusion:vortex-file-compressed 19536567 18010104 1.08
tpcds_q93/datafusion:vortex-file-compressed 32841874 33166878 0.99
tpcds_q94/datafusion:vortex-file-compressed 24802220 25130694 0.99
tpcds_q95/datafusion:vortex-file-compressed 60682812 59701583 1.02
tpcds_q96/datafusion:vortex-file-compressed 16186248 14976199 1.08
tpcds_q97/datafusion:vortex-file-compressed 30881794 30104806 1.03
tpcds_q98/datafusion:vortex-file-compressed 32400476 31256395 1.04
tpcds_q99/datafusion:vortex-file-compressed 45939580 46906899 0.98
datafusion / vortex-compact (1.012x ➖, 0↑ 3↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35302524 35640149 0.99
tpcds_q02/datafusion:vortex-compact 60716252 61388755 0.99
tpcds_q03/datafusion:vortex-compact 26817921 25794512 1.04
tpcds_q04/datafusion:vortex-compact 336518343 331582958 1.01
tpcds_q05/datafusion:vortex-compact 64122049 62967669 1.02
tpcds_q06/datafusion:vortex-compact 60379542 57793020 1.04
tpcds_q07/datafusion:vortex-compact 65601826 66550791 0.99
tpcds_q08/datafusion:vortex-compact 45333523 43971538 1.03
tpcds_q09/datafusion:vortex-compact 72413225 69280782 1.05
tpcds_q10/datafusion:vortex-compact 67133479 63409208 1.06
tpcds_q11/datafusion:vortex-compact 193986977 188162626 1.03
tpcds_q12/datafusion:vortex-compact 27309664 27595108 0.99
tpcds_q13/datafusion:vortex-compact 123582783 115830049 1.07
tpcds_q14/datafusion:vortex-compact 257489125 251288394 1.02
tpcds_q15/datafusion:vortex-compact 39243875 39046111 1.01
tpcds_q16/datafusion:vortex-compact 37362766 38618731 0.97
tpcds_q17/datafusion:vortex-compact 96428791 91176773 1.06
tpcds_q18/datafusion:vortex-compact 88711405 90009967 0.99
tpcds_q19/datafusion:vortex-compact 44722094 44453433 1.01
tpcds_q20/datafusion:vortex-compact 30388570 28645123 1.06
tpcds_q21/datafusion:vortex-compact 145018594 141778721 1.02
tpcds_q22/datafusion:vortex-compact 63908574 65615471 0.97
tpcds_q23/datafusion:vortex-compact 🚨 197584123 179291564 1.10
tpcds_q24/datafusion:vortex-compact 🚨 156806031 140849392 1.11
tpcds_q25/datafusion:vortex-compact 101279937 97059195 1.04
tpcds_q26/datafusion:vortex-compact 45921659 45534709 1.01
tpcds_q27/datafusion:vortex-compact 158515460 159973656 0.99
tpcds_q28/datafusion:vortex-compact 86446234 85385712 1.01
tpcds_q29/datafusion:vortex-compact 93498877 95922690 0.97
tpcds_q30/datafusion:vortex-compact 38038289 34632956 1.10
tpcds_q31/datafusion:vortex-compact 131934386 131975301 1.00
tpcds_q32/datafusion:vortex-compact 26854499 27302014 0.98
tpcds_q33/datafusion:vortex-compact 54666670 56608722 0.97
tpcds_q34/datafusion:vortex-compact 50662790 53171790 0.95
tpcds_q35/datafusion:vortex-compact 70494068 70157575 1.00
tpcds_q36/datafusion:vortex-compact 100250769 101062321 0.99
tpcds_q37/datafusion:vortex-compact 46981550 47277381 0.99
tpcds_q38/datafusion:vortex-compact 70750588 67855261 1.04
tpcds_q39/datafusion:vortex-compact 150049652 151386119 0.99
tpcds_q40/datafusion:vortex-compact 57959881 58012732 1.00
tpcds_q41/datafusion:vortex-compact 20979951 19777193 1.06
tpcds_q42/datafusion:vortex-compact 25087689 24904767 1.01
tpcds_q43/datafusion:vortex-compact 39126087 38199365 1.02
tpcds_q44/datafusion:vortex-compact 72629130 72320321 1.00
tpcds_q45/datafusion:vortex-compact 39689633 39160003 1.01
tpcds_q46/datafusion:vortex-compact 74980323 72561014 1.03
tpcds_q47/datafusion:vortex-compact 231439885 230915644 1.00
tpcds_q48/datafusion:vortex-compact 🚨 85905341 78043367 1.10
tpcds_q49/datafusion:vortex-compact 89058893 91157123 0.98
tpcds_q50/datafusion:vortex-compact 65228054 63683642 1.02
tpcds_q51/datafusion:vortex-compact 97595562 97310789 1.00
tpcds_q52/datafusion:vortex-compact 25508414 25459370 1.00
tpcds_q53/datafusion:vortex-compact 36939299 35061092 1.05
tpcds_q54/datafusion:vortex-compact 59895514 60359557 0.99
tpcds_q55/datafusion:vortex-compact 24834516 24463233 1.02
tpcds_q56/datafusion:vortex-compact 57284746 56220241 1.02
tpcds_q57/datafusion:vortex-compact 137728032 144905359 0.95
tpcds_q58/datafusion:vortex-compact 78404922 80148140 0.98
tpcds_q59/datafusion:vortex-compact 83700870 84302161 0.99
tpcds_q60/datafusion:vortex-compact 56800152 57432515 0.99
tpcds_q61/datafusion:vortex-compact 76760135 76570771 1.00
tpcds_q62/datafusion:vortex-compact 33812022 33723555 1.00
tpcds_q63/datafusion:vortex-compact 35276775 35135172 1.00
tpcds_q64/datafusion:vortex-compact 545065822 547898638 0.99
tpcds_q65/datafusion:vortex-compact 69450631 70785240 0.98
tpcds_q66/datafusion:vortex-compact 98396882 97742503 1.01
tpcds_q67/datafusion:vortex-compact 127527160 128494795 0.99
tpcds_q68/datafusion:vortex-compact 72309627 74230462 0.97
tpcds_q69/datafusion:vortex-compact 60340120 59950027 1.01
tpcds_q70/datafusion:vortex-compact 123340250 123603814 1.00
tpcds_q71/datafusion:vortex-compact 47741535 46919513 1.02
tpcds_q72/datafusion:vortex-compact 2590540926 2615481740 0.99
tpcds_q73/datafusion:vortex-compact 52482764 53040730 0.99
tpcds_q74/datafusion:vortex-compact 135699839 133178527 1.02
tpcds_q75/datafusion:vortex-compact 161537820 161449134 1.00
tpcds_q76/datafusion:vortex-compact 51125990 50087322 1.02
tpcds_q77/datafusion:vortex-compact 68645199 68240006 1.01
tpcds_q78/datafusion:vortex-compact 147843267 149271495 0.99
tpcds_q79/datafusion:vortex-compact 62877826 61438628 1.02
tpcds_q80/datafusion:vortex-compact 134931780 131261293 1.03
tpcds_q81/datafusion:vortex-compact 43975710 42033040 1.05
tpcds_q82/datafusion:vortex-compact 49524567 47304905 1.05
tpcds_q83/datafusion:vortex-compact 56412922 57465048 0.98
tpcds_q84/datafusion:vortex-compact 19140315 18454221 1.04
tpcds_q85/datafusion:vortex-compact 125471072 124097775 1.01
tpcds_q86/datafusion:vortex-compact 22017730 22827111 0.96
tpcds_q87/datafusion:vortex-compact 71271272 67635270 1.05
tpcds_q88/datafusion:vortex-compact 121820344 123104018 0.99
tpcds_q89/datafusion:vortex-compact 45935562 44161114 1.04
tpcds_q90/datafusion:vortex-compact 24170682 23766575 1.02
tpcds_q91/datafusion:vortex-compact 39923585 38863358 1.03
tpcds_q92/datafusion:vortex-compact 25052494 25543443 0.98
tpcds_q93/datafusion:vortex-compact 47061879 45772211 1.03
tpcds_q94/datafusion:vortex-compact 30365822 31370760 0.97
tpcds_q95/datafusion:vortex-compact 69971755 69380546 1.01
tpcds_q96/datafusion:vortex-compact 25824536 25448032 1.01
tpcds_q97/datafusion:vortex-compact 44288439 42487235 1.04
tpcds_q98/datafusion:vortex-compact 39007457 38606096 1.01
tpcds_q99/datafusion:vortex-compact 50589802 49814451 1.02
datafusion / parquet (1.014x ➖, 0↑ 3↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37991422 36177212 1.05
tpcds_q02/datafusion:parquet 47444469 44967622 1.06
tpcds_q03/datafusion:parquet 15078437 15225685 0.99
tpcds_q04/datafusion:parquet 310501441 326424861 0.95
tpcds_q05/datafusion:parquet 🚨 55492225 48925593 1.13
tpcds_q06/datafusion:parquet 65478086 66365957 0.99
tpcds_q07/datafusion:parquet 86856917 88703183 0.98
tpcds_q08/datafusion:parquet 🚨 36058016 32216092 1.12
tpcds_q09/datafusion:parquet 57918725 55362424 1.05
tpcds_q10/datafusion:parquet 84721982 79645452 1.06
tpcds_q11/datafusion:parquet 176866152 178897497 0.99
tpcds_q12/datafusion:parquet 22478308 24183883 0.93
tpcds_q13/datafusion:parquet 87049048 85772365 1.01
tpcds_q14/datafusion:parquet 190218990 199243152 0.95
tpcds_q15/datafusion:parquet 25256970 24720443 1.02
tpcds_q16/datafusion:parquet 27157325 27444223 0.99
tpcds_q17/datafusion:parquet 68389216 68587837 1.00
tpcds_q18/datafusion:parquet 130651493 130243277 1.00
tpcds_q19/datafusion:parquet 27783258 27351012 1.02
tpcds_q20/datafusion:parquet 21583322 20426783 1.06
tpcds_q21/datafusion:parquet 22825832 21440704 1.06
tpcds_q22/datafusion:parquet 142657995 146741737 0.97
tpcds_q23/datafusion:parquet 167401887 163116876 1.03
tpcds_q24/datafusion:parquet 104214331 104459459 1.00
tpcds_q25/datafusion:parquet 72678568 71587250 1.02
tpcds_q26/datafusion:parquet 75855518 78398400 0.97
tpcds_q27/datafusion:parquet 163796763 159451621 1.03
tpcds_q28/datafusion:parquet 49519486 49154711 1.01
tpcds_q29/datafusion:parquet 72553999 74529488 0.97
tpcds_q30/datafusion:parquet 44299032 42946985 1.03
tpcds_q31/datafusion:parquet 75478730 73976649 1.02
tpcds_q32/datafusion:parquet 22976878 21834936 1.05
tpcds_q33/datafusion:parquet 34904544 35436388 0.98
tpcds_q34/datafusion:parquet 28043481 26508286 1.06
tpcds_q35/datafusion:parquet 83124402 84148095 0.99
tpcds_q36/datafusion:parquet 63827969 65003952 0.98
tpcds_q37/datafusion:parquet 24152015 23056513 1.05
tpcds_q38/datafusion:parquet 49304657 50469465 0.98
tpcds_q39/datafusion:parquet 83643052 83901820 1.00
tpcds_q40/datafusion:parquet 28163591 27402998 1.03
tpcds_q41/datafusion:parquet 15831032 15523902 1.02
tpcds_q42/datafusion:parquet 13507000 13938559 0.97
tpcds_q43/datafusion:parquet 19055527 19798589 0.96
tpcds_q44/datafusion:parquet 42778845 41187142 1.04
tpcds_q45/datafusion:parquet 32088346 33499883 0.96
tpcds_q46/datafusion:parquet 38247188 39170665 0.98
tpcds_q47/datafusion:parquet 136902186 135524697 1.01
tpcds_q48/datafusion:parquet 79884954 81081122 0.99
tpcds_q49/datafusion:parquet 67555162 65125825 1.04
tpcds_q50/datafusion:parquet 50476333 49236842 1.03
tpcds_q51/datafusion:parquet 91837005 88195058 1.04
tpcds_q52/datafusion:parquet 14827864 13980834 1.06
tpcds_q53/datafusion:parquet 22875560 22224974 1.03
tpcds_q54/datafusion:parquet 45578273 41745319 1.09
tpcds_q55/datafusion:parquet 14030058 13957769 1.01
tpcds_q56/datafusion:parquet 37534406 35625469 1.05
tpcds_q57/datafusion:parquet 116261700 109198954 1.06
tpcds_q58/datafusion:parquet 57768379 57104552 1.01
tpcds_q59/datafusion:parquet 60337942 58392628 1.03
tpcds_q60/datafusion:parquet 34922363 34954246 1.00
tpcds_q61/datafusion:parquet 51257382 51112266 1.00
tpcds_q62/datafusion:parquet 🚨 28241782 24879367 1.14
tpcds_q63/datafusion:parquet 22404429 20657752 1.08
tpcds_q64/datafusion:parquet 557157882 537018587 1.04
tpcds_q65/datafusion:parquet 44476238 44982815 0.99
tpcds_q66/datafusion:parquet 73751677 73140090 1.01
tpcds_q67/datafusion:parquet 153106786 150476380 1.02
tpcds_q68/datafusion:parquet 38673306 38866514 1.00
tpcds_q69/datafusion:parquet 78173173 76080568 1.03
tpcds_q70/datafusion:parquet 94510434 95300741 0.99
tpcds_q71/datafusion:parquet 26559008 26889109 0.99
tpcds_q72/datafusion:parquet 647070547 631594195 1.02
tpcds_q73/datafusion:parquet 26877693 27053993 0.99
tpcds_q74/datafusion:parquet 102650679 104169210 0.99
tpcds_q75/datafusion:parquet 116551858 117526859 0.99
tpcds_q76/datafusion:parquet 37645143 34365852 1.10
tpcds_q77/datafusion:parquet 49693293 49667481 1.00
tpcds_q78/datafusion:parquet 125317655 122624511 1.02
tpcds_q79/datafusion:parquet 32941942 32514423 1.01
tpcds_q80/datafusion:parquet 93016024 93101456 1.00
tpcds_q81/datafusion:parquet 42056944 41881057 1.00
tpcds_q82/datafusion:parquet 22977457 23900230 0.96
tpcds_q83/datafusion:parquet 47525533 47558438 1.00
tpcds_q84/datafusion:parquet 50716538 47524280 1.07
tpcds_q85/datafusion:parquet 170855707 170407862 1.00
tpcds_q86/datafusion:parquet 17464849 17168137 1.02
tpcds_q87/datafusion:parquet 49267626 49877853 0.99
tpcds_q88/datafusion:parquet 69062329 69258544 1.00
tpcds_q89/datafusion:parquet 25226141 24614953 1.02
tpcds_q90/datafusion:parquet 18964790 18538950 1.02
tpcds_q91/datafusion:parquet 69637162 68755670 1.01
tpcds_q92/datafusion:parquet 21976120 21509746 1.02
tpcds_q93/datafusion:parquet 35589524 34557015 1.03
tpcds_q94/datafusion:parquet 25480090 25756088 0.99
tpcds_q95/datafusion:parquet 66029201 67514434 0.98
tpcds_q96/datafusion:parquet 14118978 15000972 0.94
tpcds_q97/datafusion:parquet 33213692 33568218 0.99
tpcds_q98/datafusion:parquet 26683500 26783265 1.00
tpcds_q99/datafusion:parquet 31283827 29446006 1.06
duckdb / vortex-file-compressed (1.001x ➖, 1↑ 2↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25715692 25256196 1.02
tpcds_q02/duckdb:vortex-file-compressed 79903867 78863292 1.01
tpcds_q03/duckdb:vortex-file-compressed 24069463 24868353 0.97
tpcds_q04/duckdb:vortex-file-compressed 99066777 100222861 0.99
tpcds_q05/duckdb:vortex-file-compressed 93425512 98008517 0.95
tpcds_q06/duckdb:vortex-file-compressed 34422335 34882632 0.99
tpcds_q07/duckdb:vortex-file-compressed 22655482 22413448 1.01
tpcds_q08/duckdb:vortex-file-compressed 27293030 27324160 1.00
tpcds_q09/duckdb:vortex-file-compressed 34599336 33660109 1.03
tpcds_q10/duckdb:vortex-file-compressed 42453480 43389351 0.98
tpcds_q11/duckdb:vortex-file-compressed 61229763 60927284 1.00
tpcds_q12/duckdb:vortex-file-compressed 14849708 14209890 1.05
tpcds_q13/duckdb:vortex-file-compressed 42721547 41137567 1.04
tpcds_q14/duckdb:vortex-file-compressed 182312796 189214057 0.96
tpcds_q15/duckdb:vortex-file-compressed 40600263 40296572 1.01
tpcds_q16/duckdb:vortex-file-compressed 29194749 29132320 1.00
tpcds_q17/duckdb:vortex-file-compressed 37813371 39296315 0.96
tpcds_q18/duckdb:vortex-file-compressed 44701910 45974940 0.97
tpcds_q19/duckdb:vortex-file-compressed 32132937 32768499 0.98
tpcds_q20/duckdb:vortex-file-compressed 15914491 17186798 0.93
tpcds_q21/duckdb:vortex-file-compressed 20195227 20981382 0.96
tpcds_q22/duckdb:vortex-file-compressed 100935319 106637342 0.95
tpcds_q23/duckdb:vortex-file-compressed 147573100 150535514 0.98
tpcds_q24/duckdb:vortex-file-compressed 55851009 55013001 1.02
tpcds_q25/duckdb:vortex-file-compressed 36227510 35542809 1.02
tpcds_q26/duckdb:vortex-file-compressed 39779734 39252462 1.01
tpcds_q27/duckdb:vortex-file-compressed 86160750 87308624 0.99
tpcds_q28/duckdb:vortex-file-compressed 34891516 33985420 1.03
tpcds_q29/duckdb:vortex-file-compressed 37037506 37509896 0.99
tpcds_q30/duckdb:vortex-file-compressed 29289731 29482617 0.99
tpcds_q31/duckdb:vortex-file-compressed 28360298 29143233 0.97
tpcds_q32/duckdb:vortex-file-compressed 17316186 17189287 1.01
tpcds_q33/duckdb:vortex-file-compressed 🚨 68979583 62194537 1.11
tpcds_q34/duckdb:vortex-file-compressed 19234226 19600060 0.98
tpcds_q35/duckdb:vortex-file-compressed 72290121 72876188 0.99
tpcds_q36/duckdb:vortex-file-compressed 27452222 27056619 1.01
tpcds_q37/duckdb:vortex-file-compressed 22405887 21508445 1.04
tpcds_q38/duckdb:vortex-file-compressed 39358953 39975820 0.98
tpcds_q39/duckdb:vortex-file-compressed 44156881 44729487 0.99
tpcds_q40/duckdb:vortex-file-compressed 22599861 23940432 0.94
tpcds_q41/duckdb:vortex-file-compressed 14225383 13008718 1.09
tpcds_q42/duckdb:vortex-file-compressed 11956560 12239509 0.98
tpcds_q43/duckdb:vortex-file-compressed 31374130 31120850 1.01
tpcds_q44/duckdb:vortex-file-compressed 24584167 25212655 0.98
tpcds_q45/duckdb:vortex-file-compressed 26664070 28490988 0.94
tpcds_q46/duckdb:vortex-file-compressed 45918844 46367753 0.99
tpcds_q47/duckdb:vortex-file-compressed 50550233 50720113 1.00
tpcds_q48/duckdb:vortex-file-compressed 37814557 38524941 0.98
tpcds_q49/duckdb:vortex-file-compressed 29295608 30758552 0.95
tpcds_q50/duckdb:vortex-file-compressed 33628519 33259814 1.01
tpcds_q51/duckdb:vortex-file-compressed 98756537 100716563 0.98
tpcds_q52/duckdb:vortex-file-compressed 12175844 11835669 1.03
tpcds_q53/duckdb:vortex-file-compressed 16735349 16688635 1.00
tpcds_q54/duckdb:vortex-file-compressed 48047835 45803298 1.05
tpcds_q55/duckdb:vortex-file-compressed 12379230 11325739 1.09
tpcds_q56/duckdb:vortex-file-compressed 61100207 61564198 0.99
tpcds_q57/duckdb:vortex-file-compressed 47280473 46287336 1.02
tpcds_q58/duckdb:vortex-file-compressed 34982711 34018030 1.03
tpcds_q59/duckdb:vortex-file-compressed 82006387 80706111 1.02
tpcds_q60/duckdb:vortex-file-compressed 64037654 65031823 0.98
tpcds_q61/duckdb:vortex-file-compressed 36686925 38426054 0.95
tpcds_q62/duckdb:vortex-file-compressed 🚀 18875326 21582307 0.87
tpcds_q63/duckdb:vortex-file-compressed 17739572 17925785 0.99
tpcds_q64/duckdb:vortex-file-compressed 80752185 77525245 1.04
tpcds_q65/duckdb:vortex-file-compressed 23730655 24281718 0.98
tpcds_q66/duckdb:vortex-file-compressed 57199064 52495894 1.09
tpcds_q67/duckdb:vortex-file-compressed 145510472 144619876 1.01
tpcds_q68/duckdb:vortex-file-compressed 40418032 39236721 1.03
tpcds_q69/duckdb:vortex-file-compressed 42930896 43727943 0.98
tpcds_q70/duckdb:vortex-file-compressed 28600967 28127038 1.02
tpcds_q71/duckdb:vortex-file-compressed 21147468 21303054 0.99
tpcds_q72/duckdb:vortex-file-compressed 172499450 174743138 0.99
tpcds_q73/duckdb:vortex-file-compressed 19708727 20027499 0.98
tpcds_q74/duckdb:vortex-file-compressed 46999390 47099899 1.00
tpcds_q75/duckdb:vortex-file-compressed 57194063 56777927 1.01
tpcds_q76/duckdb:vortex-file-compressed 57892929 61684008 0.94
tpcds_q77/duckdb:vortex-file-compressed 57911454 63426913 0.91
tpcds_q78/duckdb:vortex-file-compressed 80855575 80219163 1.01
tpcds_q79/duckdb:vortex-file-compressed 36245084 34500749 1.05
tpcds_q80/duckdb:vortex-file-compressed 89205626 87736814 1.02
tpcds_q81/duckdb:vortex-file-compressed 33249619 32316292 1.03
tpcds_q82/duckdb:vortex-file-compressed 20950416 21875808 0.96
tpcds_q83/duckdb:vortex-file-compressed 28636981 27606450 1.04
tpcds_q84/duckdb:vortex-file-compressed 18450764 17385144 1.06
tpcds_q85/duckdb:vortex-file-compressed 47109566 46218278 1.02
tpcds_q86/duckdb:vortex-file-compressed 17677507 17881331 0.99
tpcds_q87/duckdb:vortex-file-compressed 42712001 45919955 0.93
tpcds_q88/duckdb:vortex-file-compressed 41959900 39918272 1.05
tpcds_q89/duckdb:vortex-file-compressed 18476154 18296727 1.01
tpcds_q90/duckdb:vortex-file-compressed 14684322 13774284 1.07
tpcds_q91/duckdb:vortex-file-compressed 29342759 28716112 1.02
tpcds_q92/duckdb:vortex-file-compressed 14252152 14689492 0.97
tpcds_q93/duckdb:vortex-file-compressed 🚨 29745482 25562469 1.16
tpcds_q94/duckdb:vortex-file-compressed 21763738 22161606 0.98
tpcds_q95/duckdb:vortex-file-compressed 152536430 151118914 1.01
tpcds_q96/duckdb:vortex-file-compressed 17825887 17661214 1.01
tpcds_q97/duckdb:vortex-file-compressed 39296353 38400938 1.02
tpcds_q98/duckdb:vortex-file-compressed 18675407 18023402 1.04
tpcds_q99/duckdb:vortex-file-compressed 31397148 31661063 0.99
duckdb / vortex-compact (1.005x ➖, 2↑ 3↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 34989140 31694111 1.10
tpcds_q02/duckdb:vortex-compact 118438072 119373222 0.99
tpcds_q03/duckdb:vortex-compact 50677699 49421997 1.03
tpcds_q04/duckdb:vortex-compact 116608361 122655609 0.95
tpcds_q05/duckdb:vortex-compact 162310659 159604124 1.02
tpcds_q06/duckdb:vortex-compact 41464651 40286940 1.03
tpcds_q07/duckdb:vortex-compact 38313170 36971962 1.04
tpcds_q08/duckdb:vortex-compact 34803628 35858752 0.97
tpcds_q09/duckdb:vortex-compact 57471340 58649046 0.98
tpcds_q10/duckdb:vortex-compact 56018733 53705031 1.04
tpcds_q11/duckdb:vortex-compact 74628045 74359352 1.00
tpcds_q12/duckdb:vortex-compact 🚀 18742198 21297668 0.88
tpcds_q13/duckdb:vortex-compact 66774739 67844722 0.98
tpcds_q14/duckdb:vortex-compact 273175181 283709892 0.96
tpcds_q15/duckdb:vortex-compact 44366892 44302073 1.00
tpcds_q16/duckdb:vortex-compact 33491756 33723005 0.99
tpcds_q17/duckdb:vortex-compact 50784064 50375561 1.01
tpcds_q18/duckdb:vortex-compact 56868643 57750684 0.98
tpcds_q19/duckdb:vortex-compact 42017500 41167797 1.02
tpcds_q20/duckdb:vortex-compact 21159363 21711088 0.97
tpcds_q21/duckdb:vortex-compact 28994955 27676775 1.05
tpcds_q22/duckdb:vortex-compact 113399605 110537182 1.03
tpcds_q23/duckdb:vortex-compact 169388630 163624069 1.04
tpcds_q24/duckdb:vortex-compact 77453171 76285886 1.02
tpcds_q25/duckdb:vortex-compact 50731483 51743304 0.98
tpcds_q26/duckdb:vortex-compact 49213523 51323308 0.96
tpcds_q27/duckdb:vortex-compact 142445189 140057352 1.02
tpcds_q28/duckdb:vortex-compact 83006899 84451503 0.98
tpcds_q29/duckdb:vortex-compact 51151450 49960302 1.02
tpcds_q30/duckdb:vortex-compact 35602243 34628788 1.03
tpcds_q31/duckdb:vortex-compact 39852855 36791208 1.08
tpcds_q32/duckdb:vortex-compact 24363591 22378531 1.09
tpcds_q33/duckdb:vortex-compact 137541682 136070056 1.01
tpcds_q34/duckdb:vortex-compact 30392064 31315606 0.97
tpcds_q35/duckdb:vortex-compact 81855362 78680832 1.04
tpcds_q36/duckdb:vortex-compact 35613895 35748652 1.00
tpcds_q37/duckdb:vortex-compact 30421387 30737899 0.99
tpcds_q38/duckdb:vortex-compact 🚨 49050062 44312592 1.11
tpcds_q39/duckdb:vortex-compact 53780617 52919731 1.02
tpcds_q40/duckdb:vortex-compact 27600541 28190308 0.98
tpcds_q41/duckdb:vortex-compact 17043012 16299544 1.05
tpcds_q42/duckdb:vortex-compact 16487689 17068839 0.97
tpcds_q43/duckdb:vortex-compact 38630228 38665434 1.00
tpcds_q44/duckdb:vortex-compact 35895312 35297132 1.02
tpcds_q45/duckdb:vortex-compact 33063270 31399161 1.05
tpcds_q46/duckdb:vortex-compact 63097639 63069758 1.00
tpcds_q47/duckdb:vortex-compact 56631793 55868200 1.01
tpcds_q48/duckdb:vortex-compact 56336043 55944738 1.01
tpcds_q49/duckdb:vortex-compact 44961465 43024813 1.05
tpcds_q50/duckdb:vortex-compact 55544089 56698413 0.98
tpcds_q51/duckdb:vortex-compact 108142020 107648177 1.00
tpcds_q52/duckdb:vortex-compact 16686057 17693764 0.94
tpcds_q53/duckdb:vortex-compact 24696121 26084418 0.95
tpcds_q54/duckdb:vortex-compact 78303491 78503776 1.00
tpcds_q55/duckdb:vortex-compact 16811201 17110540 0.98
tpcds_q56/duckdb:vortex-compact 138623180 136790932 1.01
tpcds_q57/duckdb:vortex-compact 48148034 48054592 1.00
tpcds_q58/duckdb:vortex-compact 43231227 43308180 1.00
tpcds_q59/duckdb:vortex-compact 102149619 99736792 1.02
tpcds_q60/duckdb:vortex-compact 138282636 143414363 0.96
tpcds_q61/duckdb:vortex-compact 54563560 54783138 1.00
tpcds_q62/duckdb:vortex-compact 🚀 20235716 27216431 0.74
tpcds_q63/duckdb:vortex-compact 24207682 24916941 0.97
tpcds_q64/duckdb:vortex-compact 106842134 105537698 1.01
tpcds_q65/duckdb:vortex-compact 31222708 30371180 1.03
tpcds_q66/duckdb:vortex-compact 92899650 92252448 1.01
tpcds_q67/duckdb:vortex-compact 152964889 152423689 1.00
tpcds_q68/duckdb:vortex-compact 58503913 56334852 1.04
tpcds_q69/duckdb:vortex-compact 55231589 53953019 1.02
tpcds_q70/duckdb:vortex-compact 35084257 35681306 0.98
tpcds_q71/duckdb:vortex-compact 28507236 26983462 1.06
tpcds_q72/duckdb:vortex-compact 196541174 196483965 1.00
tpcds_q73/duckdb:vortex-compact 30427284 29648832 1.03
tpcds_q74/duckdb:vortex-compact 56169305 55405141 1.01
tpcds_q75/duckdb:vortex-compact 71597280 71336217 1.00
tpcds_q76/duckdb:vortex-compact 133342209 124507511 1.07
tpcds_q77/duckdb:vortex-compact 135988286 132690780 1.02
tpcds_q78/duckdb:vortex-compact 89862224 84664015 1.06
tpcds_q79/duckdb:vortex-compact 66908325 65477006 1.02
tpcds_q80/duckdb:vortex-compact 166769919 164656696 1.01
tpcds_q81/duckdb:vortex-compact 40706683 39847177 1.02
tpcds_q82/duckdb:vortex-compact 31450654 32014281 0.98
tpcds_q83/duckdb:vortex-compact 45594526 45981008 0.99
tpcds_q84/duckdb:vortex-compact 22283931 22240719 1.00
tpcds_q85/duckdb:vortex-compact 59455830 58980176 1.01
tpcds_q86/duckdb:vortex-compact 20854632 20317865 1.03
tpcds_q87/duckdb:vortex-compact 49414899 46524346 1.06
tpcds_q88/duckdb:vortex-compact 42812213 43842184 0.98
tpcds_q89/duckdb:vortex-compact 25519238 25179547 1.01
tpcds_q90/duckdb:vortex-compact 15680655 16411981 0.96
tpcds_q91/duckdb:vortex-compact 45423495 46148029 0.98
tpcds_q92/duckdb:vortex-compact 20708662 21746401 0.95
tpcds_q93/duckdb:vortex-compact 35996277 35936371 1.00
tpcds_q94/duckdb:vortex-compact 26489592 25903779 1.02
tpcds_q95/duckdb:vortex-compact 147025463 152150881 0.97
tpcds_q96/duckdb:vortex-compact 🚨 20727573 18162515 1.14
tpcds_q97/duckdb:vortex-compact 44205797 42441182 1.04
tpcds_q98/duckdb:vortex-compact 24516105 24869942 0.99
tpcds_q99/duckdb:vortex-compact 34549441 32787399 1.05
duckdb / parquet (1.009x ➖, 1↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 45838675 43314424 1.06
tpcds_q02/duckdb:parquet 62861679 62608591 1.00
tpcds_q03/duckdb:parquet 11601432 11866352 0.98
tpcds_q04/duckdb:parquet 128181329 125736892 1.02
tpcds_q05/duckdb:parquet 74111470 70646015 1.05
tpcds_q06/duckdb:parquet 29367825 28392237 1.03
tpcds_q07/duckdb:parquet 23345321 23077864 1.01
tpcds_q08/duckdb:parquet 28695232 28180612 1.02
tpcds_q09/duckdb:parquet 39196422 39671265 0.99
tpcds_q10/duckdb:parquet 35555323 34439146 1.03
tpcds_q11/duckdb:parquet 88581371 85501380 1.04
tpcds_q12/duckdb:parquet 14651394 14483319 1.01
tpcds_q13/duckdb:parquet 34181385 33554626 1.02
tpcds_q14/duckdb:parquet 161383705 158679001 1.02
tpcds_q15/duckdb:parquet 30121226 30029943 1.00
tpcds_q16/duckdb:parquet 21252210 21246471 1.00
tpcds_q17/duckdb:parquet 38563794 38147735 1.01
tpcds_q18/duckdb:parquet 46952848 45542476 1.03
tpcds_q19/duckdb:parquet 29901504 29227826 1.02
tpcds_q20/duckdb:parquet 15644826 15754800 0.99
tpcds_q21/duckdb:parquet 🚀 10612406 12061689 0.88
tpcds_q22/duckdb:parquet 67032765 64653697 1.04
tpcds_q23/duckdb:parquet 112505181 114605482 0.98
tpcds_q24/duckdb:parquet 45330000 45555400 1.00
tpcds_q25/duckdb:parquet 33587880 32711962 1.03
tpcds_q26/duckdb:parquet 38170856 35002443 1.09
tpcds_q27/duckdb:parquet 88827443 88003469 1.01
tpcds_q28/duckdb:parquet 37209661 36536869 1.02
tpcds_q29/duckdb:parquet 36042737 34249623 1.05
tpcds_q30/duckdb:parquet 40022352 37307745 1.07
tpcds_q31/duckdb:parquet 22236583 23294221 0.95
tpcds_q32/duckdb:parquet 11537710 11389569 1.01
tpcds_q33/duckdb:parquet 72103133 71287924 1.01
tpcds_q34/duckdb:parquet 21684873 21002299 1.03
tpcds_q35/duckdb:parquet 60961914 60877532 1.00
tpcds_q36/duckdb:parquet 20445192 20814909 0.98
tpcds_q37/duckdb:parquet 13333822 13417116 0.99
tpcds_q38/duckdb:parquet 33205260 33439880 0.99
tpcds_q39/duckdb:parquet 32513400 33196673 0.98
tpcds_q40/duckdb:parquet 18546743 17670876 1.05
tpcds_q41/duckdb:parquet 7696862 7612321 1.01
tpcds_q42/duckdb:parquet 10120275 10285996 0.98
tpcds_q43/duckdb:parquet 15482945 15390882 1.01
tpcds_q44/duckdb:parquet 21645397 21671211 1.00
tpcds_q45/duckdb:parquet 27060844 27651189 0.98
tpcds_q46/duckdb:parquet 45733428 46432983 0.98
tpcds_q47/duckdb:parquet 45165254 45342054 1.00
tpcds_q48/duckdb:parquet 31845456 30158298 1.06
tpcds_q49/duckdb:parquet 24773671 25175542 0.98
tpcds_q50/duckdb:parquet 24219201 24580644 0.99
tpcds_q51/duckdb:parquet 94561066 94453488 1.00
tpcds_q52/duckdb:parquet 10841311 10486273 1.03
tpcds_q53/duckdb:parquet 16224211 16008867 1.01
tpcds_q54/duckdb:parquet 40842788 42840420 0.95
tpcds_q55/duckdb:parquet 10817162 10660447 1.01
tpcds_q56/duckdb:parquet 71843104 67806309 1.06
tpcds_q57/duckdb:parquet 🚨 38207977 34650291 1.10
tpcds_q58/duckdb:parquet 22601399 20970557 1.08
tpcds_q59/duckdb:parquet 36705137 36040150 1.02
tpcds_q60/duckdb:parquet 73585873 70594178 1.04
tpcds_q61/duckdb:parquet 31366259 31125240 1.01
tpcds_q62/duckdb:parquet 11631919 12029611 0.97
tpcds_q63/duckdb:parquet 15067371 14848255 1.01
tpcds_q64/duckdb:parquet 72934597 72899336 1.00
tpcds_q65/duckdb:parquet 20890491 21527869 0.97
tpcds_q66/duckdb:parquet 54621687 56718969 0.96
tpcds_q67/duckdb:parquet 133999170 136223592 0.98
tpcds_q68/duckdb:parquet 37675598 37190721 1.01
tpcds_q69/duckdb:parquet 36766626 36314507 1.01
tpcds_q70/duckdb:parquet 19612099 19979914 0.98
tpcds_q71/duckdb:parquet 18810636 18197415 1.03
tpcds_q72/duckdb:parquet 163440450 164374008 0.99
tpcds_q73/duckdb:parquet 18232910 17770911 1.03
tpcds_q74/duckdb:parquet 50734466 48921157 1.04
tpcds_q75/duckdb:parquet 52584234 53094091 0.99
tpcds_q76/duckdb:parquet 69086120 65787556 1.05
tpcds_q77/duckdb:parquet 61168351 60969458 1.00
tpcds_q78/duckdb:parquet 76757128 74069894 1.04
tpcds_q79/duckdb:parquet 28551054 26625432 1.07
tpcds_q80/duckdb:parquet 83890686 81810151 1.03
tpcds_q81/duckdb:parquet 46880283 47141684 0.99
tpcds_q82/duckdb:parquet 15559071 16068422 0.97
tpcds_q83/duckdb:parquet 16311747 15869093 1.03
tpcds_q84/duckdb:parquet 19394400 19936116 0.97
tpcds_q85/duckdb:parquet 38952337 39271199 0.99
tpcds_q86/duckdb:parquet 13056330 12535370 1.04
tpcds_q87/duckdb:parquet 37895638 35965409 1.05
tpcds_q88/duckdb:parquet 28561681 28687180 1.00
tpcds_q89/duckdb:parquet 17560059 17195333 1.02
tpcds_q90/duckdb:parquet 7121818 7400979 0.96
tpcds_q91/duckdb:parquet 23333830 23342354 1.00
tpcds_q92/duckdb:parquet 11971388 11616505 1.03
tpcds_q93/duckdb:parquet 29678364 30303084 0.98
tpcds_q94/duckdb:parquet 15819131 16197034 0.98
tpcds_q95/duckdb:parquet 119258667 129544748 0.92
tpcds_q96/duckdb:parquet 9138208 9031942 1.01
tpcds_q97/duckdb:parquet 34822566 35535005 0.98
tpcds_q98/duckdb:parquet 18580654 18712978 0.99
tpcds_q99/duckdb:parquet 19772490 19365967 1.02
duckdb / duckdb (1.010x ➖, 0↑ 3↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19993959 19396270 1.03
tpcds_q02/duckdb:duckdb 19720398 18253961 1.08
tpcds_q03/duckdb:duckdb 8148923 8223283 0.99
tpcds_q04/duckdb:duckdb 161592487 163159441 0.99
tpcds_q05/duckdb:duckdb 17924132 18249113 0.98
tpcds_q06/duckdb:duckdb 22657081 22259951 1.02
tpcds_q07/duckdb:duckdb 38632573 36056536 1.07
tpcds_q08/duckdb:duckdb 120383981 119986192 1.00
tpcds_q09/duckdb:duckdb 19902270 19547993 1.02
tpcds_q10/duckdb:duckdb 23311517 23600280 0.99
tpcds_q11/duckdb:duckdb 139714669 136882921 1.02
tpcds_q12/duckdb:duckdb 11837388 11164994 1.06
tpcds_q13/duckdb:duckdb 23213512 23562900 0.99
tpcds_q14/duckdb:duckdb 92937945 92123794 1.01
tpcds_q15/duckdb:duckdb 24039961 24160325 1.00
tpcds_q16/duckdb:duckdb 16962735 18001402 0.94
tpcds_q17/duckdb:duckdb 21755613 22335130 0.97
tpcds_q18/duckdb:duckdb 42172574 43410817 0.97
tpcds_q19/duckdb:duckdb 15952448 16583717 0.96
tpcds_q20/duckdb:duckdb 11993146 11982304 1.00
tpcds_q21/duckdb:duckdb 6325553 6345793 1.00
tpcds_q22/duckdb:duckdb 59805842 61403559 0.97
tpcds_q23/duckdb:duckdb 81497023 76716499 1.06
tpcds_q24/duckdb:duckdb 22955151 24225217 0.95
tpcds_q25/duckdb:duckdb 🚨 17277760 15647909 1.10
tpcds_q26/duckdb:duckdb 26182565 24782969 1.06
tpcds_q27/duckdb:duckdb 35756807 38280957 0.93
tpcds_q28/duckdb:duckdb 21293974 21302313 1.00
tpcds_q29/duckdb:duckdb 19424938 19716937 0.99
tpcds_q30/duckdb:duckdb 28697260 29081114 0.99
tpcds_q31/duckdb:duckdb 19847658 20842463 0.95
tpcds_q32/duckdb:duckdb 7242441 7016025 1.03
tpcds_q33/duckdb:duckdb 13201910 12715960 1.04
tpcds_q34/duckdb:duckdb 14332858 14013517 1.02
tpcds_q35/duckdb:duckdb 32222499 29962985 1.08
tpcds_q36/duckdb:duckdb 70312936 68852326 1.02
tpcds_q37/duckdb:duckdb 7573369 6900502 1.10
tpcds_q38/duckdb:duckdb 30517464 29634893 1.03
tpcds_q39/duckdb:duckdb 25876820 25149456 1.03
tpcds_q40/duckdb:duckdb 13807015 13333488 1.04
tpcds_q41/duckdb:duckdb 7949027 8213690 0.97
tpcds_q42/duckdb:duckdb 6066111 6162221 0.98
tpcds_q43/duckdb:duckdb 11699758 11051779 1.06
tpcds_q44/duckdb:duckdb 12661346 13230611 0.96
tpcds_q45/duckdb:duckdb 17348331 16815838 1.03
tpcds_q46/duckdb:duckdb 36219738 35894610 1.01
tpcds_q47/duckdb:duckdb 40899281 40354053 1.01
tpcds_q48/duckdb:duckdb 21525939 21651447 0.99
tpcds_q49/duckdb:duckdb 17073476 15676218 1.09
tpcds_q50/duckdb:duckdb 13751299 13891303 0.99
tpcds_q51/duckdb:duckdb 91394555 91226135 1.00
tpcds_q52/duckdb:duckdb 7186069 7184019 1.00
tpcds_q53/duckdb:duckdb 11903523 11385789 1.05
tpcds_q54/duckdb:duckdb 16588651 16786455 0.99
tpcds_q55/duckdb:duckdb 6747845 6573435 1.03
tpcds_q56/duckdb:duckdb 13438882 12753542 1.05
tpcds_q57/duckdb:duckdb 32484963 30954911 1.05
tpcds_q58/duckdb:duckdb 13893316 12887000 1.08
tpcds_q59/duckdb:duckdb 34201581 33720642 1.01
tpcds_q60/duckdb:duckdb 14151080 13987578 1.01
tpcds_q61/duckdb:duckdb 14383110 14229202 1.01
tpcds_q62/duckdb:duckdb 8943382 8929779 1.00
tpcds_q63/duckdb:duckdb 10883057 11050239 0.98
tpcds_q64/duckdb:duckdb 52152779 53593212 0.97
tpcds_q65/duckdb:duckdb 33353633 34572662 0.96
tpcds_q66/duckdb:duckdb 23756859 24216392 0.98
tpcds_q67/duckdb:duckdb 129386637 128651415 1.01
tpcds_q68/duckdb:duckdb 24736926 24418316 1.01
tpcds_q69/duckdb:duckdb 23562810 23227332 1.01
tpcds_q70/duckdb:duckdb 13609295 13823340 0.98
tpcds_q71/duckdb:duckdb 12567135 12430385 1.01
tpcds_q72/duckdb:duckdb 42957088 42787674 1.00
tpcds_q73/duckdb:duckdb 10555689 10667051 0.99
tpcds_q74/duckdb:duckdb 99010702 98501659 1.01
tpcds_q75/duckdb:duckdb 42241117 42679416 0.99
tpcds_q76/duckdb:duckdb 12440913 11773098 1.06
tpcds_q77/duckdb:duckdb 11457068 11596383 0.99
tpcds_q78/duckdb:duckdb 62974306 63845293 0.99
tpcds_q79/duckdb:duckdb 17443070 17463494 1.00
tpcds_q80/duckdb:duckdb 28133111 27892193 1.01
tpcds_q81/duckdb:duckdb 36055134 37534213 0.96
tpcds_q82/duckdb:duckdb 🚨 8761112 7779156 1.13
tpcds_q83/duckdb:duckdb 9179795 8813744 1.04
tpcds_q84/duckdb:duckdb 13645849 13181075 1.04
tpcds_q85/duckdb:duckdb 23470880 23368410 1.00
tpcds_q86/duckdb:duckdb 10559034 10673448 0.99
tpcds_q87/duckdb:duckdb 33412957 34033810 0.98
tpcds_q88/duckdb:duckdb 23764900 23759830 1.00
tpcds_q89/duckdb:duckdb 13504127 13332702 1.01
tpcds_q90/duckdb:duckdb 5468783 5422092 1.01
tpcds_q91/duckdb:duckdb 12921898 12809290 1.01
tpcds_q92/duckdb:duckdb 8505581 8926328 0.95
tpcds_q93/duckdb:duckdb 🚨 21632975 18791424 1.15
tpcds_q94/duckdb:duckdb 12817639 13111230 0.98
tpcds_q95/duckdb:duckdb 127519508 128485989 0.99
tpcds_q96/duckdb:duckdb 4399160 4513541 0.97
tpcds_q97/duckdb:duckdb 30601655 29188032 1.05
tpcds_q98/duckdb:duckdb 13329784 13057550 1.02
tpcds_q99/duckdb:duckdb 16143110 16546627 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -0.9% +5.4% -6.0% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -0.1% +5.4% -5.2% +11.3% ➖ noise
1 duckdb:duckdb +3.1% +5.4% -2.2% +10.0% ➖ noise
1 duckdb:vortex-compact +10.4% +5.4% +4.7% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.8% +5.4% -3.4% +10.6% ➖ noise
2 datafusion:vortex-compact -1.1% +2.9% -3.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.1% +2.9% +2.1% +12.7% ➖ noise
2 duckdb:duckdb +8.0% +2.9% +5.0% +11.1% ➖ noise
2 duckdb:vortex-compact -0.8% +2.9% -3.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.3% +2.9% -1.6% +12.2% ➖ noise
3 datafusion:vortex-compact +4.0% -1.6% +5.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.3% -1.6% +2.0% +10.0% ➖ noise
3 duckdb:duckdb -0.9% -1.6% +0.7% +25.8% ➖ noise
3 duckdb:vortex-compact +2.5% -1.6% +4.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.2% -1.6% -1.6% +11.7% ➖ noise
4 datafusion:vortex-compact +1.5% -1.5% +3.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +6.5% -1.5% +8.2% +10.0% ➖ noise
4 duckdb:duckdb -1.0% -1.5% +0.6% +10.0% ➖ noise
4 duckdb:vortex-compact -4.9% -1.5% -3.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.2% -1.5% +0.4% +10.0% ➖ noise
5 datafusion:vortex-compact +1.8% +9.1% -6.6% +12.9% ➖ noise
5 datafusion:vortex-file-compressed -4.2% +9.1% -12.2% +14.5% ➖ noise
5 duckdb:duckdb -1.8% +9.1% -10.0% +13.4% ➖ noise
5 duckdb:vortex-compact +1.7% +9.1% -6.8% +15.5% ➖ noise
5 duckdb:vortex-file-compressed -4.7% +9.1% -12.6% +14.1% ✅ faster
6 datafusion:vortex-compact +4.5% +1.0% +3.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.7% +1.0% -3.7% +10.0% ➖ noise
6 duckdb:duckdb +1.8% +1.0% +0.8% +12.0% ➖ noise
6 duckdb:vortex-compact +2.9% +1.0% +1.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.3% +1.0% -2.3% +10.0% ➖ noise
7 datafusion:vortex-compact -1.4% -0.5% -1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -5.0% -0.5% -4.5% +10.0% ➖ noise
7 duckdb:duckdb +7.1% -0.5% +7.7% +17.2% ➖ noise
7 duckdb:vortex-compact +3.6% -0.5% +4.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.1% -0.5% +1.6% +10.0% ➖ noise
8 datafusion:vortex-compact +3.1% +6.8% -3.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +4.2% +6.8% -2.4% +10.0% ➖ noise
8 duckdb:duckdb +0.3% +6.8% -6.0% +10.0% ➖ noise
8 duckdb:vortex-compact -2.9% +6.8% -9.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.1% +6.8% -6.4% +12.1% ➖ noise
9 datafusion:vortex-compact +4.5% +1.7% +2.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.2% +1.7% -2.9% +10.0% ➖ noise
9 duckdb:duckdb +1.8% +1.7% +0.1% +10.0% ➖ noise
9 duckdb:vortex-compact -2.0% +1.7% -3.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.8% +1.7% +1.1% +10.5% ➖ noise
10 datafusion:vortex-compact +5.9% +4.8% +1.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.3% +4.8% -2.3% +10.0% ➖ noise
10 duckdb:duckdb -1.2% +4.8% -5.7% +10.0% ➖ noise
10 duckdb:vortex-compact +4.3% +4.8% -0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.2% +4.8% -6.6% +11.0% ➖ noise
11 datafusion:vortex-compact +3.1% +1.2% +1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.2% +1.2% +0.9% +10.0% ➖ noise
11 duckdb:duckdb +2.1% +1.2% +0.9% +10.0% ➖ noise
11 duckdb:vortex-compact +0.4% +1.2% -0.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.5% +1.2% -0.7% +10.0% ➖ noise
12 datafusion:vortex-compact -1.0% -3.0% +2.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.6% -3.0% +9.9% +13.4% ➖ noise
12 duckdb:duckdb +6.0% -3.0% +9.3% +10.6% ➖ noise
12 duckdb:vortex-compact -12.0% -3.0% -9.2% +18.4% ➖ noise
12 duckdb:vortex-file-compressed +4.5% -3.0% +7.8% +14.5% ➖ noise
13 datafusion:vortex-compact +6.7% +1.7% +4.9% +11.2% ➖ noise
13 datafusion:vortex-file-compressed +2.6% +1.7% +0.9% +10.0% ➖ noise
13 duckdb:duckdb -1.5% +1.7% -3.1% +10.0% ➖ noise
13 duckdb:vortex-compact -1.6% +1.7% -3.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.9% +1.7% +2.1% +10.8% ➖ noise
14 datafusion:vortex-compact +2.5% -1.5% +4.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.7% -1.5% +4.3% +10.0% ➖ noise
14 duckdb:duckdb +0.9% -1.5% +2.4% +10.0% ➖ noise
14 duckdb:vortex-compact -3.7% -1.5% -2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.6% -1.5% -2.2% +12.9% ➖ noise
15 datafusion:vortex-compact +0.5% +1.2% -0.7% +10.2% ➖ noise
15 datafusion:vortex-file-compressed +3.5% +1.2% +2.2% +13.8% ➖ noise
15 duckdb:duckdb -0.5% +1.2% -1.7% +12.3% ➖ noise
15 duckdb:vortex-compact +0.1% +1.2% -1.1% +13.8% ➖ noise
15 duckdb:vortex-file-compressed +0.8% +1.2% -0.5% +10.0% ➖ noise
16 datafusion:vortex-compact -3.3% -0.5% -2.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.3% -0.5% +0.8% +10.0% ➖ noise
16 duckdb:duckdb -5.8% -0.5% -5.3% +14.1% ➖ noise
16 duckdb:vortex-compact -0.7% -0.5% -0.2% +10.8% ➖ noise
16 duckdb:vortex-file-compressed +0.2% -0.5% +0.7% +10.0% ➖ noise
17 datafusion:vortex-compact +5.8% +0.4% +5.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.2% +0.4% -0.6% +11.6% ➖ noise
17 duckdb:duckdb -2.6% +0.4% -3.0% +10.7% ➖ noise
17 duckdb:vortex-compact +0.8% +0.4% +0.4% +11.7% ➖ noise
17 duckdb:vortex-file-compressed -3.8% +0.4% -4.2% +11.4% ➖ noise
18 datafusion:vortex-compact -1.4% +1.7% -3.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.4% +1.7% +0.7% +10.0% ➖ noise
18 duckdb:duckdb -2.9% +1.7% -4.5% +10.0% ➖ noise
18 duckdb:vortex-compact -1.5% +1.7% -3.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.8% +1.7% -4.4% +10.0% ➖ noise
19 datafusion:vortex-compact +0.6% +1.9% -1.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.2% +1.9% -1.7% +10.0% ➖ noise
19 duckdb:duckdb -3.8% +1.9% -5.6% +10.0% ➖ noise
19 duckdb:vortex-compact +2.1% +1.9% +0.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.9% +1.9% -3.8% +10.1% ➖ noise
20 datafusion:vortex-compact +6.1% +2.4% +3.6% +12.3% ➖ noise
20 datafusion:vortex-file-compressed +2.5% +2.4% +0.1% +12.6% ➖ noise
20 duckdb:duckdb +0.1% +2.4% -2.3% +13.8% ➖ noise
20 duckdb:vortex-compact -2.5% +2.4% -4.9% +13.1% ➖ noise
20 duckdb:vortex-file-compressed -7.4% +2.4% -9.6% +14.5% ➖ noise
21 datafusion:vortex-compact +2.3% -3.2% +5.7% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +5.4% -3.2% +8.9% +10.0% ➖ noise
21 duckdb:duckdb -0.3% -3.2% +3.0% +19.4% ➖ noise
21 duckdb:vortex-compact +4.8% -3.2% +8.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -3.7% -3.2% -0.5% +15.1% ➖ noise
22 datafusion:vortex-compact -2.6% +0.4% -3.0% +17.5% ➖ noise
22 datafusion:vortex-file-compressed +0.6% +0.4% +0.2% +13.0% ➖ noise
22 duckdb:duckdb -2.6% +0.4% -3.0% +15.1% ➖ noise
22 duckdb:vortex-compact +2.6% +0.4% +2.2% +11.9% ➖ noise
22 duckdb:vortex-file-compressed -5.3% +0.4% -5.7% +12.3% ➖ noise
23 datafusion:vortex-compact +10.2% +0.4% +9.8% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +1.6% +0.4% +1.2% +10.0% ➖ noise
23 duckdb:duckdb +6.2% +0.4% +5.8% +18.0% ➖ noise
23 duckdb:vortex-compact +3.5% +0.4% +3.1% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -2.0% +0.4% -2.3% +10.0% ➖ noise
24 datafusion:vortex-compact +11.3% -0.4% +11.7% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed -0.6% -0.4% -0.2% +10.0% ➖ noise
24 duckdb:duckdb -5.2% -0.4% -4.9% +10.0% ➖ noise
24 duckdb:vortex-compact +1.5% -0.4% +1.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.5% -0.4% +1.9% +12.0% ➖ noise
25 datafusion:vortex-compact +4.3% +2.1% +2.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +4.3% +2.1% +2.2% +10.0% ➖ noise
25 duckdb:duckdb +10.4% +2.1% +8.1% +10.0% ➖ noise
25 duckdb:vortex-compact -2.0% +2.1% -4.0% +10.9% ➖ noise
25 duckdb:vortex-file-compressed +1.9% +2.1% -0.2% +10.0% ➖ noise
26 datafusion:vortex-compact +0.8% +2.7% -1.8% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +1.8% +2.7% -0.9% +10.0% ➖ noise
26 duckdb:duckdb +5.6% +2.7% +2.8% +15.4% ➖ noise
26 duckdb:vortex-compact -4.1% +2.7% -6.7% +16.7% ➖ noise
26 duckdb:vortex-file-compressed +1.3% +2.7% -1.3% +10.0% ➖ noise
27 datafusion:vortex-compact -0.9% +1.8% -2.7% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.3% +1.8% -1.5% +10.0% ➖ noise
27 duckdb:duckdb -6.6% +1.8% -8.3% +14.7% ➖ noise
27 duckdb:vortex-compact +1.7% +1.8% -0.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.3% +1.8% -3.1% +10.0% ➖ noise
28 datafusion:vortex-compact +1.2% +1.3% -0.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +8.2% +1.3% +6.8% +10.0% ➖ noise
28 duckdb:duckdb -0.0% +1.3% -1.3% +10.0% ➖ noise
28 duckdb:vortex-compact -1.7% +1.3% -3.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +2.7% +1.3% +1.4% +17.6% ➖ noise
29 datafusion:vortex-compact -2.5% +1.2% -3.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +2.2% +1.2% +1.0% +10.0% ➖ noise
29 duckdb:duckdb -1.5% +1.2% -2.7% +13.0% ➖ noise
29 duckdb:vortex-compact +2.4% +1.2% +1.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -1.3% +1.2% -2.4% +10.0% ➖ noise
30 datafusion:vortex-compact +9.8% +5.2% +4.4% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +2.0% +5.2% -3.0% +11.5% ➖ noise
30 duckdb:duckdb -1.3% +5.2% -6.2% +10.0% ➖ noise
30 duckdb:vortex-compact +2.8% +5.2% -2.3% +11.0% ➖ noise
30 duckdb:vortex-file-compressed -0.7% +5.2% -5.6% +10.0% ➖ noise
31 datafusion:vortex-compact -0.0% -1.3% +1.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +4.1% -1.3% +5.5% +10.0% ➖ noise
31 duckdb:duckdb -4.8% -1.3% -3.5% +12.1% ➖ noise
31 duckdb:vortex-compact +8.3% -1.3% +9.8% +10.2% ➖ noise
31 duckdb:vortex-file-compressed -2.7% -1.3% -1.4% +10.0% ➖ noise
32 datafusion:vortex-compact -1.6% +3.2% -4.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +2.2% +3.2% -1.0% +10.3% ➖ noise
32 duckdb:duckdb +3.2% +3.2% -0.0% +10.6% ➖ noise
32 duckdb:vortex-compact +8.9% +3.2% +5.4% +14.7% ➖ noise
32 duckdb:vortex-file-compressed +0.7% +3.2% -2.4% +12.6% ➖ noise
33 datafusion:vortex-compact -3.4% -0.2% -3.2% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.2% -0.2% -1.0% +10.0% ➖ noise
33 duckdb:duckdb +3.8% -0.2% +4.0% +10.0% ➖ noise
33 duckdb:vortex-compact +1.1% -0.2% +1.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +10.9% -0.2% +11.1% +13.1% ➖ noise
34 datafusion:vortex-compact -4.7% +4.5% -8.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -2.1% +4.5% -6.4% +10.0% ➖ noise
34 duckdb:duckdb +2.3% +4.5% -2.1% +13.9% ➖ noise
34 duckdb:vortex-compact -2.9% +4.5% -7.1% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.9% +4.5% -6.1% +10.9% ➖ noise
35 datafusion:vortex-compact +0.5% -0.5% +1.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.1% -0.5% +0.5% +10.0% ➖ noise
35 duckdb:duckdb +7.5% -0.5% +8.1% +13.5% ➖ noise
35 duckdb:vortex-compact +4.0% -0.5% +4.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.8% -0.5% -0.3% +12.3% ➖ noise
36 datafusion:vortex-compact -0.8% -1.8% +1.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.5% -1.8% +4.4% +10.0% ➖ noise
36 duckdb:duckdb +2.1% -1.8% +4.0% +12.2% ➖ noise
36 duckdb:vortex-compact -0.4% -1.8% +1.4% +13.3% ➖ noise
36 duckdb:vortex-file-compressed +1.5% -1.8% +3.3% +10.0% ➖ noise
37 datafusion:vortex-compact -0.6% +2.0% -2.6% +10.3% ➖ noise
37 datafusion:vortex-file-compressed +3.3% +2.0% +1.2% +10.8% ➖ noise
37 duckdb:duckdb +9.8% +2.0% +7.6% +18.6% ➖ noise
37 duckdb:vortex-compact -1.0% +2.0% -3.0% +11.9% ➖ noise
37 duckdb:vortex-file-compressed +4.2% +2.0% +2.1% +15.3% ➖ noise
38 datafusion:vortex-compact +4.3% -1.5% +5.9% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +1.1% -1.5% +2.6% +10.0% ➖ noise
38 duckdb:duckdb +3.0% -1.5% +4.6% +24.6% ➖ noise
38 duckdb:vortex-compact +10.7% -1.5% +12.4% +15.0% ➖ noise
38 duckdb:vortex-file-compressed -1.5% -1.5% -0.0% +10.0% ➖ noise
39 datafusion:vortex-compact -0.9% -1.2% +0.3% +15.0% ➖ noise
39 datafusion:vortex-file-compressed -11.0% -1.2% -9.9% +13.8% ➖ noise
39 duckdb:duckdb +2.9% -1.2% +4.1% +26.7% ➖ noise
39 duckdb:vortex-compact +1.6% -1.2% +2.8% +12.4% ➖ noise
39 duckdb:vortex-file-compressed -1.3% -1.2% -0.1% +19.2% ➖ noise
40 datafusion:vortex-compact -0.1% +3.9% -3.8% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +1.2% +3.9% -2.6% +10.0% ➖ noise
40 duckdb:duckdb +3.6% +3.9% -0.3% +17.8% ➖ noise
40 duckdb:vortex-compact -2.1% +3.9% -5.7% +10.2% ➖ noise
40 duckdb:vortex-file-compressed -5.6% +3.9% -9.1% +16.8% ➖ noise
41 datafusion:vortex-compact +6.1% +1.5% +4.5% +11.8% ➖ noise
41 datafusion:vortex-file-compressed +1.8% +1.5% +0.2% +12.9% ➖ noise
41 duckdb:duckdb -3.2% +1.5% -4.7% +12.9% ➖ noise
41 duckdb:vortex-compact +4.6% +1.5% +3.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +9.4% +1.5% +7.7% +10.6% ➖ noise
42 datafusion:vortex-compact +0.7% -2.4% +3.2% +14.4% ➖ noise
42 datafusion:vortex-file-compressed +3.8% -2.4% +6.4% +10.0% ➖ noise
42 duckdb:duckdb -1.6% -2.4% +0.8% +13.1% ➖ noise
42 duckdb:vortex-compact -3.4% -2.4% -1.1% +16.9% ➖ noise
42 duckdb:vortex-file-compressed -2.3% -2.4% +0.0% +12.8% ➖ noise
43 datafusion:vortex-compact +2.4% -1.6% +4.1% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +4.1% -1.6% +5.8% +10.0% ➖ noise
43 duckdb:duckdb +5.9% -1.6% +7.6% +10.7% ➖ noise
43 duckdb:vortex-compact -0.1% -1.6% +1.5% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +0.8% -1.6% +2.5% +32.4% ➖ noise
44 datafusion:vortex-compact +0.4% +1.9% -1.4% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.0% +1.9% -0.8% +12.6% ➖ noise
44 duckdb:duckdb -4.3% +1.9% -6.0% +10.0% ➖ noise
44 duckdb:vortex-compact +1.7% +1.9% -0.2% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -2.5% +1.9% -4.3% +12.0% ➖ noise
45 datafusion:vortex-compact +1.4% -3.2% +4.7% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.1% -3.2% +3.1% +10.0% ➖ noise
45 duckdb:duckdb +3.2% -3.2% +6.6% +12.7% ➖ noise
45 duckdb:vortex-compact +5.3% -3.2% +8.8% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -6.4% -3.2% -3.3% +10.0% ➖ noise
46 datafusion:vortex-compact +3.3% -1.9% +5.4% +10.5% ➖ noise
46 datafusion:vortex-file-compressed +1.2% -1.9% +3.2% +12.6% ➖ noise
46 duckdb:duckdb +0.9% -1.9% +2.9% +10.0% ➖ noise
46 duckdb:vortex-compact +0.0% -1.9% +2.0% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -1.0% -1.9% +1.0% +10.0% ➖ noise
47 datafusion:vortex-compact +0.2% +0.3% -0.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +0.3% +0.3% -0.0% +10.0% ➖ noise
47 duckdb:duckdb +1.4% +0.3% +1.0% +10.0% ➖ noise
47 duckdb:vortex-compact +1.4% +0.3% +1.1% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -0.3% +0.3% -0.6% +10.0% ➖ noise
48 datafusion:vortex-compact +10.1% +2.0% +7.9% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +7.1% +2.0% +5.0% +11.3% ➖ noise
48 duckdb:duckdb -0.6% +2.0% -2.5% +10.0% ➖ noise
48 duckdb:vortex-compact +0.7% +2.0% -1.3% +13.4% ➖ noise
48 duckdb:vortex-file-compressed -1.8% +2.0% -3.8% +10.1% ➖ noise
49 datafusion:vortex-compact -2.3% +1.0% -3.3% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +7.3% +1.0% +6.2% +10.9% ➖ noise
49 duckdb:duckdb +8.9% +1.0% +7.8% +17.7% ➖ noise
49 duckdb:vortex-compact +4.5% +1.0% +3.4% +10.8% ➖ noise
49 duckdb:vortex-file-compressed -4.8% +1.0% -5.7% +16.1% ➖ noise
50 datafusion:vortex-compact +2.4% +0.5% +1.9% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +9.1% +0.5% +8.6% +10.4% ➖ noise
50 duckdb:duckdb -1.0% +0.5% -1.5% +10.9% ➖ noise
50 duckdb:vortex-compact -2.0% +0.5% -2.5% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +1.1% +0.5% +0.6% +10.0% ➖ noise
51 datafusion:vortex-compact +0.3% +2.1% -1.8% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -0.5% +2.1% -2.6% +10.0% ➖ noise
51 duckdb:duckdb +0.2% +2.1% -1.9% +10.0% ➖ noise
51 duckdb:vortex-compact +0.5% +2.1% -1.6% +23.8% ➖ noise
51 duckdb:vortex-file-compressed -1.9% +2.1% -4.0% +10.0% ➖ noise
52 datafusion:vortex-compact +0.2% +4.7% -4.3% +14.2% ➖ noise
52 datafusion:vortex-file-compressed +4.5% +4.7% -0.2% +13.3% ➖ noise
52 duckdb:duckdb +0.0% +4.7% -4.5% +16.7% ➖ noise
52 duckdb:vortex-compact -5.7% +4.7% -9.9% +14.1% ➖ noise
52 duckdb:vortex-file-compressed +2.9% +4.7% -1.8% +16.9% ➖ noise
53 datafusion:vortex-compact +5.4% +2.1% +3.2% +10.5% ➖ noise
53 datafusion:vortex-file-compressed +14.1% +2.1% +11.7% +18.9% ➖ noise
53 duckdb:duckdb +4.5% +2.1% +2.4% +11.8% ➖ noise
53 duckdb:vortex-compact -5.3% +2.1% -7.3% +10.7% ➖ noise
53 duckdb:vortex-file-compressed +0.3% +2.1% -1.8% +11.0% ➖ noise
54 datafusion:vortex-compact -0.8% +2.0% -2.7% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +3.3% +2.0% +1.3% +10.7% ➖ noise
54 duckdb:duckdb -1.2% +2.0% -3.1% +10.9% ➖ noise
54 duckdb:vortex-compact -0.3% +2.0% -2.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +4.9% +2.0% +2.8% +10.0% ➖ noise
55 datafusion:vortex-compact +1.5% +1.0% +0.5% +10.8% ➖ noise
55 datafusion:vortex-file-compressed +3.4% +1.0% +2.4% +18.1% ➖ noise
55 duckdb:duckdb +2.7% +1.0% +1.6% +15.9% ➖ noise
55 duckdb:vortex-compact -1.7% +1.0% -2.7% +13.2% ➖ noise
55 duckdb:vortex-file-compressed +9.3% +1.0% +8.2% +16.0% ➖ noise
56 datafusion:vortex-compact +1.9% +5.7% -3.6% +10.8% ➖ noise
56 datafusion:vortex-file-compressed +13.4% +5.7% +7.3% +11.1% ➖ noise
56 duckdb:duckdb +5.4% +5.7% -0.3% +17.2% ➖ noise
56 duckdb:vortex-compact +1.3% +5.7% -4.1% +10.4% ➖ noise
56 duckdb:vortex-file-compressed -0.8% +5.7% -6.1% +12.6% ➖ noise
57 datafusion:vortex-compact -5.0% +8.4% -12.3% +10.0% ✅ faster
57 datafusion:vortex-file-compressed +7.5% +8.4% -0.8% +10.0% ➖ noise
57 duckdb:duckdb +4.9% +8.4% -3.1% +13.5% ➖ noise
57 duckdb:vortex-compact +0.2% +8.4% -7.5% +11.6% ➖ noise
57 duckdb:vortex-file-compressed +2.1% +8.4% -5.7% +24.6% ➖ noise
58 datafusion:vortex-compact -2.2% +4.4% -6.3% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -0.5% +4.4% -4.7% +10.0% ➖ noise
58 duckdb:duckdb +7.8% +4.4% +3.2% +21.0% ➖ noise
58 duckdb:vortex-compact -0.2% +4.4% -4.4% +17.9% ➖ noise
58 duckdb:vortex-file-compressed +2.8% +4.4% -1.5% +11.0% ➖ noise
59 datafusion:vortex-compact -0.7% +2.6% -3.2% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +1.4% +2.6% -1.2% +11.7% ➖ noise
59 duckdb:duckdb +1.4% +2.6% -1.1% +10.0% ➖ noise
59 duckdb:vortex-compact +2.4% +2.6% -0.2% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +1.6% +2.6% -0.9% +10.0% ➖ noise
60 datafusion:vortex-compact -1.1% +2.1% -3.1% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +4.5% +2.1% +2.4% +10.0% ➖ noise
60 duckdb:duckdb +1.2% +2.1% -0.9% +10.2% ➖ noise
60 duckdb:vortex-compact -3.6% +2.1% -5.5% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -1.5% +2.1% -3.5% +12.9% ➖ noise
61 datafusion:vortex-compact +0.2% +0.5% -0.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +0.7% +0.5% +0.1% +10.0% ➖ noise
61 duckdb:duckdb +1.1% +0.5% +0.5% +10.0% ➖ noise
61 duckdb:vortex-compact -0.4% +0.5% -0.9% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -4.5% +0.5% -5.0% +10.0% ➖ noise
62 datafusion:vortex-compact +0.3% +4.8% -4.3% +10.2% ➖ noise
62 datafusion:vortex-file-compressed -1.2% +4.8% -5.7% +13.2% ➖ noise
62 duckdb:duckdb +0.2% +4.8% -4.4% +21.5% ➖ noise
62 duckdb:vortex-compact -25.6% +4.8% -29.0% +23.7% ✅ faster
62 duckdb:vortex-file-compressed -12.5% +4.8% -16.5% +24.7% ➖ noise
63 datafusion:vortex-compact +0.4% +4.9% -4.3% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +1.8% +4.9% -2.9% +10.0% ➖ noise
63 duckdb:duckdb -1.5% +4.9% -6.1% +10.0% ➖ noise
63 duckdb:vortex-compact -2.8% +4.9% -7.4% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -1.0% +4.9% -5.7% +10.7% ➖ noise
64 datafusion:vortex-compact -0.5% +1.9% -2.4% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +1.5% +1.9% -0.4% +10.0% ➖ noise
64 duckdb:duckdb -2.7% +1.9% -4.5% +10.4% ➖ noise
64 duckdb:vortex-compact +1.2% +1.9% -0.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +4.2% +1.9% +2.2% +10.0% ➖ noise
65 datafusion:vortex-compact -1.9% -2.0% +0.2% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +6.5% -2.0% +8.7% +12.4% ➖ noise
65 duckdb:duckdb -3.5% -2.0% -1.5% +19.4% ➖ noise
65 duckdb:vortex-compact +2.8% -2.0% +5.0% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -2.3% -2.0% -0.2% +14.2% ➖ noise
66 datafusion:vortex-compact +0.7% -1.5% +2.2% +10.3% ➖ noise
66 datafusion:vortex-file-compressed -0.8% -1.5% +0.7% +12.7% ➖ noise
66 duckdb:duckdb -1.9% -1.5% -0.4% +13.7% ➖ noise
66 duckdb:vortex-compact +0.7% -1.5% +2.2% +11.6% ➖ noise
66 duckdb:vortex-file-compressed +9.0% -1.5% +10.6% +20.6% ➖ noise
67 datafusion:vortex-compact -0.8% +0.0% -0.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +1.8% +0.0% +1.7% +10.0% ➖ noise
67 duckdb:duckdb +0.6% +0.0% +0.5% +10.0% ➖ noise
67 duckdb:vortex-compact +0.4% +0.0% +0.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.6% +0.0% +0.6% +10.0% ➖ noise
68 datafusion:vortex-compact -2.6% +0.4% -3.0% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +5.3% +0.4% +4.9% +10.0% ➖ noise
68 duckdb:duckdb +1.3% +0.4% +0.9% +11.9% ➖ noise
68 duckdb:vortex-compact +3.9% +0.4% +3.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +3.0% +0.4% +2.6% +10.0% ➖ noise
69 datafusion:vortex-compact +0.7% +2.0% -1.3% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +7.0% +2.0% +4.9% +10.0% ➖ noise
69 duckdb:duckdb +1.4% +2.0% -0.5% +11.9% ➖ noise
69 duckdb:vortex-compact +2.4% +2.0% +0.4% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -1.8% +2.0% -3.7% +10.0% ➖ noise
70 datafusion:vortex-compact -0.2% -1.3% +1.1% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +1.2% -1.3% +2.6% +10.0% ➖ noise
70 duckdb:duckdb -1.5% -1.3% -0.2% +13.7% ➖ noise
70 duckdb:vortex-compact -1.7% -1.3% -0.3% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +1.7% -1.3% +3.1% +10.0% ➖ noise
71 datafusion:vortex-compact +1.8% +1.0% +0.7% +10.1% ➖ noise
71 datafusion:vortex-file-compressed -2.0% +1.0% -3.0% +12.9% ➖ noise
71 duckdb:duckdb +1.1% +1.0% +0.1% +19.2% ➖ noise
71 duckdb:vortex-compact +5.6% +1.0% +4.6% +11.4% ➖ noise
71 duckdb:vortex-file-compressed -0.7% +1.0% -1.8% +15.0% ➖ noise
72 datafusion:vortex-compact -1.0% +0.9% -1.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +2.8% +0.9% +1.9% +10.0% ➖ noise
72 duckdb:duckdb +0.4% +0.9% -0.5% +13.1% ➖ noise
72 duckdb:vortex-compact +0.0% +0.9% -0.9% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -1.3% +0.9% -2.2% +10.0% ➖ noise
73 datafusion:vortex-compact -1.1% +1.0% -2.0% +15.6% ➖ noise
73 datafusion:vortex-file-compressed +3.0% +1.0% +2.1% +25.3% ➖ noise
73 duckdb:duckdb -1.0% +1.0% -2.0% +11.6% ➖ noise
73 duckdb:vortex-compact +2.6% +1.0% +1.6% +14.7% ➖ noise
73 duckdb:vortex-file-compressed -1.6% +1.0% -2.5% +10.0% ➖ noise
74 datafusion:vortex-compact +1.9% +1.1% +0.8% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.7% +1.1% +1.5% +10.0% ➖ noise
74 duckdb:duckdb +0.5% +1.1% -0.6% +10.0% ➖ noise
74 duckdb:vortex-compact +1.4% +1.1% +0.3% +11.0% ➖ noise
74 duckdb:vortex-file-compressed -0.2% +1.1% -1.3% +10.0% ➖ noise
75 datafusion:vortex-compact +0.1% -0.9% +1.0% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -0.0% -0.9% +0.9% +10.0% ➖ noise
75 duckdb:duckdb -1.0% -0.9% -0.1% +10.0% ➖ noise
75 duckdb:vortex-compact +0.4% -0.9% +1.3% +12.4% ➖ noise
75 duckdb:vortex-file-compressed +0.7% -0.9% +1.6% +10.0% ➖ noise
76 datafusion:vortex-compact +2.1% +7.3% -4.8% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -0.5% +7.3% -7.2% +10.0% ➖ noise
76 duckdb:duckdb +5.7% +7.3% -1.5% +17.9% ➖ noise
76 duckdb:vortex-compact +7.1% +7.3% -0.1% +10.4% ➖ noise
76 duckdb:vortex-file-compressed -6.1% +7.3% -12.5% +20.9% ➖ noise
77 datafusion:vortex-compact +0.6% +0.2% +0.4% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +2.8% +0.2% +2.6% +10.0% ➖ noise
77 duckdb:duckdb -1.2% +0.2% -1.4% +11.5% ➖ noise
77 duckdb:vortex-compact +2.5% +0.2% +2.3% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -8.7% +0.2% -8.9% +12.0% ➖ noise
78 datafusion:vortex-compact -1.0% +2.9% -3.8% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +1.6% +2.9% -1.3% +10.0% ➖ noise
78 duckdb:duckdb -1.4% +2.9% -4.2% +10.0% ➖ noise
78 duckdb:vortex-compact +6.1% +2.9% +3.1% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +0.8% +2.9% -2.1% +10.0% ➖ noise
79 datafusion:vortex-compact +2.3% +4.2% -1.8% +10.4% ➖ noise
79 datafusion:vortex-file-compressed +1.2% +4.2% -2.9% +10.1% ➖ noise
79 duckdb:duckdb -0.1% +4.2% -4.2% +11.7% ➖ noise
79 duckdb:vortex-compact +2.2% +4.2% -2.0% +11.0% ➖ noise
79 duckdb:vortex-file-compressed +5.1% +4.2% +0.8% +12.7% ➖ noise
80 datafusion:vortex-compact +2.8% +1.2% +1.6% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +1.4% +1.2% +0.2% +10.0% ➖ noise
80 duckdb:duckdb +0.9% +1.2% -0.3% +11.9% ➖ noise
80 duckdb:vortex-compact +1.3% +1.2% +0.1% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +1.7% +1.2% +0.5% +10.0% ➖ noise
81 datafusion:vortex-compact +4.6% -0.1% +4.7% +10.7% ➖ noise
81 datafusion:vortex-file-compressed +5.5% -0.1% +5.6% +16.3% ➖ noise
81 duckdb:duckdb -3.9% -0.1% -3.9% +11.9% ➖ noise
81 duckdb:vortex-compact +2.2% -0.1% +2.2% +10.2% ➖ noise
81 duckdb:vortex-file-compressed +2.9% -0.1% +3.0% +11.3% ➖ noise
82 datafusion:vortex-compact +4.7% -3.5% +8.5% +11.4% ➖ noise
82 datafusion:vortex-file-compressed +0.3% -3.5% +3.9% +10.0% ➖ noise
82 duckdb:duckdb +12.6% -3.5% +16.7% +13.2% 🚨 regression
82 duckdb:vortex-compact -1.8% -3.5% +1.8% +10.8% ➖ noise
82 duckdb:vortex-file-compressed -4.2% -3.5% -0.7% +10.0% ➖ noise
83 datafusion:vortex-compact -1.8% +1.4% -3.1% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +5.5% +1.4% +4.1% +11.1% ➖ noise
83 duckdb:duckdb +4.2% +1.4% +2.8% +12.6% ➖ noise
83 duckdb:vortex-compact -0.8% +1.4% -2.2% +11.4% ➖ noise
83 duckdb:vortex-file-compressed +3.7% +1.4% +2.4% +10.6% ➖ noise
84 datafusion:vortex-compact +3.7% +1.9% +1.8% +10.7% ➖ noise
84 datafusion:vortex-file-compressed +4.9% +1.9% +2.9% +11.2% ➖ noise
84 duckdb:duckdb +3.5% +1.9% +1.6% +10.4% ➖ noise
84 duckdb:vortex-compact +0.2% +1.9% -1.7% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +6.1% +1.9% +4.2% +10.0% ➖ noise
85 datafusion:vortex-compact +1.1% -0.3% +1.4% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +4.1% -0.3% +4.4% +10.0% ➖ noise
85 duckdb:duckdb +0.4% -0.3% +0.7% +15.5% ➖ noise
85 duckdb:vortex-compact +0.8% -0.3% +1.1% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +1.9% -0.3% +2.2% +10.0% ➖ noise
86 datafusion:vortex-compact -3.5% +2.9% -6.3% +10.6% ➖ noise
86 datafusion:vortex-file-compressed +6.1% +2.9% +3.0% +13.5% ➖ noise
86 duckdb:duckdb -1.1% +2.9% -3.9% +12.2% ➖ noise
86 duckdb:vortex-compact +2.6% +2.9% -0.3% +18.6% ➖ noise
86 duckdb:vortex-file-compressed -1.1% +2.9% -4.0% +16.3% ➖ noise
87 datafusion:vortex-compact +5.4% +2.0% +3.3% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +4.4% +2.0% +2.3% +10.0% ➖ noise
87 duckdb:duckdb -1.8% +2.0% -3.8% +12.5% ➖ noise
87 duckdb:vortex-compact +6.2% +2.0% +4.1% +11.8% ➖ noise
87 duckdb:vortex-file-compressed -7.0% +2.0% -8.8% +13.5% ➖ noise
88 datafusion:vortex-compact -1.0% -0.4% -0.7% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.1% -0.4% +0.5% +10.0% ➖ noise
88 duckdb:duckdb +0.0% -0.4% +0.4% +10.0% ➖ noise
88 duckdb:vortex-compact -2.3% -0.4% -2.0% +11.8% ➖ noise
88 duckdb:vortex-file-compressed +5.1% -0.4% +5.5% +10.0% ➖ noise
89 datafusion:vortex-compact +4.0% +2.3% +1.7% +16.1% ➖ noise
89 datafusion:vortex-file-compressed +2.4% +2.3% +0.1% +19.8% ➖ noise
89 duckdb:duckdb +1.3% +2.3% -1.0% +16.3% ➖ noise
89 duckdb:vortex-compact +1.3% +2.3% -0.9% +14.7% ➖ noise
89 duckdb:vortex-file-compressed +1.0% +2.3% -1.3% +17.0% ➖ noise
90 datafusion:vortex-compact +1.7% -0.8% +2.5% +10.3% ➖ noise
90 datafusion:vortex-file-compressed -4.9% -0.8% -4.2% +10.0% ➖ noise
90 duckdb:duckdb +0.9% -0.8% +1.7% +10.0% ➖ noise
90 duckdb:vortex-compact -4.5% -0.8% -3.7% +10.0% ➖ noise
90 duckdb:vortex-file-compressed +6.6% -0.8% +7.4% +12.1% ➖ noise
91 datafusion:vortex-compact +2.7% +0.6% +2.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +2.9% +0.6% +2.3% +10.0% ➖ noise
91 duckdb:duckdb +0.9% +0.6% +0.3% +10.0% ➖ noise
91 duckdb:vortex-compact -1.6% +0.6% -2.2% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +2.2% +0.6% +1.6% +10.1% ➖ noise
92 datafusion:vortex-compact -1.9% +2.6% -4.4% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +8.5% +2.6% +5.7% +10.6% ➖ noise
92 duckdb:duckdb -4.7% +2.6% -7.1% +15.9% ➖ noise
92 duckdb:vortex-compact -4.8% +2.6% -7.2% +13.5% ➖ noise
92 duckdb:vortex-file-compressed -3.0% +2.6% -5.4% +10.0% ➖ noise
93 datafusion:vortex-compact +2.8% +0.4% +2.4% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.0% +0.4% -1.4% +10.0% ➖ noise
93 duckdb:duckdb +15.1% +0.4% +14.6% +14.8% ➖ noise
93 duckdb:vortex-compact +0.2% +0.4% -0.3% +11.3% ➖ noise
93 duckdb:vortex-file-compressed +16.4% +0.4% +15.9% +19.2% ➖ noise
94 datafusion:vortex-compact -3.2% -1.7% -1.5% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -1.3% -1.7% +0.4% +10.0% ➖ noise
94 duckdb:duckdb -2.2% -1.7% -0.5% +10.0% ➖ noise
94 duckdb:vortex-compact +2.3% -1.7% +4.0% +12.4% ➖ noise
94 duckdb:vortex-file-compressed -1.8% -1.7% -0.1% +11.0% ➖ noise
95 datafusion:vortex-compact +0.9% -5.1% +6.3% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +1.6% -5.1% +7.1% +10.0% ➖ noise
95 duckdb:duckdb -0.8% -5.1% +4.6% +18.0% ➖ noise
95 duckdb:vortex-compact -3.4% -5.1% +1.8% +11.1% ➖ noise
95 duckdb:vortex-file-compressed +0.9% -5.1% +6.4% +14.7% ➖ noise
96 datafusion:vortex-compact +1.5% -2.4% +4.0% +11.4% ➖ noise
96 datafusion:vortex-file-compressed +8.1% -2.4% +10.8% +14.6% ➖ noise
96 duckdb:duckdb -2.5% -2.4% -0.1% +17.6% ➖ noise
96 duckdb:vortex-compact +14.1% -2.4% +16.9% +28.0% ➖ noise
96 duckdb:vortex-file-compressed +0.9% -2.4% +3.4% +14.9% ➖ noise
97 datafusion:vortex-compact +4.2% -1.5% +5.9% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +2.6% -1.5% +4.2% +10.8% ➖ noise
97 duckdb:duckdb +4.8% -1.5% +6.5% +11.5% ➖ noise
97 duckdb:vortex-compact +4.2% -1.5% +5.8% +10.8% ➖ noise
97 duckdb:vortex-file-compressed +2.3% -1.5% +3.9% +15.2% ➖ noise
98 datafusion:vortex-compact +1.0% -0.5% +1.6% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +3.7% -0.5% +4.2% +10.0% ➖ noise
98 duckdb:duckdb +2.1% -0.5% +2.6% +16.0% ➖ noise
98 duckdb:vortex-compact -1.4% -0.5% -0.9% +10.5% ➖ noise
98 duckdb:vortex-file-compressed +3.6% -0.5% +4.2% +12.3% ➖ noise
99 datafusion:vortex-compact +1.6% +4.1% -2.5% +13.3% ➖ noise
99 datafusion:vortex-file-compressed -2.1% +4.1% -6.0% +13.8% ➖ noise
99 duckdb:duckdb -2.4% +4.1% -6.3% +37.0% ➖ noise
99 duckdb:vortex-compact +5.4% +4.1% +1.2% +20.2% ➖ noise
99 duckdb:vortex-file-compressed -0.8% +4.1% -4.8% +15.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.3%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +0.4%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 394299085 406077690 0.97
tpch_q02/datafusion:vortex-file-compressed 120671518 116652207 1.03
tpch_q03/datafusion:vortex-file-compressed 213761375 210012544 1.02
tpch_q04/datafusion:vortex-file-compressed 102591676 101880203 1.01
tpch_q05/datafusion:vortex-file-compressed 400227901 386245153 1.04
tpch_q06/datafusion:vortex-file-compressed 41959138 41215662 1.02
tpch_q07/datafusion:vortex-file-compressed 585712264 565046086 1.04
tpch_q08/datafusion:vortex-file-compressed 406720431 372204136 1.09
tpch_q09/datafusion:vortex-file-compressed 706377077 668585723 1.06
tpch_q10/datafusion:vortex-file-compressed 249473603 244142403 1.02
tpch_q11/datafusion:vortex-file-compressed 92861550 92097120 1.01
tpch_q12/datafusion:vortex-file-compressed 113015001 114212136 0.99
tpch_q13/datafusion:vortex-file-compressed 237518309 234014699 1.01
tpch_q14/datafusion:vortex-file-compressed 63261809 59993055 1.05
tpch_q15/datafusion:vortex-file-compressed 116813996 109505265 1.07
tpch_q16/datafusion:vortex-file-compressed 80974933 83769562 0.97
tpch_q17/datafusion:vortex-file-compressed 713330486 686731372 1.04
tpch_q18/datafusion:vortex-file-compressed 927563851 946193505 0.98
tpch_q19/datafusion:vortex-file-compressed 93120959 92085279 1.01
tpch_q20/datafusion:vortex-file-compressed 179449831 180526656 0.99
tpch_q21/datafusion:vortex-file-compressed 701749912 699267753 1.00
tpch_q22/datafusion:vortex-file-compressed 63136246 62869507 1.00
datafusion / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 448146187 453637653 0.99
tpch_q02/datafusion:vortex-compact 127024093 127161000 1.00
tpch_q03/datafusion:vortex-compact 225339285 231037488 0.98
tpch_q04/datafusion:vortex-compact 123472535 122071380 1.01
tpch_q05/datafusion:vortex-compact 409354899 417472671 0.98
tpch_q06/datafusion:vortex-compact 64865233 64103140 1.01
tpch_q07/datafusion:vortex-compact 600611511 630294050 0.95
tpch_q08/datafusion:vortex-compact 395527301 400677122 0.99
tpch_q09/datafusion:vortex-compact 708491704 703181160 1.01
tpch_q10/datafusion:vortex-compact 278272668 279030875 1.00
tpch_q11/datafusion:vortex-compact 92984832 92030041 1.01
tpch_q12/datafusion:vortex-compact 168476346 162963735 1.03
tpch_q13/datafusion:vortex-compact 276456491 267643940 1.03
tpch_q14/datafusion:vortex-compact 74873000 73910315 1.01
tpch_q15/datafusion:vortex-compact 168231721 161509456 1.04
tpch_q16/datafusion:vortex-compact 83892968 80890932 1.04
tpch_q17/datafusion:vortex-compact 665316684 660049315 1.01
tpch_q18/datafusion:vortex-compact 906941071 879308529 1.03
tpch_q19/datafusion:vortex-compact 133465621 138713032 0.96
tpch_q20/datafusion:vortex-compact 202980586 205839895 0.99
tpch_q21/datafusion:vortex-compact 722745913 716191045 1.01
tpch_q22/datafusion:vortex-compact 72910433 71750914 1.02
datafusion / parquet (1.049x ➖, 0↑ 2↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 453757777 420466727 1.08
tpch_q02/datafusion:parquet 193149709 186886084 1.03
tpch_q03/datafusion:parquet 307822180 293144835 1.05
tpch_q04/datafusion:parquet 137703332 134650537 1.02
tpch_q05/datafusion:parquet 468694065 445497426 1.05
tpch_q06/datafusion:parquet 118981967 118826780 1.00
tpch_q07/datafusion:parquet 651724431 626529975 1.04
tpch_q08/datafusion:parquet 532864604 493728187 1.08
tpch_q09/datafusion:parquet 🚨 846334250 766622610 1.10
tpch_q10/datafusion:parquet 534488574 496711043 1.08
tpch_q11/datafusion:parquet 142444802 134232656 1.06
tpch_q12/datafusion:parquet 225713487 206993926 1.09
tpch_q13/datafusion:parquet 355696376 339504327 1.05
tpch_q14/datafusion:parquet 🚨 167865910 151968888 1.10
tpch_q15/datafusion:parquet 256968292 245555523 1.05
tpch_q16/datafusion:parquet 142182121 138010606 1.03
tpch_q17/datafusion:parquet 732625610 700018394 1.05
tpch_q18/datafusion:parquet 936920650 881940994 1.06
tpch_q19/datafusion:parquet 283122108 268623897 1.05
tpch_q20/datafusion:parquet 320623950 305447482 1.05
tpch_q21/datafusion:parquet 770202035 736207912 1.05
tpch_q22/datafusion:parquet 215816769 234470672 0.92
datafusion / arrow (1.024x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 605602286 595814403 1.02
tpch_q02/datafusion:arrow 162662176 162221635 1.00
tpch_q03/datafusion:arrow 456350204 440813455 1.04
tpch_q04/datafusion:arrow 350464516 335010049 1.05
tpch_q05/datafusion:arrow 916820419 886620576 1.03
tpch_q06/datafusion:arrow 270067778 264283549 1.02
tpch_q07/datafusion:arrow 1131752844 1101434792 1.03
tpch_q08/datafusion:arrow 1112796094 1085937996 1.02
tpch_q09/datafusion:arrow 1325962153 1291909902 1.03
tpch_q10/datafusion:arrow 592780851 585920082 1.01
tpch_q11/datafusion:arrow 148319988 145811950 1.02
tpch_q12/datafusion:arrow 657789509 656737353 1.00
tpch_q13/datafusion:arrow 516151567 525847383 0.98
tpch_q14/datafusion:arrow 307651216 297359075 1.03
tpch_q15/datafusion:arrow 651473411 621450191 1.05
tpch_q16/datafusion:arrow 107578385 106032733 1.01
tpch_q17/datafusion:arrow 1316065443 1279940360 1.03
tpch_q18/datafusion:arrow 1802235867 1787906969 1.01
tpch_q19/datafusion:arrow 497575762 490905824 1.01
tpch_q20/datafusion:arrow 496883113 468651617 1.06
tpch_q21/datafusion:arrow 2886487789 2749397218 1.05
tpch_q22/datafusion:arrow 143088668 139299407 1.03
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 180430758 176716286 1.02
tpch_q02/duckdb:vortex-file-compressed 56496039 54358958 1.04
tpch_q03/duckdb:vortex-file-compressed 129525048 132135049 0.98
tpch_q04/duckdb:vortex-file-compressed 153289795 155782002 0.98
tpch_q05/duckdb:vortex-file-compressed 136274507 133808806 1.02
tpch_q06/duckdb:vortex-file-compressed 47402627 50134230 0.95
tpch_q07/duckdb:vortex-file-compressed 150282007 148858603 1.01
tpch_q08/duckdb:vortex-file-compressed 184832689 180091571 1.03
tpch_q09/duckdb:vortex-file-compressed 339639394 340310219 1.00
tpch_q10/duckdb:vortex-file-compressed 158839229 155602147 1.02
tpch_q11/duckdb:vortex-file-compressed 37806454 36937575 1.02
tpch_q12/duckdb:vortex-file-compressed 90088403 90107473 1.00
tpch_q13/duckdb:vortex-file-compressed 252051441 249376187 1.01
tpch_q14/duckdb:vortex-file-compressed 69504243 71902848 0.97
tpch_q15/duckdb:vortex-file-compressed 100942763 102288675 0.99
tpch_q16/duckdb:vortex-file-compressed 80339561 83030061 0.97
tpch_q17/duckdb:vortex-file-compressed 103176089 103455242 1.00
tpch_q18/duckdb:vortex-file-compressed 290724449 283662017 1.02
tpch_q19/duckdb:vortex-file-compressed 92226647 94200566 0.98
tpch_q20/duckdb:vortex-file-compressed 166014665 182341509 0.91
tpch_q21/duckdb:vortex-file-compressed 571973383 596952408 0.96
tpch_q22/duckdb:vortex-file-compressed 77836087 84084743 0.93
duckdb / vortex-compact (0.936x ➖, 1↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230074339 249892008 0.92
tpch_q02/duckdb:vortex-compact 60178631 65709973 0.92
tpch_q03/duckdb:vortex-compact 143031753 152311710 0.94
tpch_q04/duckdb:vortex-compact 177895020 188543874 0.94
tpch_q05/duckdb:vortex-compact 147462464 153831371 0.96
tpch_q06/duckdb:vortex-compact 83388516 86868125 0.96
tpch_q07/duckdb:vortex-compact 202044945 223546272 0.90
tpch_q08/duckdb:vortex-compact 198525354 213494239 0.93
tpch_q09/duckdb:vortex-compact 369456261 382946018 0.96
tpch_q10/duckdb:vortex-compact 188314671 206575614 0.91
tpch_q11/duckdb:vortex-compact 42393403 45425761 0.93
tpch_q12/duckdb:vortex-compact 201145674 213570772 0.94
tpch_q13/duckdb:vortex-compact 298640689 320548165 0.93
tpch_q14/duckdb:vortex-compact 105102750 112199952 0.94
tpch_q15/duckdb:vortex-compact 🚀 118573534 132529971 0.89
tpch_q16/duckdb:vortex-compact 85461612 92651318 0.92
tpch_q17/duckdb:vortex-compact 119417337 128095845 0.93
tpch_q18/duckdb:vortex-compact 300604997 305913618 0.98
tpch_q19/duckdb:vortex-compact 115573563 121804184 0.95
tpch_q20/duckdb:vortex-compact 211818916 224289449 0.94
tpch_q21/duckdb:vortex-compact 649766675 691972338 0.94
tpch_q22/duckdb:vortex-compact 90055237 96016534 0.94
duckdb / parquet (1.012x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260583956 262705652 0.99
tpch_q02/duckdb:parquet 105645708 98649747 1.07
tpch_q03/duckdb:parquet 218966539 208682463 1.05
tpch_q04/duckdb:parquet 136792425 133566558 1.02
tpch_q05/duckdb:parquet 220623148 220305437 1.00
tpch_q06/duckdb:parquet 68102115 68000287 1.00
tpch_q07/duckdb:parquet 179631483 186822310 0.96
tpch_q08/duckdb:parquet 260312863 256154337 1.02
tpch_q09/duckdb:parquet 464088480 468422404 0.99
tpch_q10/duckdb:parquet 615767211 615318773 1.00
tpch_q11/duckdb:parquet 45254154 45695912 0.99
tpch_q12/duckdb:parquet 129259951 126003488 1.03
tpch_q13/duckdb:parquet 🚨 466894902 407865757 1.14
tpch_q14/duckdb:parquet 174982699 174745384 1.00
tpch_q15/duckdb:parquet 101213700 101140893 1.00
tpch_q16/duckdb:parquet 160093076 160897203 1.00
tpch_q17/duckdb:parquet 180192967 177982813 1.01
tpch_q18/duckdb:parquet 359660148 353753949 1.02
tpch_q19/duckdb:parquet 283643431 280061075 1.01
tpch_q20/duckdb:parquet 220851829 229910871 0.96
tpch_q21/duckdb:parquet 582065969 575385525 1.01
tpch_q22/duckdb:parquet 291478494 289655388 1.01
duckdb / duckdb (0.949x ➖, 1↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 118217657 122346207 0.97
tpch_q02/duckdb:duckdb 47129887 48321622 0.98
tpch_q03/duckdb:duckdb 97642671 103966686 0.94
tpch_q04/duckdb:duckdb 133325175 143527479 0.93
tpch_q05/duckdb:duckdb 111940935 118711750 0.94
tpch_q06/duckdb:duckdb 40263375 41318167 0.97
tpch_q07/duckdb:duckdb 87172855 91501549 0.95
tpch_q08/duckdb:duckdb 112208294 116867547 0.96
tpch_q09/duckdb:duckdb 278197803 295467296 0.94
tpch_q10/duckdb:duckdb 208468826 220731223 0.94
tpch_q11/duckdb:duckdb 15802372 15948403 0.99
tpch_q12/duckdb:duckdb 84476985 88152348 0.96
tpch_q13/duckdb:duckdb 256209940 270379480 0.95
tpch_q14/duckdb:duckdb 71482032 75341993 0.95
tpch_q15/duckdb:duckdb 77863888 83397538 0.93
tpch_q16/duckdb:duckdb 73619406 76927680 0.96
tpch_q17/duckdb:duckdb 84799278 88257771 0.96
tpch_q18/duckdb:duckdb 215139055 228798138 0.94
tpch_q19/duckdb:duckdb 115954557 124470511 0.93
tpch_q20/duckdb:duckdb 110836167 117166063 0.95
tpch_q21/duckdb:duckdb 304304287 325304421 0.94
tpch_q22/duckdb:duckdb 🚀 65128495 72479085 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.6% +3.5% -1.8% +12.4% ➖ noise
1 datafusion:vortex-compact -1.2% +3.5% -4.5% +13.0% ➖ noise
1 datafusion:vortex-file-compressed -2.9% +3.5% -6.2% +14.6% ➖ noise
1 duckdb:duckdb -3.4% +3.5% -6.6% +12.2% ➖ noise
1 duckdb:vortex-compact -7.9% +3.5% -11.0% +12.2% ✅ faster
1 duckdb:vortex-file-compressed +2.1% +3.5% -1.3% +12.7% ➖ noise
2 datafusion:arrow +0.3% +5.2% -4.7% +10.0% ➖ noise
2 datafusion:vortex-compact -0.1% +5.2% -5.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +3.4% +5.2% -1.7% +10.0% ➖ noise
2 duckdb:duckdb -2.5% +5.2% -7.3% +13.5% ➖ noise
2 duckdb:vortex-compact -8.4% +5.2% -12.9% +10.0% ✅ faster
2 duckdb:vortex-file-compressed +3.9% +5.2% -1.2% +10.0% ➖ noise
3 datafusion:arrow +3.5% +5.0% -1.4% +10.0% ➖ noise
3 datafusion:vortex-compact -2.5% +5.0% -7.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.8% +5.0% -3.0% +10.0% ➖ noise
3 duckdb:duckdb -6.1% +5.0% -10.5% +10.0% ✅ faster
3 duckdb:vortex-compact -6.1% +5.0% -10.5% +10.0% ✅ faster
3 duckdb:vortex-file-compressed -2.0% +5.0% -6.6% +10.0% ➖ noise
4 datafusion:arrow +4.6% +2.3% +2.2% +10.0% ➖ noise
4 datafusion:vortex-compact +1.1% +2.3% -1.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.7% +2.3% -1.6% +10.0% ➖ noise
4 duckdb:duckdb -7.1% +2.3% -9.2% +10.0% ✅ faster
4 duckdb:vortex-compact -5.6% +2.3% -7.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.6% +2.3% -3.9% +10.0% ➖ noise
5 datafusion:arrow +3.4% +2.6% +0.7% +10.0% ➖ noise
5 datafusion:vortex-compact -1.9% +2.6% -4.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +3.6% +2.6% +1.0% +10.0% ➖ noise
5 duckdb:duckdb -5.7% +2.6% -8.1% +10.0% ➖ noise
5 duckdb:vortex-compact -4.1% +2.6% -6.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.8% +2.6% -0.8% +10.0% ➖ noise
6 datafusion:arrow +2.2% +0.1% +2.0% +10.0% ➖ noise
6 datafusion:vortex-compact +1.2% +0.1% +1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.8% +0.1% +1.7% +10.0% ➖ noise
6 duckdb:duckdb -2.6% +0.1% -2.7% +16.2% ➖ noise
6 duckdb:vortex-compact -4.0% +0.1% -4.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -5.4% +0.1% -5.6% +12.4% ➖ noise
7 datafusion:arrow +2.8% +0.0% +2.7% +10.0% ➖ noise
7 datafusion:vortex-compact -4.7% +0.0% -4.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +3.7% +0.0% +3.6% +10.0% ➖ noise
7 duckdb:duckdb -4.7% +0.0% -4.7% +10.0% ➖ noise
7 duckdb:vortex-compact -9.6% +0.0% -9.6% +10.0% ✅ faster
7 duckdb:vortex-file-compressed +1.0% +0.0% +0.9% +10.0% ➖ noise
8 datafusion:arrow +2.5% +4.7% -2.2% +10.0% ➖ noise
8 datafusion:vortex-compact -1.3% +4.7% -5.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +9.3% +4.7% +4.3% +10.0% ➖ noise
8 duckdb:duckdb -4.0% +4.7% -8.3% +10.0% ➖ noise
8 duckdb:vortex-compact -7.0% +4.7% -11.2% +10.0% ✅ faster
8 duckdb:vortex-file-compressed +2.6% +4.7% -2.0% +10.0% ➖ noise
9 datafusion:arrow +2.6% +4.6% -1.9% +10.0% ➖ noise
9 datafusion:vortex-compact +0.8% +4.6% -3.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +5.7% +4.6% +1.0% +10.0% ➖ noise
9 duckdb:duckdb -5.8% +4.6% -10.0% +10.0% ✅ faster
9 duckdb:vortex-compact -3.5% +4.6% -7.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% +4.6% -4.6% +10.0% ➖ noise
10 datafusion:arrow +1.2% +3.8% -2.5% +10.0% ➖ noise
10 datafusion:vortex-compact -0.3% +3.8% -3.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.2% +3.8% -1.5% +10.0% ➖ noise
10 duckdb:duckdb -5.6% +3.8% -9.0% +10.0% ➖ noise
10 duckdb:vortex-compact -8.8% +3.8% -12.2% +10.0% ✅ faster
10 duckdb:vortex-file-compressed +2.1% +3.8% -1.6% +10.0% ➖ noise
11 datafusion:arrow +1.7% +2.5% -0.8% +10.0% ➖ noise
11 datafusion:vortex-compact +1.0% +2.5% -1.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.8% +2.5% -1.6% +10.4% ➖ noise
11 duckdb:duckdb -0.9% +2.5% -3.3% +18.6% ➖ noise
11 duckdb:vortex-compact -6.7% +2.5% -9.0% +14.8% ➖ noise
11 duckdb:vortex-file-compressed +2.4% +2.5% -0.2% +12.4% ➖ noise
12 datafusion:arrow +0.2% +5.8% -5.3% +49.4% ➖ noise
12 datafusion:vortex-compact +3.4% +5.8% -2.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.0% +5.8% -6.4% +10.0% ➖ noise
12 duckdb:duckdb -4.2% +5.8% -9.4% +10.0% ✅ faster
12 duckdb:vortex-compact -5.8% +5.8% -11.0% +10.0% ✅ faster
12 duckdb:vortex-file-compressed -0.0% +5.8% -5.5% +10.0% ➖ noise
13 datafusion:arrow -1.8% +9.5% -10.4% +10.0% ✅ faster
13 datafusion:vortex-compact +3.3% +9.5% -5.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.5% +9.5% -7.3% +10.0% ➖ noise
13 duckdb:duckdb -5.2% +9.5% -13.5% +10.0% ✅ faster
13 duckdb:vortex-compact -6.8% +9.5% -14.9% +10.0% ✅ faster
13 duckdb:vortex-file-compressed +1.1% +9.5% -7.7% +10.0% ➖ noise
14 datafusion:arrow +3.5% +5.2% -1.6% +10.0% ➖ noise
14 datafusion:vortex-compact +1.3% +5.2% -3.7% +10.3% ➖ noise
14 datafusion:vortex-file-compressed +5.4% +5.2% +0.3% +16.7% ➖ noise
14 duckdb:duckdb -5.1% +5.2% -9.8% +10.0% ✅ faster
14 duckdb:vortex-compact -6.3% +5.2% -10.9% +10.0% ✅ faster
14 duckdb:vortex-file-compressed -3.3% +5.2% -8.1% +10.3% ➖ noise
15 datafusion:arrow +4.8% +2.3% +2.4% +10.0% ➖ noise
15 datafusion:vortex-compact +4.2% +2.3% +1.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +6.7% +2.3% +4.2% +10.0% ➖ noise
15 duckdb:duckdb -6.6% +2.3% -8.8% +10.0% ➖ noise
15 duckdb:vortex-compact -10.5% +2.3% -12.6% +10.0% ✅ faster
15 duckdb:vortex-file-compressed -1.3% +2.3% -3.6% +10.0% ➖ noise
16 datafusion:arrow +1.5% +1.2% +0.2% +21.2% ➖ noise
16 datafusion:vortex-compact +3.7% +1.2% +2.4% +11.1% ➖ noise
16 datafusion:vortex-file-compressed -3.3% +1.2% -4.5% +12.0% ➖ noise
16 duckdb:duckdb -4.3% +1.2% -5.5% +11.2% ➖ noise
16 duckdb:vortex-compact -7.8% +1.2% -8.9% +11.9% ➖ noise
16 duckdb:vortex-file-compressed -3.2% +1.2% -4.4% +11.2% ➖ noise
17 datafusion:arrow +2.8% +2.9% -0.1% +10.0% ➖ noise
17 datafusion:vortex-compact +0.8% +2.9% -2.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +3.9% +2.9% +0.9% +10.0% ➖ noise
17 duckdb:duckdb -3.9% +2.9% -6.7% +10.0% ➖ noise
17 duckdb:vortex-compact -6.8% +2.9% -9.4% +10.0% ✅ faster
17 duckdb:vortex-file-compressed -0.3% +2.9% -3.1% +10.0% ➖ noise
18 datafusion:arrow +0.8% +3.9% -3.0% +10.0% ➖ noise
18 datafusion:vortex-compact +3.1% +3.9% -0.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.0% +3.9% -5.7% +10.0% ➖ noise
18 duckdb:duckdb -6.0% +3.9% -9.5% +10.0% ✅ faster
18 duckdb:vortex-compact -1.7% +3.9% -5.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.5% +3.9% -1.4% +10.0% ➖ noise
19 datafusion:arrow +1.4% +3.3% -1.9% +10.0% ➖ noise
19 datafusion:vortex-compact -3.8% +3.3% -6.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.1% +3.3% -2.1% +10.0% ➖ noise
19 duckdb:duckdb -6.8% +3.3% -9.8% +10.0% ✅ faster
19 duckdb:vortex-compact -5.1% +3.3% -8.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.1% +3.3% -5.2% +10.0% ➖ noise
20 datafusion:arrow +6.0% +0.4% +5.6% +10.0% ➖ noise
20 datafusion:vortex-compact -1.4% +0.4% -1.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -0.6% +0.4% -1.0% +10.0% ➖ noise
20 duckdb:duckdb -5.4% +0.4% -5.8% +10.0% ➖ noise
20 duckdb:vortex-compact -5.6% +0.4% -6.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -9.0% +0.4% -9.3% +10.0% ✅ faster
21 datafusion:arrow +5.0% +2.9% +2.1% +10.0% ➖ noise
21 datafusion:vortex-compact +0.9% +2.9% -1.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.4% +2.9% -2.4% +10.0% ➖ noise
21 duckdb:duckdb -6.5% +2.9% -9.1% +10.0% ➖ noise
21 duckdb:vortex-compact -6.1% +2.9% -8.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -4.2% +2.9% -6.9% +10.0% ➖ noise
22 datafusion:arrow +2.7% -3.8% +6.7% +10.0% ➖ noise
22 datafusion:vortex-compact +1.6% -3.8% +5.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.4% -3.8% +4.3% +10.0% ➖ noise
22 duckdb:duckdb -10.1% -3.8% -6.6% +10.0% ➖ noise
22 duckdb:vortex-compact -6.2% -3.8% -2.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -7.4% -3.8% -3.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.9%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 1.019x ➖
Shifts: Parquet (control) +1.9% · Median polish +0.2%


datafusion / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 212877847 203319736 1.05
tpch_q02/datafusion:vortex-file-compressed 401535404 414419444 0.97
tpch_q03/datafusion:vortex-file-compressed 352828058 340354565 1.04
tpch_q04/datafusion:vortex-file-compressed 191789783 190416748 1.01
tpch_q05/datafusion:vortex-file-compressed 366070807 377855217 0.97
tpch_q06/datafusion:vortex-file-compressed 278392955 257430866 1.08
tpch_q07/datafusion:vortex-file-compressed 363086210 366439482 0.99
tpch_q08/datafusion:vortex-file-compressed 608132036 522922254 1.16
tpch_q09/datafusion:vortex-file-compressed 326418968 315671417 1.03
tpch_q10/datafusion:vortex-file-compressed 407666047 394831471 1.03
tpch_q11/datafusion:vortex-file-compressed 287933442 289483066 0.99
tpch_q12/datafusion:vortex-file-compressed 313240148 304349855 1.03
tpch_q13/datafusion:vortex-file-compressed 177661746 210710513 0.84
tpch_q14/datafusion:vortex-file-compressed 204032673 178883957 1.14
tpch_q15/datafusion:vortex-file-compressed 298397412 296143396 1.01
tpch_q16/datafusion:vortex-file-compressed 201275292 187438565 1.07
tpch_q17/datafusion:vortex-file-compressed 312655785 295104991 1.06
tpch_q18/datafusion:vortex-file-compressed 283204930 244539981 1.16
tpch_q19/datafusion:vortex-file-compressed 360912180 333155661 1.08
tpch_q20/datafusion:vortex-file-compressed 342265809 371246484 0.92
tpch_q21/datafusion:vortex-file-compressed 440311911 478117923 0.92
tpch_q22/datafusion:vortex-file-compressed 148362322 185078281 0.80
datafusion / vortex-compact (1.028x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 288586019 277144649 1.04
tpch_q02/datafusion:vortex-compact 425000101 444318622 0.96
tpch_q03/datafusion:vortex-compact 🚨 539241958 408469837 1.32
tpch_q04/datafusion:vortex-compact 237575300 240883191 0.99
tpch_q05/datafusion:vortex-compact 419504432 350583827 1.20
tpch_q06/datafusion:vortex-compact 383529679 313518936 1.22
tpch_q07/datafusion:vortex-compact 414795468 450032907 0.92
tpch_q08/datafusion:vortex-compact 499091922 487110609 1.02
tpch_q09/datafusion:vortex-compact 395453321 371013931 1.07
tpch_q10/datafusion:vortex-compact 416657214 409431827 1.02
tpch_q11/datafusion:vortex-compact 271474629 236300076 1.15
tpch_q12/datafusion:vortex-compact 379275278 405814435 0.93
tpch_q13/datafusion:vortex-compact 215812834 205598804 1.05
tpch_q14/datafusion:vortex-compact 247171967 248251340 1.00
tpch_q15/datafusion:vortex-compact 457521366 431933793 1.06
tpch_q16/datafusion:vortex-compact 175907513 203261186 0.87
tpch_q17/datafusion:vortex-compact 325589175 324945078 1.00
tpch_q18/datafusion:vortex-compact 296834389 278416027 1.07
tpch_q19/datafusion:vortex-compact 470028932 465362873 1.01
tpch_q20/datafusion:vortex-compact 432965546 443182878 0.98
tpch_q21/datafusion:vortex-compact 509422218 526320923 0.97
tpch_q22/datafusion:vortex-compact 152088345 167829369 0.91
datafusion / parquet (1.074x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 244563331 219196992 1.12
tpch_q02/datafusion:parquet 496229299 428798032 1.16
tpch_q03/datafusion:parquet 🚨 604598368 287738815 2.10
tpch_q04/datafusion:parquet 154907047 137729434 1.12
tpch_q05/datafusion:parquet 490197442 428211090 1.14
tpch_q06/datafusion:parquet 154951929 144443669 1.07
tpch_q07/datafusion:parquet 502550783 465045399 1.08
tpch_q08/datafusion:parquet 627235500 562934256 1.11
tpch_q09/datafusion:parquet 495939394 502986147 0.99
tpch_q10/datafusion:parquet 547339306 510382139 1.07
tpch_q11/datafusion:parquet 371227500 348642866 1.06
tpch_q12/datafusion:parquet 263078543 223500278 1.18
tpch_q13/datafusion:parquet 468516034 453318929 1.03
tpch_q14/datafusion:parquet 170872656 185235835 0.92
tpch_q15/datafusion:parquet 281608307 285182334 0.99
tpch_q16/datafusion:parquet 183555635 176028258 1.04
tpch_q17/datafusion:parquet 389251491 401325358 0.97
tpch_q18/datafusion:parquet 440676225 448977522 0.98
tpch_q19/datafusion:parquet 315488236 357977155 0.88
tpch_q20/datafusion:parquet 318794688 340606433 0.94
tpch_q21/datafusion:parquet 524073503 539897918 0.97
tpch_q22/datafusion:parquet 129472220 120068834 1.08
duckdb / vortex-file-compressed (0.945x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 277276215 264154879 1.05
tpch_q02/duckdb:vortex-file-compressed 910406805 959475116 0.95
tpch_q03/duckdb:vortex-file-compressed 622208741 625270293 1.00
tpch_q04/duckdb:vortex-file-compressed 352097797 361585096 0.97
tpch_q05/duckdb:vortex-file-compressed 857083831 884150845 0.97
tpch_q06/duckdb:vortex-file-compressed 411933624 415658269 0.99
tpch_q07/duckdb:vortex-file-compressed 781465630 737435796 1.06
tpch_q08/duckdb:vortex-file-compressed 864584861 1049787113 0.82
tpch_q09/duckdb:vortex-file-compressed 888036082 852776233 1.04
tpch_q10/duckdb:vortex-file-compressed 722172542 664794621 1.09
tpch_q11/duckdb:vortex-file-compressed 489223935 497975398 0.98
tpch_q12/duckdb:vortex-file-compressed 500184693 544336921 0.92
tpch_q13/duckdb:vortex-file-compressed 431975820 479191128 0.90
tpch_q14/duckdb:vortex-file-compressed 432904760 529746695 0.82
tpch_q15/duckdb:vortex-file-compressed 283412587 319752691 0.89
tpch_q16/duckdb:vortex-file-compressed 315355062 391271493 0.81
tpch_q17/duckdb:vortex-file-compressed 657641359 724626818 0.91
tpch_q18/duckdb:vortex-file-compressed 496547960 576184846 0.86
tpch_q19/duckdb:vortex-file-compressed 430470881 422196356 1.02
tpch_q20/duckdb:vortex-file-compressed 737671045 850039334 0.87
tpch_q21/duckdb:vortex-file-compressed 961226976 1090629371 0.88
tpch_q22/duckdb:vortex-file-compressed 341454989 312267381 1.09
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 261599148 297711260 0.88
tpch_q02/duckdb:vortex-compact 854267033 868815468 0.98
tpch_q03/duckdb:vortex-compact 582771175 576838991 1.01
tpch_q04/duckdb:vortex-compact 354012456 332697971 1.06
tpch_q05/duckdb:vortex-compact 773943220 855528741 0.90
tpch_q06/duckdb:vortex-compact 398266729 396671249 1.00
tpch_q07/duckdb:vortex-compact 690545189 744062294 0.93
tpch_q08/duckdb:vortex-compact 766866640 841050835 0.91
tpch_q09/duckdb:vortex-compact 830094317 863524917 0.96
tpch_q10/duckdb:vortex-compact 622625992 632296059 0.98
tpch_q11/duckdb:vortex-compact 468401158 446723861 1.05
tpch_q12/duckdb:vortex-compact 445974833 484840973 0.92
tpch_q13/duckdb:vortex-compact 458539641 460608415 1.00
tpch_q14/duckdb:vortex-compact 465632286 427337616 1.09
tpch_q15/duckdb:vortex-compact 271867565 239953267 1.13
tpch_q16/duckdb:vortex-compact 346689797 376256857 0.92
tpch_q17/duckdb:vortex-compact 609518528 603740741 1.01
tpch_q18/duckdb:vortex-compact 487370659 481137592 1.01
tpch_q19/duckdb:vortex-compact 404945968 447816097 0.90
tpch_q20/duckdb:vortex-compact 670979843 743630505 0.90
tpch_q21/duckdb:vortex-compact 1027092761 1028939925 1.00
tpch_q22/duckdb:vortex-compact 351741124 375709908 0.94
duckdb / parquet (0.967x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 508809634 516066532 0.99
tpch_q02/duckdb:parquet 1312948655 1469484616 0.89
tpch_q03/duckdb:parquet 1108819840 1046200908 1.06
tpch_q04/duckdb:parquet 698027851 679532020 1.03
tpch_q05/duckdb:parquet 1484358973 1565853246 0.95
tpch_q06/duckdb:parquet 396317535 419746935 0.94
tpch_q07/duckdb:parquet 1155867727 1311481659 0.88
tpch_q08/duckdb:parquet 1538703292 1736729321 0.89
tpch_q09/duckdb:parquet 1419651248 1458749456 0.97
tpch_q10/duckdb:parquet 1379887912 1327768408 1.04
tpch_q11/duckdb:parquet 811659585 872322572 0.93
tpch_q12/duckdb:parquet 640007567 722669534 0.89
tpch_q13/duckdb:parquet 902837123 959200200 0.94
tpch_q14/duckdb:parquet 665119303 638333631 1.04
tpch_q15/duckdb:parquet 491421809 502735776 0.98
tpch_q16/duckdb:parquet 525822598 584828358 0.90
tpch_q17/duckdb:parquet 774148571 732082457 1.06
tpch_q18/duckdb:parquet 922552557 862495350 1.07
tpch_q19/duckdb:parquet 848787959 798108040 1.06
tpch_q20/duckdb:parquet 969065593 1076451957 0.90
tpch_q21/duckdb:parquet 1214858924 1227525585 0.99
tpch_q22/duckdb:parquet 467099707 505452674 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.1% +4.9% -0.7% +133.6% ➖ noise
1 datafusion:vortex-file-compressed +4.7% +4.9% -0.2% +149.9% ➖ noise
1 duckdb:vortex-compact -12.1% +4.9% -16.2% +38.4% ➖ noise
1 duckdb:vortex-file-compressed +5.0% +4.9% +0.1% +38.0% ➖ noise
2 datafusion:vortex-compact -4.3% +1.7% -5.9% +58.1% ➖ noise
2 datafusion:vortex-file-compressed -3.1% +1.7% -4.7% +38.4% ➖ noise
2 duckdb:vortex-compact -1.7% +1.7% -3.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -5.1% +1.7% -6.7% +30.0% ➖ noise
3 datafusion:vortex-compact +32.0% +49.2% -11.5% +80.0% ➖ noise
3 datafusion:vortex-file-compressed +3.7% +49.2% -30.5% +110.4% ➖ noise
3 duckdb:vortex-compact +1.0% +49.2% -32.3% +41.4% ✅ faster
3 duckdb:vortex-file-compressed -0.5% +49.2% -33.3% +42.9% ✅ faster
4 datafusion:vortex-compact -1.4% +7.5% -8.2% +59.7% ➖ noise
4 datafusion:vortex-file-compressed +0.7% +7.5% -6.3% +30.0% ➖ noise
4 duckdb:vortex-compact +6.4% +7.5% -1.0% +36.0% ➖ noise
4 duckdb:vortex-file-compressed -2.6% +7.5% -9.4% +30.0% ➖ noise
5 datafusion:vortex-compact +19.7% +4.2% +14.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.1% +4.2% -7.0% +50.6% ➖ noise
5 duckdb:vortex-compact -9.5% +4.2% -13.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.1% +4.2% -6.9% +30.0% ➖ noise
6 datafusion:vortex-compact +22.3% +0.6% +21.6% +49.8% ➖ noise
6 datafusion:vortex-file-compressed +8.1% +0.6% +7.5% +51.8% ➖ noise
6 duckdb:vortex-compact +0.4% +0.6% -0.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -0.9% +0.6% -1.5% +34.1% ➖ noise
7 datafusion:vortex-compact -7.8% -2.4% -5.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.9% -2.4% +1.5% +30.0% ➖ noise
7 duckdb:vortex-compact -7.2% -2.4% -4.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +6.0% -2.4% +8.6% +30.0% ➖ noise
8 datafusion:vortex-compact +2.5% -0.6% +3.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +16.3% -0.6% +17.0% +34.6% ➖ noise
8 duckdb:vortex-compact -8.8% -0.6% -8.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -17.6% -0.6% -17.1% +30.0% ➖ noise
9 datafusion:vortex-compact +6.6% -2.0% +8.8% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +3.4% -2.0% +5.6% +40.5% ➖ noise
9 duckdb:vortex-compact -3.9% -2.0% -1.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +4.1% -2.0% +6.3% +30.0% ➖ noise
10 datafusion:vortex-compact +1.8% +5.6% -3.6% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +3.3% +5.6% -2.2% +30.0% ➖ noise
10 duckdb:vortex-compact -1.5% +5.6% -6.7% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +8.6% +5.6% +2.9% +32.8% ➖ noise
11 datafusion:vortex-compact +14.9% -0.5% +15.4% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -0.5% -0.5% -0.1% +30.0% ➖ noise
11 duckdb:vortex-compact +4.9% -0.5% +5.3% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -1.8% -0.5% -1.3% +30.0% ➖ noise
12 datafusion:vortex-compact -6.5% +2.1% -8.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +2.9% +2.1% +0.8% +49.4% ➖ noise
12 duckdb:vortex-compact -8.0% +2.1% -9.9% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -8.1% +2.1% -10.0% +38.4% ➖ noise
13 datafusion:vortex-compact +5.0% -1.4% +6.4% +67.8% ➖ noise
13 datafusion:vortex-file-compressed -15.7% -1.4% -14.5% +38.5% ➖ noise
13 duckdb:vortex-compact -0.4% -1.4% +0.9% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -9.9% -1.4% -8.6% +30.0% ➖ noise
14 datafusion:vortex-compact -0.4% -2.0% +1.6% +36.1% ➖ noise
14 datafusion:vortex-file-compressed +14.1% -2.0% +16.3% +39.6% ➖ noise
14 duckdb:vortex-compact +9.0% -2.0% +11.1% +41.1% ➖ noise
14 duckdb:vortex-file-compressed -18.3% -2.0% -16.6% +36.0% ➖ noise
15 datafusion:vortex-compact +5.9% -1.8% +7.8% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +0.8% -1.8% +2.6% +30.0% ➖ noise
15 duckdb:vortex-compact +13.3% -1.8% +15.3% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -11.4% -1.8% -9.8% +30.5% ➖ noise
16 datafusion:vortex-compact -13.5% -3.2% -10.6% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +7.4% -3.2% +10.9% +30.0% ➖ noise
16 duckdb:vortex-compact -7.9% -3.2% -4.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -19.4% -3.2% -16.8% +30.0% ➖ noise
17 datafusion:vortex-compact +0.2% +1.3% -1.1% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +5.9% +1.3% +4.6% +55.5% ➖ noise
17 duckdb:vortex-compact +1.0% +1.3% -0.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -9.2% +1.3% -10.4% +30.0% ➖ noise
18 datafusion:vortex-compact +6.6% +2.5% +4.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +15.8% +2.5% +13.0% +30.0% ➖ noise
18 duckdb:vortex-compact +1.3% +2.5% -1.1% +31.3% ➖ noise
18 duckdb:vortex-file-compressed -13.8% +2.5% -15.9% +30.0% ➖ noise
19 datafusion:vortex-compact +1.0% -3.2% +4.3% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +8.3% -3.2% +11.9% +30.0% ➖ noise
19 duckdb:vortex-compact -9.6% -3.2% -6.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +2.0% -3.2% +5.3% +30.0% ➖ noise
20 datafusion:vortex-compact -2.3% -8.2% +6.4% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -7.8% -8.2% +0.4% +30.0% ➖ noise
20 duckdb:vortex-compact -9.8% -8.2% -1.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -13.2% -8.2% -5.5% +30.0% ➖ noise
21 datafusion:vortex-compact -3.2% -2.0% -1.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -7.9% -2.0% -6.0% +30.0% ➖ noise
21 duckdb:vortex-compact -0.2% -2.0% +1.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -11.9% -2.0% -10.1% +30.0% ➖ noise
22 datafusion:vortex-compact -9.4% -0.2% -9.2% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -19.8% -0.2% -19.7% +30.0% ➖ noise
22 duckdb:vortex-compact -6.4% -0.2% -6.2% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +9.3% -0.2% +9.5% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 13, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish -2.0%


datafusion / vortex-file-compressed (0.846x ➖, 2↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 27351588 34411532 0.79
fineweb_q01/datafusion:vortex-file-compressed 🚀 723147447 1168083512 0.62
fineweb_q02/datafusion:vortex-file-compressed 🚀 507534941 842053600 0.60
fineweb_q03/datafusion:vortex-file-compressed 1511539792 1382956860 1.09
fineweb_q04/datafusion:vortex-file-compressed 1452824005 1362294483 1.07
fineweb_q05/datafusion:vortex-file-compressed 1456379568 1419339899 1.03
fineweb_q06/datafusion:vortex-file-compressed 1524106527 1663064693 0.92
fineweb_q07/datafusion:vortex-file-compressed 1385172579 1698398192 0.82
fineweb_q08/datafusion:vortex-file-compressed 572387051 686155631 0.83
datafusion / vortex-compact (0.974x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35717519 37113259 0.96
fineweb_q01/datafusion:vortex-compact 542555893 518005060 1.05
fineweb_q02/datafusion:vortex-compact 642657022 649685593 0.99
fineweb_q03/datafusion:vortex-compact 1848128243 1895618377 0.97
fineweb_q04/datafusion:vortex-compact 2212202854 2358406640 0.94
fineweb_q05/datafusion:vortex-compact 1693786141 1745846800 0.97
fineweb_q06/datafusion:vortex-compact 1418026969 1501532851 0.94
fineweb_q07/datafusion:vortex-compact 1293816358 1324780787 0.98
fineweb_q08/datafusion:vortex-compact 407526096 422249138 0.97
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1021076611 1028151887 0.99
fineweb_q01/datafusion:parquet 1662372237 1767920082 0.94
fineweb_q02/datafusion:parquet 1677630656 1758027564 0.95
fineweb_q03/datafusion:parquet 1830335848 1723698474 1.06
fineweb_q04/datafusion:parquet 1737752259 1771910793 0.98
fineweb_q05/datafusion:parquet 1798056820 1763868439 1.02
fineweb_q06/datafusion:parquet 1624253499 1710898594 0.95
fineweb_q07/datafusion:parquet 1694977870 1756116627 0.97
fineweb_q08/datafusion:parquet 2013825004 1822754658 1.10
duckdb / vortex-file-compressed (1.097x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 83435599 56416106 1.48
fineweb_q01/duckdb:vortex-file-compressed 534278165 581134069 0.92
fineweb_q02/duckdb:vortex-file-compressed 462164058 454835041 1.02
fineweb_q03/duckdb:vortex-file-compressed 1581522470 1429905604 1.11
fineweb_q04/duckdb:vortex-file-compressed 1640820870 1429244423 1.15
fineweb_q05/duckdb:vortex-file-compressed 1485863873 1436570509 1.03
fineweb_q06/duckdb:vortex-file-compressed 1579785175 1581638380 1.00
fineweb_q07/duckdb:vortex-file-compressed 1494617388 1407165470 1.06
fineweb_q08/duckdb:vortex-file-compressed 731871964 611024358 1.20
duckdb / vortex-compact (1.076x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 88475102 61977876 1.43
fineweb_q01/duckdb:vortex-compact 508188653 513262665 0.99
fineweb_q02/duckdb:vortex-compact 564778864 571284243 0.99
fineweb_q03/duckdb:vortex-compact 1703822954 1552676542 1.10
fineweb_q04/duckdb:vortex-compact 1708452317 1539369672 1.11
fineweb_q05/duckdb:vortex-compact 1545017889 1506020826 1.03
fineweb_q06/duckdb:vortex-compact 1481213902 1449944905 1.02
fineweb_q07/duckdb:vortex-compact 1388986224 1283453213 1.08
fineweb_q08/duckdb:vortex-compact 459311256 456963197 1.01
duckdb / parquet (0.978x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1050480447 1128224151 0.93
fineweb_q01/duckdb:parquet 1579503602 1639293904 0.96
fineweb_q02/duckdb:parquet 1636509463 1636485387 1.00
fineweb_q03/duckdb:parquet 3960648903 3959427088 1.00
fineweb_q04/duckdb:parquet 1803322423 1799451108 1.00
fineweb_q05/duckdb:parquet 2517268366 2690412101 0.94
fineweb_q06/duckdb:parquet 3308525678 3388410317 0.98
fineweb_q07/duckdb:parquet 3964954343 3863729916 1.03
fineweb_q08/duckdb:parquet 1050405087 1081320035 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -3.8% -3.8% +0.1% +272.2% ➖ noise
0 datafusion:vortex-file-compressed -20.5% -3.8% -17.3% +161.2% ➖ noise
0 duckdb:vortex-compact +42.8% -3.8% +48.5% +59.1% ➖ noise
0 duckdb:vortex-file-compressed +47.9% -3.8% +53.8% +55.7% ➖ noise
1 datafusion:vortex-compact +4.7% -4.8% +10.0% +76.7% ➖ noise
1 datafusion:vortex-file-compressed -38.1% -4.8% -35.0% +138.2% ➖ noise
1 duckdb:vortex-compact -1.0% -4.8% +4.0% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -8.1% -4.8% -3.4% +30.0% ➖ noise
2 datafusion:vortex-compact -1.1% -2.3% +1.3% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -39.7% -2.3% -38.3% +42.7% ✅ faster
2 duckdb:vortex-compact -1.1% -2.3% +1.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +1.6% -2.3% +4.0% +30.0% ➖ noise
3 datafusion:vortex-compact -2.5% +3.1% -5.4% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +9.3% +3.1% +6.0% +30.0% ➖ noise
3 duckdb:vortex-compact +9.7% +3.1% +6.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +10.6% +3.1% +7.3% +30.0% ➖ noise
4 datafusion:vortex-compact -6.2% -0.9% -5.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +6.6% -0.9% +7.6% +30.0% ➖ noise
4 duckdb:vortex-compact +11.0% -0.9% +11.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +14.8% -0.9% +15.8% +30.0% ➖ noise
5 datafusion:vortex-compact -3.0% -2.3% -0.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.6% -2.3% +5.1% +30.0% ➖ noise
5 duckdb:vortex-compact +2.6% -2.3% +5.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +3.4% -2.3% +5.9% +30.0% ➖ noise
6 datafusion:vortex-compact -5.6% -3.7% -1.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -8.4% -3.7% -4.8% +30.0% ➖ noise
6 duckdb:vortex-compact +2.2% -3.7% +6.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -3.7% +3.7% +30.0% ➖ noise
7 datafusion:vortex-compact -2.3% -0.5% -1.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -18.4% -0.5% -18.1% +30.0% ➖ noise
7 duckdb:vortex-compact +8.2% -0.5% +8.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +6.2% -0.5% +6.7% +30.0% ➖ noise
8 datafusion:vortex-compact -3.5% +3.6% -6.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -16.6% +3.6% -19.5% +49.7% ➖ noise
8 duckdb:vortex-compact +0.5% +3.6% -3.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +19.8% +3.6% +15.6% +33.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.8%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +2.9%


duckdb / vortex-file-compressed (1.074x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11231442 10608687 1.06
statpopgen_q01/duckdb:vortex-file-compressed 🚨 27670833 19224676 1.44
statpopgen_q02/duckdb:vortex-file-compressed 1357350833 1294686600 1.05
statpopgen_q03/duckdb:vortex-file-compressed 3173854951 3015838570 1.05
statpopgen_q04/duckdb:vortex-file-compressed 3154100358 3034896259 1.04
statpopgen_q05/duckdb:vortex-file-compressed 1423237787 1417484176 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2134935252 2068807968 1.03
statpopgen_q07/duckdb:vortex-file-compressed 230221400 217297792 1.06
statpopgen_q08/duckdb:vortex-file-compressed 247177019 231694047 1.07
statpopgen_q09/duckdb:vortex-file-compressed 2953533870 2889752356 1.02
statpopgen_q10/duckdb:vortex-file-compressed 4796090181 4595824613 1.04
duckdb / vortex-compact (0.936x ➖, 4↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11234902 10667712 1.05
statpopgen_q01/duckdb:vortex-compact 170387636 166882817 1.02
statpopgen_q02/duckdb:vortex-compact 1868049092 1822891254 1.02
statpopgen_q03/duckdb:vortex-compact 3604731375 3726596620 0.97
statpopgen_q04/duckdb:vortex-compact 3671913522 3924984606 0.94
statpopgen_q05/duckdb:vortex-compact 🚀 1913707616 2222180378 0.86
statpopgen_q06/duckdb:vortex-compact 🚀 2756924884 3358913244 0.82
statpopgen_q07/duckdb:vortex-compact 🚀 948314744 1182704447 0.80
statpopgen_q08/duckdb:vortex-compact 🚀 984970236 1203847305 0.82
statpopgen_q09/duckdb:vortex-compact 3480680968 3361756845 1.04
statpopgen_q10/duckdb:vortex-compact 5599699824 5565462791 1.01
duckdb / parquet (1.031x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 323224220 312832021 1.03
statpopgen_q01/duckdb:parquet 413070018 390827483 1.06
statpopgen_q02/duckdb:parquet 1039822919 1005612078 1.03
statpopgen_q03/duckdb:parquet 1552671315 1500351984 1.03
statpopgen_q04/duckdb:parquet 1547793549 1501041943 1.03
statpopgen_q05/duckdb:parquet 1039021119 1013725018 1.02
statpopgen_q06/duckdb:parquet 1504351812 1479007469 1.02
statpopgen_q07/duckdb:parquet 1941094527 1885528566 1.03
statpopgen_q08/duckdb:parquet 1955631803 1882560898 1.04
statpopgen_q09/duckdb:parquet 1431828219 1408253820 1.02
statpopgen_q10/duckdb:parquet 2736862913 2674225147 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +5.3% +3.3% +1.9% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +5.9% +3.3% +2.5% +11.5% ➖ noise
1 duckdb:vortex-compact +2.1% +5.7% -3.4% +27.6% ➖ noise
1 duckdb:vortex-file-compressed +43.9% +5.7% +36.2% +200.4% ➖ noise
2 duckdb:vortex-compact +2.5% +3.4% -0.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.8% +3.4% +1.4% +10.0% ➖ noise
3 duckdb:vortex-compact -3.3% +3.5% -6.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.2% +3.5% +1.7% +10.0% ➖ noise
4 duckdb:vortex-compact -6.4% +3.1% -9.3% +10.0% ✅ faster
4 duckdb:vortex-file-compressed +3.9% +3.1% +0.8% +10.0% ➖ noise
5 duckdb:vortex-compact -13.9% +2.5% -16.0% +10.0% ✅ faster
5 duckdb:vortex-file-compressed +0.4% +2.5% -2.0% +10.0% ➖ noise
6 duckdb:vortex-compact -17.9% +1.7% -19.3% +10.0% ✅ faster
6 duckdb:vortex-file-compressed +3.2% +1.7% +1.5% +10.0% ➖ noise
7 duckdb:vortex-compact -19.8% +2.9% -22.1% +10.0% ✅ faster
7 duckdb:vortex-file-compressed +5.9% +2.9% +2.9% +29.1% ➖ noise
8 duckdb:vortex-compact -18.2% +3.9% -21.2% +11.3% ✅ faster
8 duckdb:vortex-file-compressed +6.7% +3.9% +2.7% +10.0% ➖ noise
9 duckdb:vortex-compact +3.5% +1.7% +1.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.2% +1.7% +0.5% +10.0% ➖ noise
10 duckdb:vortex-compact +0.6% +2.3% -1.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.4% +2.3% +2.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026

Benchmarks: Compression

Vortex (geomean): 1.014x ➖
Parquet (geomean): 1.004x ➖


unknown / unknown (1.006x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
compress time/Arade 1156138982 1125437148 1.03
compress time/Bimbo 7048734159 6981100090 1.01
compress time/CMSprovider 3084037228 2879486649 1.07
compress time/Euro2016 425568929 424358338 1.00
compress time/Food 394993764 378894937 1.04
compress time/HashTags 815666382 783899448 1.04
compress time/TPC-H l_comment canonical 1304675244 1250585458 1.04
compress time/TPC-H l_comment chunked 1323439714 1279297761 1.03
compress time/taxi 713469391 708658948 1.01
compress time/wide table cols=100 chunks=1 rows=1000 13319124 12390793 1.07
compress time/wide table cols=100 chunks=50 rows=1000 12653126 13895950 0.91
compress time/wide table cols=1000 chunks=1 rows=1000 136426848 134522484 1.01
compress time/wide table cols=1000 chunks=50 rows=1000 138764116 136924277 1.01
compress time/wide table cols=10000 chunks=1 rows=1000 1404878967 1429878255 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1391077849 1432239190 0.97
decompress time/Arade 31025696 29727406 1.04
decompress time/Bimbo 115373215 114495802 1.01
decompress time/CMSprovider 84594919 85388909 0.99
decompress time/Euro2016 20953920 19827466 1.06
decompress time/Food 9239829 8504446 1.09
decompress time/HashTags 76178052 81023847 0.94
decompress time/TPC-H l_comment canonical 42579066 41573792 1.02
decompress time/TPC-H l_comment chunked 41618034 41426290 1.00
decompress time/taxi 20172745 21171016 0.95
decompress time/wide table cols=100 chunks=1 rows=1000 2585000 2576390 1.00
decompress time/wide table cols=100 chunks=50 rows=1000 2614379 2582363 1.01
decompress time/wide table cols=1000 chunks=1 rows=1000 23453748 22533235 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 22795118 23288548 0.98
decompress time/wide table cols=10000 chunks=1 rows=1000 236242635 231824810 1.02
decompress time/wide table cols=10000 chunks=50 rows=1000 235459896 234704930 1.00
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3021655062 3016163129 1.00
parquet_rs-zstd compress time/Bimbo 17279448389 17223880675 1.00
parquet_rs-zstd compress time/CMSprovider 7646321786 7745094136 0.99
parquet_rs-zstd compress time/Euro2016 1335432372 1339817149 1.00
parquet_rs-zstd compress time/Food 926331357 936428738 0.99
parquet_rs-zstd compress time/HashTags 2451470388 2475973067 0.99
parquet_rs-zstd compress time/TPC-H l_comment canonical 3085898079 3083855236 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3111064189 3066767889 1.01
parquet_rs-zstd compress time/taxi 1510378896 1517538484 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6715659 6578773 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6724406 6817880 0.99
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 87773557 91098785 0.96
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 90568066 91019076 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 887464703 888750564 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 877505850 910317843 0.96
parquet_rs-zstd decompress time/Arade 642353945 648826356 0.99
parquet_rs-zstd decompress time/Bimbo 1718716587 1752425716 0.98
parquet_rs-zstd decompress time/CMSprovider 1918595026 1938116553 0.99
parquet_rs-zstd decompress time/Euro2016 386171233 388959914 0.99
parquet_rs-zstd decompress time/Food 216392208 223849493 0.97
parquet_rs-zstd decompress time/HashTags 621724072 637458343 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 570237209 561280702 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 572711798 563223799 1.02
parquet_rs-zstd decompress time/taxi 244116154 247756707 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2537393 2683935 0.95
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2574700 2715174 0.95
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31865763 33577799 0.95
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31107700 32381844 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 368930747 379224822 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 366913446 370966707 0.99
vortex-file-compressed size/Arade 143387436 143387436 1.00
vortex-file-compressed size/Bimbo 457703724 457703724 1.00
vortex-file-compressed size/CMSprovider 422234284 422234284 1.00
vortex-file-compressed size/Euro2016 164460204 164459636 1.00
vortex-file-compressed size/Food 42374944 42374944 1.00
vortex-file-compressed size/HashTags 195781844 195781844 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179471576 179471576 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179471576 179471576 1.00
vortex-file-compressed size/taxi 50083652 50083652 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 876416 876416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 876416 876416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8749616 8749616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8749616 8749616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 87517616 87517616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 87517616 87517616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.03
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.08
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 0 0 1.05
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.05
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.05
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 2 0.92
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.05
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.05
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.03
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 1.029x ➖
Parquet (geomean): 1.038x ➖
Shifts: Parquet (control) +3.8% · Median polish +5.4%


datafusion / vortex-file-compressed (1.053x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 706770159 667389916 1.06
tpch_q02/datafusion:vortex-file-compressed 754560185 680316859 1.11
tpch_q03/datafusion:vortex-file-compressed 785455042 783347664 1.00
tpch_q04/datafusion:vortex-file-compressed 551208879 559093850 0.99
tpch_q05/datafusion:vortex-file-compressed 1059803739 960291415 1.10
tpch_q06/datafusion:vortex-file-compressed 669739674 637468523 1.05
tpch_q07/datafusion:vortex-file-compressed 1066906440 1041026461 1.02
tpch_q08/datafusion:vortex-file-compressed 🚨 1450090900 1101186115 1.32
tpch_q09/datafusion:vortex-file-compressed 1579581817 1283426500 1.23
tpch_q10/datafusion:vortex-file-compressed 1121780565 960712068 1.17
tpch_q11/datafusion:vortex-file-compressed 581977118 456554647 1.27
tpch_q12/datafusion:vortex-file-compressed 874127019 836702508 1.04
tpch_q13/datafusion:vortex-file-compressed 440980056 412507130 1.07
tpch_q14/datafusion:vortex-file-compressed 606562211 553808447 1.10
tpch_q15/datafusion:vortex-file-compressed 1167581278 1109647184 1.05
tpch_q16/datafusion:vortex-file-compressed 317241268 304707246 1.04
tpch_q17/datafusion:vortex-file-compressed 1193528285 1194835386 1.00
tpch_q18/datafusion:vortex-file-compressed 1365531013 1262501681 1.08
tpch_q19/datafusion:vortex-file-compressed 766183228 776355889 0.99
tpch_q20/datafusion:vortex-file-compressed 823922057 991567397 0.83
tpch_q21/datafusion:vortex-file-compressed 1601269588 1624758367 0.99
tpch_q22/datafusion:vortex-file-compressed 348441244 434267414 0.80
datafusion / vortex-compact (0.939x ➖, 2↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 703248977 698136216 1.01
tpch_q02/datafusion:vortex-compact 583563642 694097838 0.84
tpch_q03/datafusion:vortex-compact 706240216 664623910 1.06
tpch_q04/datafusion:vortex-compact 519729457 524247602 0.99
tpch_q05/datafusion:vortex-compact 885335090 888473606 1.00
tpch_q06/datafusion:vortex-compact 560993800 556294413 1.01
tpch_q07/datafusion:vortex-compact 1010232004 986764575 1.02
tpch_q08/datafusion:vortex-compact 1086488436 1149388418 0.95
tpch_q09/datafusion:vortex-compact 1283332786 1262904409 1.02
tpch_q10/datafusion:vortex-compact 1007977244 992759047 1.02
tpch_q11/datafusion:vortex-compact 440757325 432425190 1.02
tpch_q12/datafusion:vortex-compact 777314743 910424984 0.85
tpch_q13/datafusion:vortex-compact 415170073 437867243 0.95
tpch_q14/datafusion:vortex-compact 🚀 545507808 812079024 0.67
tpch_q15/datafusion:vortex-compact 982798653 1066818091 0.92
tpch_q16/datafusion:vortex-compact 341347083 343190342 0.99
tpch_q17/datafusion:vortex-compact 1222479524 1224609276 1.00
tpch_q18/datafusion:vortex-compact 1111800876 1129815235 0.98
tpch_q19/datafusion:vortex-compact 🚀 755077473 1167368304 0.65
tpch_q20/datafusion:vortex-compact 810567654 875874509 0.93
tpch_q21/datafusion:vortex-compact 1411492104 1479784456 0.95
tpch_q22/datafusion:vortex-compact 328680393 336445236 0.98
datafusion / parquet (1.033x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 862326075 826109488 1.04
tpch_q02/datafusion:parquet 671594580 591376660 1.14
tpch_q03/datafusion:parquet 924840468 932171733 0.99
tpch_q04/datafusion:parquet 538938048 418087355 1.29
tpch_q05/datafusion:parquet 1178595699 1123944352 1.05
tpch_q06/datafusion:parquet 470866560 532512656 0.88
tpch_q07/datafusion:parquet 1214308338 1217728861 1.00
tpch_q08/datafusion:parquet 1478927562 1567165619 0.94
tpch_q09/datafusion:parquet 1665211241 1693303744 0.98
tpch_q10/datafusion:parquet 1952082944 1898187334 1.03
tpch_q11/datafusion:parquet 494562284 464134423 1.07
tpch_q12/datafusion:parquet 633726204 638163856 0.99
tpch_q13/datafusion:parquet 696923422 703778076 0.99
tpch_q14/datafusion:parquet 730715293 741225093 0.99
tpch_q15/datafusion:parquet 1246699718 1220371485 1.02
tpch_q16/datafusion:parquet 378758938 342537781 1.11
tpch_q17/datafusion:parquet 1306311053 1416200303 0.92
tpch_q18/datafusion:parquet 1617366226 1650894073 0.98
tpch_q19/datafusion:parquet 1087343707 977761952 1.11
tpch_q20/datafusion:parquet 1377874060 1122692197 1.23
tpch_q21/datafusion:parquet 1790081195 1702511555 1.05
tpch_q22/datafusion:parquet 656936941 652871738 1.01
duckdb / vortex-file-compressed (1.070x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 665378488 610256339 1.09
tpch_q02/duckdb:vortex-file-compressed 1374057620 1162445343 1.18
tpch_q03/duckdb:vortex-file-compressed 985499490 916793207 1.07
tpch_q04/duckdb:vortex-file-compressed 787932208 710994592 1.11
tpch_q05/duckdb:vortex-file-compressed 1339106229 1039955581 1.29
tpch_q06/duckdb:vortex-file-compressed 859213058 794065569 1.08
tpch_q07/duckdb:vortex-file-compressed 1325700329 1079033756 1.23
tpch_q08/duckdb:vortex-file-compressed 1614195667 1576588032 1.02
tpch_q09/duckdb:vortex-file-compressed 1495795814 1359761413 1.10
tpch_q10/duckdb:vortex-file-compressed 1144625896 1143340681 1.00
tpch_q11/duckdb:vortex-file-compressed 693025963 646177480 1.07
tpch_q12/duckdb:vortex-file-compressed 728721334 695144319 1.05
tpch_q13/duckdb:vortex-file-compressed 1039506426 898273816 1.16
tpch_q14/duckdb:vortex-file-compressed 849587937 855471457 0.99
tpch_q15/duckdb:vortex-file-compressed 597782095 562655547 1.06
tpch_q16/duckdb:vortex-file-compressed 433006111 461149616 0.94
tpch_q17/duckdb:vortex-file-compressed 972689304 985662249 0.99
tpch_q18/duckdb:vortex-file-compressed 873238719 980349822 0.89
tpch_q19/duckdb:vortex-file-compressed 776042341 817787869 0.95
tpch_q20/duckdb:vortex-file-compressed 1390618832 1205482616 1.15
tpch_q21/duckdb:vortex-file-compressed 2001715147 1972053673 1.02
tpch_q22/duckdb:vortex-file-compressed 667992664 567919858 1.18
duckdb / vortex-compact (1.062x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 606797111 592676178 1.02
tpch_q02/duckdb:vortex-compact 1171169007 994199759 1.18
tpch_q03/duckdb:vortex-compact 912515062 772252687 1.18
tpch_q04/duckdb:vortex-compact 552571108 487504385 1.13
tpch_q05/duckdb:vortex-compact 1012358893 1023457466 0.99
tpch_q06/duckdb:vortex-compact 751964292 807273350 0.93
tpch_q07/duckdb:vortex-compact 1150422591 1062447227 1.08
tpch_q08/duckdb:vortex-compact 1326058123 1312274732 1.01
tpch_q09/duckdb:vortex-compact 1468041201 1358140415 1.08
tpch_q10/duckdb:vortex-compact 1119112817 1211420680 0.92
tpch_q11/duckdb:vortex-compact 721591301 611510188 1.18
tpch_q12/duckdb:vortex-compact 633829908 678016387 0.93
tpch_q13/duckdb:vortex-compact 910222773 850530433 1.07
tpch_q14/duckdb:vortex-compact 867188816 873322928 0.99
tpch_q15/duckdb:vortex-compact 568421590 544974557 1.04
tpch_q16/duckdb:vortex-compact 436509780 417739436 1.04
tpch_q17/duckdb:vortex-compact 963140881 878230405 1.10
tpch_q18/duckdb:vortex-compact 687181730 718492087 0.96
tpch_q19/duckdb:vortex-compact 769096516 714580624 1.08
tpch_q20/duckdb:vortex-compact 1311738753 1173440883 1.12
tpch_q21/duckdb:vortex-compact 1687954447 1650915787 1.02
tpch_q22/duckdb:vortex-compact 🚨 663798596 476521031 1.39
duckdb / parquet (1.043x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 922474497 1056097699 0.87
tpch_q02/duckdb:parquet 1417043416 1559337083 0.91
tpch_q03/duckdb:parquet 1408055851 1621632956 0.87
tpch_q04/duckdb:parquet 982189502 954335352 1.03
tpch_q05/duckdb:parquet 1965035550 2179931370 0.90
tpch_q06/duckdb:parquet 845357304 688576526 1.23
tpch_q07/duckdb:parquet 1728175587 1918380359 0.90
tpch_q08/duckdb:parquet 2409421149 2378920278 1.01
tpch_q09/duckdb:parquet 2291815851 2332162740 0.98
tpch_q10/duckdb:parquet 3314549373 2975163326 1.11
tpch_q11/duckdb:parquet 996316323 1053946198 0.95
tpch_q12/duckdb:parquet 916317165 934023064 0.98
tpch_q13/duckdb:parquet 1259737727 1160507491 1.09
tpch_q14/duckdb:parquet 1420460882 1163923602 1.22
tpch_q15/duckdb:parquet 950378167 881512096 1.08
tpch_q16/duckdb:parquet 827456299 669979102 1.24
tpch_q17/duckdb:parquet 1373489080 1162618283 1.18
tpch_q18/duckdb:parquet 1503928101 1343212963 1.12
tpch_q19/duckdb:parquet 1637936671 1370004473 1.20
tpch_q20/duckdb:parquet 1720733420 1894549138 0.91
tpch_q21/duckdb:parquet 2228193915 1796949863 1.24
tpch_q22/duckdb:parquet 1112870938 1005026209 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.7% -4.5% +5.5% +69.8% ➖ noise
1 datafusion:vortex-file-compressed +5.9% -4.5% +10.9% +76.2% ➖ noise
1 duckdb:vortex-compact +2.4% -4.5% +7.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +9.0% -4.5% +14.2% +30.0% ➖ noise
2 datafusion:vortex-compact -15.9% +1.6% -17.2% +70.5% ➖ noise
2 datafusion:vortex-file-compressed +10.9% +1.6% +9.2% +73.2% ➖ noise
2 duckdb:vortex-compact +17.8% +1.6% +16.0% +40.5% ➖ noise
2 duckdb:vortex-file-compressed +18.2% +1.6% +16.4% +45.0% ➖ noise
3 datafusion:vortex-compact +6.3% -7.2% +14.5% +84.6% ➖ noise
3 datafusion:vortex-file-compressed +0.3% -7.2% +8.0% +94.7% ➖ noise
3 duckdb:vortex-compact +18.2% -7.2% +27.3% +51.2% ➖ noise
3 duckdb:vortex-file-compressed +7.5% -7.2% +15.8% +49.3% ➖ noise
4 datafusion:vortex-compact -0.9% +15.2% -13.9% +86.2% ➖ noise
4 datafusion:vortex-file-compressed -1.4% +15.2% -14.4% +30.0% ➖ noise
4 duckdb:vortex-compact +13.3% +15.2% -1.6% +36.1% ➖ noise
4 duckdb:vortex-file-compressed +10.8% +15.2% -3.8% +47.0% ➖ noise
5 datafusion:vortex-compact -0.4% -2.8% +2.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +10.4% -2.8% +13.5% +30.0% ➖ noise
5 duckdb:vortex-compact -1.1% -2.8% +1.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +28.8% -2.8% +32.4% +38.1% ➖ noise
6 datafusion:vortex-compact +0.8% +4.2% -3.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +5.1% +4.2% +0.8% +30.0% ➖ noise
6 duckdb:vortex-compact -6.9% +4.2% -10.6% +49.5% ➖ noise
6 duckdb:vortex-file-compressed +8.2% +4.2% +3.9% +30.0% ➖ noise
7 datafusion:vortex-compact +2.4% -5.2% +8.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +2.5% -5.2% +8.1% +30.0% ➖ noise
7 duckdb:vortex-compact +8.3% -5.2% +14.2% +100.5% ➖ noise
7 duckdb:vortex-file-compressed +22.9% -5.2% +29.6% +30.0% ➖ noise
8 datafusion:vortex-compact -5.5% -2.2% -3.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +31.7% -2.2% +34.7% +30.0% 🚨 regression
8 duckdb:vortex-compact +1.1% -2.2% +3.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +2.4% -2.2% +4.7% +30.0% ➖ noise
9 datafusion:vortex-compact +1.6% -1.7% +3.4% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +23.1% -1.7% +25.2% +30.0% ➖ noise
9 duckdb:vortex-compact +8.1% -1.7% +10.0% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +10.0% -1.7% +11.9% +30.0% ➖ noise
10 datafusion:vortex-compact +1.5% +7.0% -5.1% +50.6% ➖ noise
10 datafusion:vortex-file-compressed +16.8% +7.0% +9.1% +51.3% ➖ noise
10 duckdb:vortex-compact -7.6% +7.0% -13.7% +41.9% ➖ noise
10 duckdb:vortex-file-compressed +0.1% +7.0% -6.5% +36.0% ➖ noise
11 datafusion:vortex-compact +1.9% +0.4% +1.6% +45.0% ➖ noise
11 datafusion:vortex-file-compressed +27.5% +0.4% +27.0% +35.7% ➖ noise
11 duckdb:vortex-compact +18.0% +0.4% +17.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +7.3% +0.4% +6.9% +30.0% ➖ noise
12 datafusion:vortex-compact -14.6% -1.3% -13.5% +41.6% ➖ noise
12 datafusion:vortex-file-compressed +4.5% -1.3% +5.8% +34.8% ➖ noise
12 duckdb:vortex-compact -6.5% -1.3% -5.3% +33.6% ➖ noise
12 duckdb:vortex-file-compressed +4.8% -1.3% +6.2% +33.0% ➖ noise
13 datafusion:vortex-compact -5.2% +3.7% -8.5% +53.6% ➖ noise
13 datafusion:vortex-file-compressed +6.9% +3.7% +3.1% +46.2% ➖ noise
13 duckdb:vortex-compact +7.0% +3.7% +3.2% +76.5% ➖ noise
13 duckdb:vortex-file-compressed +15.7% +3.7% +11.6% +84.3% ➖ noise
14 datafusion:vortex-compact -32.8% +9.7% -38.8% +42.4% ✅ faster
14 datafusion:vortex-file-compressed +9.5% +9.7% -0.1% +35.5% ➖ noise
14 duckdb:vortex-compact -0.7% +9.7% -9.5% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -0.7% +9.7% -9.5% +30.0% ➖ noise
15 datafusion:vortex-compact -7.9% +4.9% -12.2% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +5.2% +4.9% +0.3% +30.0% ➖ noise
15 duckdb:vortex-compact +4.3% +4.9% -0.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +6.2% +4.9% +1.2% +30.0% ➖ noise
16 datafusion:vortex-compact -0.5% +16.9% -14.9% +43.7% ➖ noise
16 datafusion:vortex-file-compressed +4.1% +16.9% -10.9% +32.7% ➖ noise
16 duckdb:vortex-compact +4.5% +16.9% -10.6% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -6.1% +16.9% -19.7% +38.0% ➖ noise
17 datafusion:vortex-compact -0.2% +4.4% -4.4% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -0.1% +4.4% -4.3% +30.0% ➖ noise
17 duckdb:vortex-compact +9.7% +4.4% +5.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -1.3% +4.4% -5.5% +30.0% ➖ noise
18 datafusion:vortex-compact -1.6% +4.7% -6.0% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +8.2% +4.7% +3.3% +30.0% ➖ noise
18 duckdb:vortex-compact -4.4% +4.7% -8.7% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -10.9% +4.7% -15.0% +30.0% ➖ noise
19 datafusion:vortex-compact -35.3% +15.3% -43.9% +30.0% ✅ faster
19 datafusion:vortex-file-compressed -1.3% +15.3% -14.4% +30.0% ➖ noise
19 duckdb:vortex-compact +7.6% +15.3% -6.7% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -5.1% +15.3% -17.7% +30.0% ➖ noise
20 datafusion:vortex-compact -7.5% +5.6% -12.3% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -16.9% +5.6% -21.3% +30.0% ➖ noise
20 duckdb:vortex-compact +11.8% +5.6% +5.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +15.4% +5.6% +9.3% +30.0% ➖ noise
21 datafusion:vortex-compact -4.6% +14.2% -16.5% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -1.4% +14.2% -13.7% +30.0% ➖ noise
21 duckdb:vortex-compact +2.2% +14.2% -10.5% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +1.5% +14.2% -11.1% +30.0% ➖ noise
22 datafusion:vortex-compact -2.3% +5.6% -7.4% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -19.8% +5.6% -24.0% +30.0% ✅ faster
22 duckdb:vortex-compact +39.3% +5.6% +32.0% +34.2% ➖ noise
22 duckdb:vortex-file-compressed +17.6% +5.6% +11.4% +32.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -1.4%


datafusion / vortex-file-compressed (0.989x ➖, 0↑ 1↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1839164 1853107 0.99
clickbench_q01/datafusion:vortex-file-compressed 13720717 14171476 0.97
clickbench_q02/datafusion:vortex-file-compressed 33226337 35531697 0.94
clickbench_q03/datafusion:vortex-file-compressed 39871262 38995779 1.02
clickbench_q04/datafusion:vortex-file-compressed 307835481 314673909 0.98
clickbench_q05/datafusion:vortex-file-compressed 315520617 321311376 0.98
clickbench_q06/datafusion:vortex-file-compressed 1865637 1875869 0.99
clickbench_q07/datafusion:vortex-file-compressed 18083541 17751131 1.02
clickbench_q08/datafusion:vortex-file-compressed 390918582 387853192 1.01
clickbench_q09/datafusion:vortex-file-compressed 562353532 572930996 0.98
clickbench_q10/datafusion:vortex-file-compressed 71963962 76460457 0.94
clickbench_q11/datafusion:vortex-file-compressed 81906657 86355847 0.95
clickbench_q12/datafusion:vortex-file-compressed 271351882 274360769 0.99
clickbench_q13/datafusion:vortex-file-compressed 407956020 420436710 0.97
clickbench_q14/datafusion:vortex-file-compressed 259174962 260626958 0.99
clickbench_q15/datafusion:vortex-file-compressed 365075252 365342536 1.00
clickbench_q16/datafusion:vortex-file-compressed 705540197 701709579 1.01
clickbench_q17/datafusion:vortex-file-compressed 696003456 703512750 0.99
clickbench_q18/datafusion:vortex-file-compressed 1369012873 1402145626 0.98
clickbench_q19/datafusion:vortex-file-compressed 23297463 23087287 1.01
clickbench_q20/datafusion:vortex-file-compressed 355648652 359836053 0.99
clickbench_q21/datafusion:vortex-file-compressed 398339588 405366282 0.98
clickbench_q22/datafusion:vortex-file-compressed 485646701 491591936 0.99
clickbench_q23/datafusion:vortex-file-compressed 🚨 773986787 665043247 1.16
clickbench_q24/datafusion:vortex-file-compressed 48972175 49763751 0.98
clickbench_q25/datafusion:vortex-file-compressed 70933045 70050588 1.01
clickbench_q26/datafusion:vortex-file-compressed 44377681 45671532 0.97
clickbench_q27/datafusion:vortex-file-compressed 788364383 802388085 0.98
clickbench_q28/datafusion:vortex-file-compressed 6730637568 6964861247 0.97
clickbench_q29/datafusion:vortex-file-compressed 232112966 233823957 0.99
clickbench_q30/datafusion:vortex-file-compressed 226742702 240099566 0.94
clickbench_q31/datafusion:vortex-file-compressed 267038923 271647428 0.98
clickbench_q32/datafusion:vortex-file-compressed 1235631756 1295562696 0.95
clickbench_q33/datafusion:vortex-file-compressed 1419052340 1437426092 0.99
clickbench_q34/datafusion:vortex-file-compressed 1405236861 1451695797 0.97
clickbench_q35/datafusion:vortex-file-compressed 518534905 535791851 0.97
clickbench_q36/datafusion:vortex-file-compressed 82374972 81021354 1.02
clickbench_q37/datafusion:vortex-file-compressed 39664285 39951212 0.99
clickbench_q38/datafusion:vortex-file-compressed 22899267 21885478 1.05
clickbench_q39/datafusion:vortex-file-compressed 146997367 152339412 0.96
clickbench_q40/datafusion:vortex-file-compressed 18993564 18069032 1.05
clickbench_q41/datafusion:vortex-file-compressed 16706770 17990017 0.93
clickbench_q42/datafusion:vortex-file-compressed 19407331 19273614 1.01
datafusion / parquet (0.978x ➖, 1↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1957560 1830333 1.07
clickbench_q01/datafusion:parquet 21152654 20498870 1.03
clickbench_q02/datafusion:parquet 55152338 55334307 1.00
clickbench_q03/datafusion:parquet 44397830 45433008 0.98
clickbench_q04/datafusion:parquet 323890687 346966288 0.93
clickbench_q05/datafusion:parquet 364627299 369804604 0.99
clickbench_q06/datafusion:parquet 1730843 1729238 1.00
clickbench_q07/datafusion:parquet 25329202 25901265 0.98
clickbench_q08/datafusion:parquet 412057027 416391008 0.99
clickbench_q09/datafusion:parquet 639066306 676821928 0.94
clickbench_q10/datafusion:parquet 106826149 110449597 0.97
clickbench_q11/datafusion:parquet 133136949 138222973 0.96
clickbench_q12/datafusion:parquet 364665621 371340929 0.98
clickbench_q13/datafusion:parquet 498561036 523596673 0.95
clickbench_q14/datafusion:parquet 359220926 363438963 0.99
clickbench_q15/datafusion:parquet 368686562 386538664 0.95
clickbench_q16/datafusion:parquet 700671258 708630280 0.99
clickbench_q17/datafusion:parquet 678904675 695533201 0.98
clickbench_q18/datafusion:parquet 1362773879 1399862081 0.97
clickbench_q19/datafusion:parquet 33563562 33427467 1.00
clickbench_q20/datafusion:parquet 614761240 629687559 0.98
clickbench_q21/datafusion:parquet 685763308 686114731 1.00
clickbench_q22/datafusion:parquet 976675361 990212318 0.99
clickbench_q23/datafusion:parquet 3654853296 3733705319 0.98
clickbench_q24/datafusion:parquet 86588139 93466805 0.93
clickbench_q25/datafusion:parquet 144056725 145571630 0.99
clickbench_q26/datafusion:parquet 92729826 91442592 1.01
clickbench_q27/datafusion:parquet 1053151945 1081864624 0.97
clickbench_q28/datafusion:parquet 6481698457 6670955226 0.97
clickbench_q29/datafusion:parquet 246782044 235256647 1.05
clickbench_q30/datafusion:parquet 352103858 364556003 0.97
clickbench_q31/datafusion:parquet 385722589 391644485 0.98
clickbench_q32/datafusion:parquet 🚀 1178783416 1328616663 0.89
clickbench_q33/datafusion:parquet 1500418341 1567109452 0.96
clickbench_q34/datafusion:parquet 1504446477 1552834101 0.97
clickbench_q35/datafusion:parquet 527738346 552688169 0.95
clickbench_q36/datafusion:parquet 144314009 148220774 0.97
clickbench_q37/datafusion:parquet 62736519 61163609 1.03
clickbench_q38/datafusion:parquet 90743204 94139060 0.96
clickbench_q39/datafusion:parquet 270622071 296570448 0.91
clickbench_q40/datafusion:parquet 34004264 35198565 0.97
clickbench_q41/datafusion:parquet 30610940 30753535 1.00
clickbench_q42/datafusion:parquet 32735467 32752249 1.00
duckdb / vortex-file-compressed (0.956x ➖, 9↑ 2↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6134293 6019438 1.02
clickbench_q01/duckdb:vortex-file-compressed 14345975 14281589 1.00
clickbench_q02/duckdb:vortex-file-compressed 25587332 25814035 0.99
clickbench_q03/duckdb:vortex-file-compressed 29609573 31405864 0.94
clickbench_q04/duckdb:vortex-file-compressed 180926014 182979412 0.99
clickbench_q05/duckdb:vortex-file-compressed 197858098 200180994 0.99
clickbench_q06/duckdb:vortex-file-compressed 18171821 18770884 0.97
clickbench_q07/duckdb:vortex-file-compressed 🚀 15053545 16884371 0.89
clickbench_q08/duckdb:vortex-file-compressed 268866797 269517786 1.00
clickbench_q09/duckdb:vortex-file-compressed 348502673 357448622 0.97
clickbench_q10/duckdb:vortex-file-compressed 72403670 74575865 0.97
clickbench_q11/duckdb:vortex-file-compressed 81005398 83683217 0.97
clickbench_q12/duckdb:vortex-file-compressed 218058401 213876052 1.02
clickbench_q13/duckdb:vortex-file-compressed 434632380 436654451 1.00
clickbench_q14/duckdb:vortex-file-compressed 241837866 246280169 0.98
clickbench_q15/duckdb:vortex-file-compressed 221986668 221285371 1.00
clickbench_q16/duckdb:vortex-file-compressed 664081245 705653075 0.94
clickbench_q17/duckdb:vortex-file-compressed 520811117 539532233 0.97
clickbench_q18/duckdb:vortex-file-compressed 1215637571 1221542172 1.00
clickbench_q19/duckdb:vortex-file-compressed 20759009 20932888 0.99
clickbench_q20/duckdb:vortex-file-compressed 365251710 392508321 0.93
clickbench_q21/duckdb:vortex-file-compressed 396140698 426991306 0.93
clickbench_q22/duckdb:vortex-file-compressed 🚨 669008469 566761500 1.18
clickbench_q23/duckdb:vortex-file-compressed 🚨 1489390227 1319227739 1.13
clickbench_q24/duckdb:vortex-file-compressed 🚀 47195716 55032532 0.86
clickbench_q25/duckdb:vortex-file-compressed 78298452 80857751 0.97
clickbench_q26/duckdb:vortex-file-compressed 44212559 44906138 0.98
clickbench_q27/duckdb:vortex-file-compressed 481347060 514204364 0.94
clickbench_q28/duckdb:vortex-file-compressed 2995060079 3015430777 0.99
clickbench_q29/duckdb:vortex-file-compressed 29242734 29284937 1.00
clickbench_q30/duckdb:vortex-file-compressed 181150250 185361018 0.98
clickbench_q31/duckdb:vortex-file-compressed 263968853 266919214 0.99
clickbench_q32/duckdb:vortex-file-compressed 1311370102 1331649548 0.98
clickbench_q33/duckdb:vortex-file-compressed 1424732263 1557989339 0.91
clickbench_q34/duckdb:vortex-file-compressed 🚀 1512489501 1695859606 0.89
clickbench_q35/duckdb:vortex-file-compressed 376555257 378744889 0.99
clickbench_q36/duckdb:vortex-file-compressed 🚀 28802397 33440682 0.86
clickbench_q37/duckdb:vortex-file-compressed 🚀 20348442 24411875 0.83
clickbench_q38/duckdb:vortex-file-compressed 🚀 22681143 26800771 0.85
clickbench_q39/duckdb:vortex-file-compressed 41561322 44538449 0.93
clickbench_q40/duckdb:vortex-file-compressed 🚀 20947706 25767985 0.81
clickbench_q41/duckdb:vortex-file-compressed 🚀 20987729 24524482 0.86
clickbench_q42/duckdb:vortex-file-compressed 🚀 20331780 24355297 0.83
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 227518815 238637883 0.95
clickbench_q01/duckdb:parquet 50398675 50954179 0.99
clickbench_q02/duckdb:parquet 66561211 66639981 1.00
clickbench_q03/duckdb:parquet 64851017 65060705 1.00
clickbench_q04/duckdb:parquet 205004849 207012820 0.99
clickbench_q05/duckdb:parquet 282255212 277520439 1.02
clickbench_q06/duckdb:parquet 60669538 61649578 0.98
clickbench_q07/duckdb:parquet 52610576 53207585 0.99
clickbench_q08/duckdb:parquet 272137464 270968201 1.00
clickbench_q09/duckdb:parquet 398165667 399057205 1.00
clickbench_q10/duckdb:parquet 94284930 98569588 0.96
clickbench_q11/duckdb:parquet 107066867 109049360 0.98
clickbench_q12/duckdb:parquet 295938627 298169251 0.99
clickbench_q13/duckdb:parquet 506954096 520608632 0.97
clickbench_q14/duckdb:parquet 327039955 335788422 0.97
clickbench_q15/duckdb:parquet 242929349 245239379 0.99
clickbench_q16/duckdb:parquet 622292415 625800395 0.99
clickbench_q17/duckdb:parquet 512411038 516753380 0.99
clickbench_q18/duckdb:parquet 1057400012 1059749755 1.00
clickbench_q19/duckdb:parquet 50122182 49797241 1.01
clickbench_q20/duckdb:parquet 439974260 432100756 1.02
clickbench_q21/duckdb:parquet 557678606 561426389 0.99
clickbench_q22/duckdb:parquet 940358538 935388538 1.01
clickbench_q23/duckdb:parquet 316986380 318516450 1.00
clickbench_q24/duckdb:parquet 80606852 79061857 1.02
clickbench_q25/duckdb:parquet 141462276 142552948 0.99
clickbench_q26/duckdb:parquet 54320670 55259704 0.98
clickbench_q27/duckdb:parquet 646047438 648120756 1.00
clickbench_q28/duckdb:parquet 4823120029 4876102961 0.99
clickbench_q29/duckdb:parquet 61568615 62473407 0.99
clickbench_q30/duckdb:parquet 304701827 306524085 0.99
clickbench_q31/duckdb:parquet 353385512 346519394 1.02
clickbench_q32/duckdb:parquet 1177706097 1139760801 1.03
clickbench_q33/duckdb:parquet 1257906988 1254030144 1.00
clickbench_q34/duckdb:parquet 1262907252 1244615727 1.01
clickbench_q35/duckdb:parquet 354148457 355018815 1.00
clickbench_q36/duckdb:parquet 64799578 63629771 1.02
clickbench_q37/duckdb:parquet 54766855 54610304 1.00
clickbench_q38/duckdb:parquet 58665945 58494038 1.00
clickbench_q39/duckdb:parquet 96870256 107592467 0.90
clickbench_q40/duckdb:parquet 55522936 56849946 0.98
clickbench_q41/duckdb:parquet 59417522 58976401 1.01
clickbench_q42/duckdb:parquet 52705304 54276919 0.97
duckdb / duckdb (0.988x ➖, 6↑ 0↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 19149221 17752185 1.08
clickbench_q01/duckdb:duckdb 35563376 33689583 1.06
clickbench_q02/duckdb:duckdb 47517014 45179187 1.05
clickbench_q03/duckdb:duckdb 48907217 47471766 1.03
clickbench_q04/duckdb:duckdb 209151318 229778816 0.91
clickbench_q05/duckdb:duckdb 316674077 333787497 0.95
clickbench_q06/duckdb:duckdb 37581359 36005472 1.04
clickbench_q07/duckdb:duckdb 38631481 35518526 1.09
clickbench_q08/duckdb:duckdb 299980093 319361290 0.94
clickbench_q09/duckdb:duckdb 464679529 490383864 0.95
clickbench_q10/duckdb:duckdb 99365714 97948179 1.01
clickbench_q11/duckdb:duckdb 108543891 107388182 1.01
clickbench_q12/duckdb:duckdb 294504306 318573356 0.92
clickbench_q13/duckdb:duckdb 🚀 504985003 582947341 0.87
clickbench_q14/duckdb:duckdb 🚀 327549880 370528137 0.88
clickbench_q15/duckdb:duckdb 🚀 253728228 284492007 0.89
clickbench_q16/duckdb:duckdb 674365408 702659161 0.96
clickbench_q17/duckdb:duckdb 573506176 605101635 0.95
clickbench_q18/duckdb:duckdb 1259150073 1300276984 0.97
clickbench_q19/duckdb:duckdb 37140824 35119021 1.06
clickbench_q20/duckdb:duckdb 🚀 865079293 1012675071 0.85
clickbench_q21/duckdb:duckdb 🚀 964749738 1081293951 0.89
clickbench_q22/duckdb:duckdb 1060447031 1167609921 0.91
clickbench_q23/duckdb:duckdb 253645190 261291697 0.97
clickbench_q24/duckdb:duckdb 63400364 61302379 1.03
clickbench_q25/duckdb:duckdb 124963397 125413442 1.00
clickbench_q26/duckdb:duckdb 57949557 56653659 1.02
clickbench_q27/duckdb:duckdb 🚀 982691822 1130809973 0.87
clickbench_q28/duckdb:duckdb 4665095704 4627982214 1.01
clickbench_q29/duckdb:duckdb 50365072 48822159 1.03
clickbench_q30/duckdb:duckdb 276500868 286905103 0.96
clickbench_q31/duckdb:duckdb 405517935 398415855 1.02
clickbench_q32/duckdb:duckdb 1386836394 1452723420 0.95
clickbench_q33/duckdb:duckdb 1963718717 1965759104 1.00
clickbench_q34/duckdb:duckdb 1994848876 2006215059 0.99
clickbench_q35/duckdb:duckdb 266159948 268224892 0.99
clickbench_q36/duckdb:duckdb 39489051 37311542 1.06
clickbench_q37/duckdb:duckdb 34131435 31312912 1.09
clickbench_q38/duckdb:duckdb 32907309 31437585 1.05
clickbench_q39/duckdb:duckdb 61617116 61824884 1.00
clickbench_q40/duckdb:duckdb 34844492 31866328 1.09
clickbench_q41/duckdb:duckdb 32609369 30062882 1.08
clickbench_q42/duckdb:duckdb 34299118 31434442 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -0.8% +1.0% -1.7% +568.5% ➖ noise
0 duckdb:duckdb +7.9% +1.0% +6.8% +260.4% ➖ noise
0 duckdb:vortex-file-compressed +1.9% +1.0% +0.9% +306.3% ➖ noise
1 datafusion:vortex-file-compressed -3.2% +1.0% -4.2% +28.1% ➖ noise
1 duckdb:duckdb +5.6% +1.0% +4.5% +44.1% ➖ noise
1 duckdb:vortex-file-compressed +0.5% +1.0% -0.6% +20.1% ➖ noise
2 datafusion:vortex-file-compressed -6.5% -0.2% -6.3% +21.6% ➖ noise
2 duckdb:duckdb +5.2% -0.2% +5.4% +20.0% ➖ noise
2 duckdb:vortex-file-compressed -0.9% -0.2% -0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +2.2% -1.3% +3.6% +137.4% ➖ noise
3 duckdb:duckdb +3.0% -1.3% +4.4% +35.8% ➖ noise
3 duckdb:vortex-file-compressed -5.7% -1.3% -4.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.2% -3.9% +1.7% +10.0% ➖ noise
4 duckdb:duckdb -9.0% -3.9% -5.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.1% -3.9% +2.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.8% +0.1% -1.9% +10.0% ➖ noise
5 duckdb:duckdb -5.1% +0.1% -5.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.2% +0.1% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% -0.8% +0.2% +41.2% ➖ noise
6 duckdb:duckdb +4.4% -0.8% +5.2% +30.7% ➖ noise
6 duckdb:vortex-file-compressed -3.2% -0.8% -2.5% +18.8% ➖ noise
7 datafusion:vortex-file-compressed +1.9% -1.7% +3.6% +10.0% ➖ noise
7 duckdb:duckdb +8.8% -1.7% +10.6% +12.9% ➖ noise
7 duckdb:vortex-file-compressed -10.8% -1.7% -9.3% +10.0% ✅ faster
8 datafusion:vortex-file-compressed +0.8% -0.3% +1.1% +10.0% ➖ noise
8 duckdb:duckdb -6.1% -0.3% -5.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.2% -0.3% +0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.8% -2.9% +1.1% +10.0% ➖ noise
9 duckdb:duckdb -5.2% -2.9% -2.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.5% -2.9% +0.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -5.9% -3.8% -2.1% +10.0% ➖ noise
10 duckdb:duckdb +1.4% -3.8% +5.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.9% -3.8% +0.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -5.2% -2.8% -2.5% +10.0% ➖ noise
11 duckdb:duckdb +1.1% -2.8% +3.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.2% -2.8% -0.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.1% -1.3% +0.2% +10.0% ➖ noise
12 duckdb:duckdb -7.6% -1.3% -6.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.0% -1.3% +3.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -3.0% -3.7% +0.8% +10.0% ➖ noise
13 duckdb:duckdb -13.4% -3.7% -10.0% +10.0% ✅ faster
13 duckdb:vortex-file-compressed -0.5% -3.7% +3.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.6% -1.9% +1.4% +10.0% ➖ noise
14 duckdb:duckdb -11.6% -1.9% -9.9% +10.0% ✅ faster
14 duckdb:vortex-file-compressed -1.8% -1.9% +0.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.1% -2.8% +2.8% +10.0% ➖ noise
15 duckdb:duckdb -10.8% -2.8% -8.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.3% -2.8% +3.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.5% -0.8% +1.4% +10.0% ➖ noise
16 duckdb:duckdb -4.0% -0.8% -3.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -5.9% -0.8% -5.1% +13.9% ➖ noise
17 datafusion:vortex-file-compressed -1.1% -1.6% +0.6% +10.0% ➖ noise
17 duckdb:duckdb -5.2% -1.6% -3.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.5% -1.6% -1.9% +15.2% ➖ noise
18 datafusion:vortex-file-compressed -2.4% -1.4% -0.9% +10.0% ➖ noise
18 duckdb:duckdb -3.2% -1.4% -1.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.5% -1.4% +1.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.9% +0.5% +0.4% +13.7% ➖ noise
19 duckdb:duckdb +5.8% +0.5% +5.2% +10.7% ➖ noise
19 duckdb:vortex-file-compressed -0.8% +0.5% -1.4% +28.0% ➖ noise
20 datafusion:vortex-file-compressed -1.2% -0.3% -0.9% +177.8% ➖ noise
20 duckdb:duckdb -14.6% -0.3% -14.3% +25.1% ➖ noise
20 duckdb:vortex-file-compressed -6.9% -0.3% -6.7% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.7% -0.4% -1.4% +10.0% ➖ noise
21 duckdb:duckdb -10.8% -0.4% -10.5% +12.0% ➖ noise
21 duckdb:vortex-file-compressed -7.2% -0.4% -6.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.2% -0.4% -0.8% +10.0% ➖ noise
22 duckdb:duckdb -9.2% -0.4% -8.8% +14.2% ➖ noise
22 duckdb:vortex-file-compressed +18.0% -0.4% +18.5% +21.8% ➖ noise
23 datafusion:vortex-file-compressed +16.4% -1.3% +17.9% +34.6% ➖ noise
23 duckdb:duckdb -2.9% -1.3% -1.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +12.9% -1.3% +14.4% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed -1.6% -2.8% +1.3% +29.0% ➖ noise
24 duckdb:duckdb +3.4% -2.8% +6.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -14.2% -2.8% -11.8% +37.4% ➖ noise
25 datafusion:vortex-file-compressed +1.3% -0.9% +2.2% +13.8% ➖ noise
25 duckdb:duckdb -0.4% -0.9% +0.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -3.2% -0.9% -2.3% +13.0% ➖ noise
26 datafusion:vortex-file-compressed -2.8% -0.2% -2.7% +17.4% ➖ noise
26 duckdb:duckdb +2.3% -0.2% +2.4% +15.7% ➖ noise
26 duckdb:vortex-file-compressed -1.5% -0.2% -1.4% +24.2% ➖ noise
27 datafusion:vortex-file-compressed -1.7% -1.5% -0.3% +10.0% ➖ noise
27 duckdb:duckdb -13.1% -1.5% -11.8% +10.0% ✅ faster
27 duckdb:vortex-file-compressed -6.4% -1.5% -5.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -3.4% -2.0% -1.4% +10.0% ➖ noise
28 duckdb:duckdb +0.8% -2.0% +2.8% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.7% -2.0% +1.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.7% +1.7% -2.4% +10.0% ➖ noise
29 duckdb:duckdb +3.2% +1.7% +1.5% +14.0% ➖ noise
29 duckdb:vortex-file-compressed -0.1% +1.7% -1.8% +10.6% ➖ noise
30 datafusion:vortex-file-compressed -5.6% -2.0% -3.6% +10.0% ➖ noise
30 duckdb:duckdb -3.6% -2.0% -1.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -2.3% -2.0% -0.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.7% +0.2% -1.9% +10.0% ➖ noise
31 duckdb:duckdb +1.8% +0.2% +1.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -1.1% +0.2% -1.3% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -4.6% -4.3% -0.4% +10.0% ➖ noise
32 duckdb:duckdb -4.5% -4.3% -0.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -1.5% -4.3% +2.9% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.3% -2.0% +0.7% +10.0% ➖ noise
33 duckdb:duckdb -0.1% -2.0% +1.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -8.6% -2.0% -6.7% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -3.2% -0.8% -2.4% +10.0% ➖ noise
34 duckdb:duckdb -0.6% -0.8% +0.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -10.8% -0.8% -10.0% +10.0% ✅ faster
35 datafusion:vortex-file-compressed -3.2% -2.4% -0.8% +10.0% ➖ noise
35 duckdb:duckdb -0.8% -2.4% +1.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.6% -2.4% +1.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.7% -0.4% +2.1% +10.0% ➖ noise
36 duckdb:duckdb +5.8% -0.4% +6.3% +14.1% ➖ noise
36 duckdb:vortex-file-compressed -13.9% -0.4% -13.5% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -0.7% +1.4% -2.1% +10.0% ➖ noise
37 duckdb:duckdb +9.0% +1.4% +7.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -16.6% +1.4% -17.8% +11.1% ✅ faster
38 datafusion:vortex-file-compressed +4.6% -1.7% +6.4% +10.0% ➖ noise
38 duckdb:duckdb +4.7% -1.7% +6.5% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -15.4% -1.7% -13.9% +10.0% ✅ faster
39 datafusion:vortex-file-compressed -3.5% -9.4% +6.5% +10.0% ➖ noise
39 duckdb:duckdb -0.3% -9.4% +10.0% +24.8% ➖ noise
39 duckdb:vortex-file-compressed -6.7% -9.4% +3.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +5.1% -2.9% +8.2% +10.6% ➖ noise
40 duckdb:duckdb +9.3% -2.9% +12.6% +10.9% 🚨 regression
40 duckdb:vortex-file-compressed -18.7% -2.9% -16.3% +13.2% ✅ faster
41 datafusion:vortex-file-compressed -7.1% +0.1% -7.3% +10.7% ➖ noise
41 duckdb:duckdb +8.5% +0.1% +8.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -14.4% +0.1% -14.5% +10.0% ✅ faster
42 datafusion:vortex-file-compressed +0.7% -1.5% +2.2% +10.0% ➖ noise
42 duckdb:duckdb +9.1% -1.5% +10.8% +10.0% 🚨 regression
42 duckdb:vortex-file-compressed -16.5% -1.5% -15.3% +10.8% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 7.03 GB (-0.0%)
  • vortex-file-compressed: 14.08 GB → 14.08 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 14, 2026

Benchmarks: Random Access

Vortex (geomean): 0.934x ➖
Parquet (geomean): 1.050x ➖


unknown / unknown (1.017x ➖, 5↑ 9↓)
name PR 22d305a (ns) base 3fd9f26 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3226044 2463726 1.31
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1389831 1258182 1.10
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11733078550 11628654605 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11308823455 11397662161 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7903230 8548105 0.92
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6897281 6865160 1.00
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1603703 1442016 1.11
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 2688756 2333124 1.15
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11311174898 11389906522 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11331279164 11422363976 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13433084 13553432 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13796789 13711984 1.01
random-access/lance-tokio-local-disk 771420 733171 1.05
random-access/lance-tokio-local-disk-footer 1403445 1315609 1.07
random-access/nested-lists/correlated/lance-tokio-local-disk 284990 267873 1.06
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 756240 683333 1.11
random-access/nested-lists/correlated/parquet-tokio-local-disk 140363455 136646234 1.03
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 138842798 134818977 1.03
random-access/nested-lists/correlated/vortex-tokio-local-disk 731057 744003 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 739106 815194 0.91
random-access/nested-lists/uniform/lance-tokio-local-disk 1217703 1171853 1.04
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1742630 1633672 1.07
random-access/nested-lists/uniform/parquet-tokio-local-disk 138562696 134986989 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 137422439 134830555 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 2442538 2330796 1.05
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2532191 2443681 1.04
random-access/nested-structs/correlated/lance-tokio-local-disk 440220 430121 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 654549 636132 1.03
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 31953537 25875235 1.23
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 30935426 25747319 1.20
random-access/nested-structs/correlated/vortex-tokio-local-disk 936759 863793 1.08
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 945390 885293 1.07
random-access/nested-structs/uniform/lance-tokio-local-disk 2884091 2860878 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3120472 3104655 1.01
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 32142699 25963414 1.24
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 30604364 25880127 1.18
random-access/nested-structs/uniform/vortex-tokio-local-disk 1950331 1783348 1.09
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1835288 1796092 1.02
random-access/parquet-tokio-local-disk 187426729 185660585 1.01
random-access/parquet-tokio-local-disk-footer 184910633 183411839 1.01
random-access/taxi/correlated/lance-tokio-local-disk 1001803 957080 1.05
random-access/taxi/correlated/lance-tokio-local-disk-footer 1728069 1622638 1.06
random-access/taxi/correlated/parquet-tokio-local-disk 277622411 276112530 1.01
random-access/taxi/correlated/parquet-tokio-local-disk-footer 275298744 274954964 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1908861 2509550 0.76
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1789125 2521683 0.71
random-access/taxi/uniform/lance-tokio-local-disk 8909830 8536213 1.04
random-access/taxi/uniform/lance-tokio-local-disk-footer 9491687 9196388 1.03
random-access/taxi/uniform/parquet-tokio-local-disk 292776494 293765744 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 290771532 293672875 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 4742704 5208820 0.91
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4571336 5242012 0.87
random-access/vortex-tokio-local-disk 🚀 1304101 1654024 0.79
random-access/vortex-tokio-local-disk-footer 🚀 1312745 1764033 0.74

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
u
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 14, 2026
u
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
u
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants