Skip to content

Align DF expression conversion and pushdown - #9785

Draft
AdamGS wants to merge 7 commits into
developfrom
adamg/df-fix-bugs-conversion
Draft

Align DF expression conversion and pushdown#9785
AdamGS wants to merge 7 commits into
developfrom
adamg/df-fix-bugs-conversion

Conversation

@AdamGS

@AdamGS AdamGS commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Summary

Align DF expression conversion so claiming an expression is supported AND converting it are aligned.

Changes

  1. Changes the ExpressionConvertor trait.
  2. Split some of the larger files into more focused ones.

API Changes

The ExpressionConvertor trait is changed, now allowing users to implement ExpressionConvertor::try_convert as the main entry point.

@AdamGS AdamGS added the changelog/fix A bug fix label Sep 7, 2026
@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 01bc390 to 47d4415 Compare September 7, 2026 11:57
@codspeed-hq

codspeed-hq Bot commented Sep 7, 2026

Copy link
Copy Markdown

Merging this PR will regress 2 benchmarks

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
❌ 2 regressed benchmarks
✅ 2193 untouched benchmarks
⏩ 206 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation random_i16[0.95] 77.4 µs 95.9 µs -19.22%
WallTime mul_u32_nonnull_avx512 5.6 µs 6.2 µs -10.42%
Simulation random_i8[0.5] 91.4 µs 68 µs +34.4%
Simulation decompress[u64, (4000, 1024)] 85.6 µs 70.5 µs +21.42%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%
Simulation allocate_drop_bytes[0] 575.7 ns 521.6 ns +10.39%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/df-fix-bugs-conversion (2dd2e1a) with develop (85b70cf)2

Open in CodSpeed

Footnotes

  1. 206 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on develop (5c8c397) during the generation of this report, so 85b70cf was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 47d4415 to 4d7f747 Compare September 7, 2026 11:58
@AdamGS AdamGS added ext/datafusion Relates to the DataFusion integration action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Sep 7, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 7, 2026
@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 095b9a4 statpopgen 1 Explore Profiling Data
🟢 Done 095b9a4 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 095b9a4 fineweb 1 Explore Profiling Data
🟢 Done 095b9a4 fineweb-s3 1 Explore Profiling Data
🟢 Done 095b9a4 tpcds-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 clickbench-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 polarsignals 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-s3 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 095b9a4b vs base dc1b355d
Vortex (geomean): hot 1.001x ➖ · cold 0.989x ➖


datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45490810 / 45212450 / +0.6% 90822481 / 90150835 / +0.7% 0.50 / 0.50 / -0.1%
polarsignals_q01/datafusion:vortex-file-compressed 51096362 / 50940478 / +0.3% 112636236 / 111616529 / +0.9% 0.45 / 0.46 / -0.6%
polarsignals_q02/datafusion:vortex-file-compressed 35280247 / 37426394 / -5.7% 78791198 / 78537234 / +0.3% 0.45 / 0.48 / -6.0%
polarsignals_q03/datafusion:vortex-file-compressed 53614342 / 52990236 / +1.2% 115864416 / 117226587 / -1.2% 0.46 / 0.45 / +2.4%
polarsignals_q04/datafusion:vortex-file-compressed 9572531 / 9328471 / +2.6% 51213842 / 50323690 / +1.8% 0.19 / 0.19 / +0.8%
polarsignals_q05/datafusion:vortex-file-compressed 11214018 / 11240840 / -0.2% 54320573 / 57902448 / -6.2% 0.21 / 0.19 / +6.3%
polarsignals_q06/datafusion:vortex-file-compressed 21199904 / 20432410 / +3.8% 62873426 / 63434690 / -0.9% 0.34 / 0.32 / +4.7%
polarsignals_q07/datafusion:vortex-file-compressed 11154898 / 10983690 / +1.6% 54253406 / 55204786 / -1.7% 0.21 / 0.20 / +3.3%
polarsignals_q08/datafusion:vortex-file-compressed 100247501 / 100989874 / -0.7% 161866504 / 163591109 / -1.1% 0.62 / 0.62 / +0.3%
polarsignals_q09/datafusion:vortex-file-compressed 9710186 / 9862704 / -1.5% 48981435 / 50989184 / -3.9% 0.20 / 0.19 / +2.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-1.7%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 1.007x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15622513 / 16373089 / -4.6% 45179733 / 44552308 / +1.4% 0.35 / 0.37 / -5.9%
tpch_q02/datafusion:vortex-file-compressed 17551046 / 17270934 / +1.6% 36727319 / 36433328 / +0.8% 0.48 / 0.47 / +0.8%
tpch_q03/datafusion:vortex-file-compressed 19451677 / 19199069 / +1.3% 46282315 / 46879655 / -1.3% 0.42 / 0.41 / +2.6%
tpch_q04/datafusion:vortex-file-compressed 10052221 / 10141922 / -0.9% 32460124 / 32648478 / -0.6% 0.31 / 0.31 / -0.3%
tpch_q05/datafusion:vortex-file-compressed 36645300 / 36287332 / +1.0% 62225317 / 64220269 / -3.1% 0.59 / 0.57 / +4.2%
tpch_q06/datafusion:vortex-file-compressed 6327239 / 6341910 / -0.2% 29288088 / 30329187 / -3.4% 0.22 / 0.21 / +3.3%
tpch_q07/datafusion:vortex-file-compressed 51568373 / 51172687 / +0.8% 81460412 / 79140815 / +2.9% 0.63 / 0.65 / -2.1%
tpch_q08/datafusion:vortex-file-compressed 51152587 / 50910554 / +0.5% 79046518 / 78011738 / +1.3% 0.65 / 0.65 / -0.8%
tpch_q09/datafusion:vortex-file-compressed 49601178 / 50303429 / -1.4% 73209015 / 79019641 / -7.4% 0.68 / 0.64 / +6.4%
tpch_q10/datafusion:vortex-file-compressed 17378284 / 17065216 / +1.8% 48127844 / 47990486 / +0.3% 0.36 / 0.36 / +1.5%
tpch_q11/datafusion:vortex-file-compressed 14826128 / 14978751 / -1.0% 32954325 / 32286911 / +2.1% 0.45 / 0.46 / -3.0%
tpch_q12/datafusion:vortex-file-compressed 22806564 / 22717920 / +0.4% 45053856 / 45933065 / -1.9% 0.51 / 0.49 / +2.3%
tpch_q13/datafusion:vortex-file-compressed 20150737 / 20292106 / -0.7% 39929369 / 37924308 / +5.3% 0.50 / 0.54 / -5.7%
tpch_q14/datafusion:vortex-file-compressed 14946359 / 14788295 / +1.1% 37453691 / 38847368 / -3.6% 0.40 / 0.38 / +4.8%
tpch_q15/datafusion:vortex-file-compressed 18359759 / 18288674 / +0.4% 44544379 / 45267790 / -1.6% 0.41 / 0.40 / +2.0%
tpch_q16/datafusion:vortex-file-compressed 18541622 / 18469281 / +0.4% 36820998 / 36746330 / +0.2% 0.50 / 0.50 / +0.2%
tpch_q17/datafusion:vortex-file-compressed 28538642 / 27905889 / +2.3% 57547563 / 57670779 / -0.2% 0.50 / 0.48 / +2.5%
tpch_q18/datafusion:vortex-file-compressed 36588855 / 36282100 / +0.8% 57495498 / 57747330 / -0.4% 0.64 / 0.63 / +1.3%
tpch_q19/datafusion:vortex-file-compressed 14013256 / 13993119 / +0.1% 37522448 / 36142606 / +3.8% 0.37 / 0.39 / -3.5%
tpch_q20/datafusion:vortex-file-compressed 20778383 / 20673477 / +0.5% 43510555 / 44205704 / -1.6% 0.48 / 0.47 / +2.1%
tpch_q21/datafusion:vortex-file-compressed 40035250 / 39273524 / +1.9% 65276081 / 63949049 / +2.1% 0.61 / 0.61 / -0.1%
tpch_q22/datafusion:vortex-file-compressed 10897185 / 11273786 / -3.3% 30328257 / 30422916 / -0.3% 0.36 / 0.37 / -3.0%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67368582 / 67050292 / +0.5% 83629321 / 84665749 / -1.2% 0.81 / 0.79 / +1.7%
tpch_q02/datafusion:parquet 53056228 / 52307864 / +1.4% 69028988 / 74113046 / -6.9% 0.77 / 0.71 / +8.9%
tpch_q03/datafusion:parquet 72558710 / 72755077 / -0.3% 96569184 / 95761202 / +0.8% 0.75 / 0.76 / -1.1%
tpch_q04/datafusion:parquet 40700830 / 40619070 / +0.2% 57925487 / 63040029 / -8.1% 0.70 / 0.64 / +9.0%
tpch_q05/datafusion:parquet 88565653 / 88091347 / +0.5% 112392495 / 114508291 / -1.8% 0.79 / 0.77 / +2.4%
tpch_q06/datafusion:parquet 28785484 / 28733331 / +0.2% 48052709 / 48813357 / -1.6% 0.60 / 0.59 / +1.8%
tpch_q07/datafusion:parquet 96763661 / 93169141 / +3.9% 118027923 / 120119379 / -1.7% 0.82 / 0.78 / +5.7%
tpch_q08/datafusion:parquet 95941893 / 96743127 / -0.8% 123592506 / 126140272 / -2.0% 0.78 / 0.77 / +1.2%
tpch_q09/datafusion:parquet 113143870 / 112814362 / +0.3% 140448977 / 144312447 / -2.7% 0.81 / 0.78 / +3.1%
tpch_q10/datafusion:parquet 79232251 / 80064418 / -1.0% 108899573 / 115022654 / -5.3% 0.73 / 0.70 / +4.5%
tpch_q11/datafusion:parquet 38239447 / 39654695 / -3.6% 58874281 / 61015023 / -3.5% 0.65 / 0.65 / -0.1%
tpch_q12/datafusion:parquet 61571708 / 61880543 / -0.5% 85325104 / 89469505 / -4.6% 0.72 / 0.69 / +4.3%
tpch_q13/datafusion:parquet 159710211 / 159244384 / +0.3% 180661337 / 181098210 / -0.2% 0.88 / 0.88 / +0.5%
tpch_q14/datafusion:parquet 40312298 / 40111227 / +0.5% 63905534 / 63896260 / +0.0% 0.63 / 0.63 / +0.5%
tpch_q15/datafusion:parquet 47124500 / 47130678 / -0.0% 67359442 / 67130809 / +0.3% 0.70 / 0.70 / -0.4%
tpch_q16/datafusion:parquet 39149762 / 38265470 / +2.3% 56005856 / 57072528 / -1.9% 0.70 / 0.67 / +4.3%
tpch_q17/datafusion:parquet 117790078 / 116176719 / +1.4% 139086937 / 140435920 / -1.0% 0.85 / 0.83 / +2.4%
tpch_q18/datafusion:parquet 114318426 / 113762518 / +0.5% 136466642 / 135561395 / +0.7% 0.84 / 0.84 / -0.2%
tpch_q19/datafusion:parquet 50694817 / 49938506 / +1.5% 75283219 / 77763737 / -3.2% 0.67 / 0.64 / +4.9%
tpch_q20/datafusion:parquet 59706039 / 58306552 / +2.4% 82144713 / 80839248 / +1.6% 0.73 / 0.72 / +0.8%
tpch_q21/datafusion:parquet 98446830 / 98508034 / -0.1% 120492564 / 120155202 / +0.3% 0.82 / 0.82 / -0.3%
tpch_q22/datafusion:parquet 41124430 / 41731714 / -1.5% 58522375 / 60868267 / -3.9% 0.70 / 0.69 / +2.5%
duckdb / vortex-file-compressed / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11309755 / 11886742 / -4.9% 23277593 / 23189958 / +0.4% 0.49 / 0.51 / -5.2%
tpch_q02/duckdb:vortex-file-compressed 17586795 / 17617766 / -0.2% 26265462 / 26581036 / -1.2% 0.67 / 0.66 / +1.0%
tpch_q03/duckdb:vortex-file-compressed 18354672 / 18068916 / +1.6% 32571768 / 33076348 / -1.5% 0.56 / 0.55 / +3.2%
tpch_q04/duckdb:vortex-file-compressed 17545711 / 17031531 / +3.0% 30212663 / 27795912 / +8.7% 0.58 / 0.61 / -5.2%
tpch_q05/duckdb:vortex-file-compressed 22160792 / 22382947 / -1.0% 37325192 / 33945737 / +10.0% 0.59 / 0.66 / -10.0%
tpch_q06/duckdb:vortex-file-compressed 5823127 / 5663599 / +2.8% 13526986 / 13619696 / -0.7% 0.43 / 0.42 / +3.5%
tpch_q07/duckdb:vortex-file-compressed 21171746 / 20910240 / +1.3% 43728984 / 37659210 / +16.1% 🔴 0.48 / 0.56 / -12.8%
tpch_q08/duckdb:vortex-file-compressed 23395519 / 23484197 / -0.4% 40430445 / 38154134 / +6.0% 0.58 / 0.62 / -6.0%
tpch_q09/duckdb:vortex-file-compressed 29008913 / 29296239 / -1.0% 52263061 / 43679925 / +19.7% 🔴 0.56 / 0.67 / -17.2%
tpch_q10/duckdb:vortex-file-compressed 29161304 / 28947182 / +0.7% 46463625 / 44541224 / +4.3% 0.63 / 0.65 / -3.4%
tpch_q11/duckdb:vortex-file-compressed 8022731 / 10995971 / -27.0% 🟢 15798929 / 15587475 / +1.4% 0.51 / 0.71 / -28.0%
tpch_q12/duckdb:vortex-file-compressed 15466474 / 16055228 / -3.7% 29671118 / 27442919 / +8.1% 0.52 / 0.59 / -10.9%
tpch_q13/duckdb:vortex-file-compressed 22482986 / 23054585 / -2.5% 42361461 / 39211725 / +8.0% 0.53 / 0.59 / -9.7%
tpch_q14/duckdb:vortex-file-compressed 13093381 / 13198640 / -0.8% 22555910 / 25783697 / -12.5% 🟢 0.58 / 0.51 / +13.4%
tpch_q15/duckdb:vortex-file-compressed 9142285 / 9348399 / -2.2% 18020387 / 18516639 / -2.7% 0.51 / 0.50 / +0.5%
tpch_q16/duckdb:vortex-file-compressed 18718395 / 18613000 / +0.6% 24300168 / 23879145 / +1.8% 0.77 / 0.78 / -1.2%
tpch_q17/duckdb:vortex-file-compressed 15185043 / 15148004 / +0.2% 30053181 / 31876409 / -5.7% 0.51 / 0.48 / +6.3%
tpch_q18/duckdb:vortex-file-compressed 24357570 / 24902734 / -2.2% 34289786 / 36380301 / -5.7% 0.71 / 0.68 / +3.8%
tpch_q19/duckdb:vortex-file-compressed 23214702 / 23901354 / -2.9% 35480132 / 35334625 / +0.4% 0.65 / 0.68 / -3.3%
tpch_q20/duckdb:vortex-file-compressed 17439645 / 17648869 / -1.2% 34549624 / 33129002 / +4.3% 0.50 / 0.53 / -5.2%
tpch_q21/duckdb:vortex-file-compressed 64660574 / 68099096 / -5.0% 83800373 / 81399973 / +2.9% 0.77 / 0.84 / -7.8%
tpch_q22/duckdb:vortex-file-compressed 12018018 / 12039493 / -0.2% 21334519 / 25549276 / -16.5% 🟢 0.56 / 0.47 / +19.5%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 59945910 / 59963894 / -0.0% 66506367 / 66136221 / +0.6% 0.90 / 0.91 / -0.6%
tpch_q02/duckdb:parquet 34619071 / 34891353 / -0.8% 43332266 / 43265556 / +0.2% 0.80 / 0.81 / -0.9%
tpch_q03/duckdb:parquet 61801811 / 62003612 / -0.3% 73839453 / 73370646 / +0.6% 0.84 / 0.85 / -1.0%
tpch_q04/duckdb:parquet 43146798 / 45821942 / -5.8% 56359861 / 54777399 / +2.9% 0.77 / 0.84 / -8.5%
tpch_q05/duckdb:parquet 60540365 / 60514110 / +0.0% 71989434 / 71819382 / +0.2% 0.84 / 0.84 / -0.2%
tpch_q06/duckdb:parquet 20020056 / 20088308 / -0.3% 24464376 / 23927191 / +2.2% 0.82 / 0.84 / -2.5%
tpch_q07/duckdb:parquet 60617874 / 60712073 / -0.2% 71483261 / 71453847 / +0.0% 0.85 / 0.85 / -0.2%
tpch_q08/duckdb:parquet 73527482 / 73288525 / +0.3% 86758923 / 85085551 / +2.0% 0.85 / 0.86 / -1.6%
tpch_q09/duckdb:parquet 113883529 / 113901109 / -0.0% 128074956 / 129603359 / -1.2% 0.89 / 0.88 / +1.2%
tpch_q10/duckdb:parquet 108309654 / 108788709 / -0.4% 124705031 / 122297722 / +2.0% 0.87 / 0.89 / -2.4%
tpch_q11/duckdb:parquet 19932353 / 19913257 / +0.1% 24192724 / 24210287 / -0.1% 0.82 / 0.82 / +0.2%
tpch_q12/duckdb:parquet 41180651 / 41222354 / -0.1% 49391561 / 49356794 / +0.1% 0.83 / 0.84 / -0.2%
tpch_q13/duckdb:parquet 238513504 / 240484432 / -0.8% 247348589 / 249639979 / -0.9% 0.96 / 0.96 / +0.1%
tpch_q14/duckdb:parquet 43446245 / 43498577 / -0.1% 51652353 / 51796206 / -0.3% 0.84 / 0.84 / +0.2%
tpch_q15/duckdb:parquet 24700299 / 24887822 / -0.8% 31173764 / 30676171 / +1.6% 0.79 / 0.81 / -2.3%
tpch_q16/duckdb:parquet 49727682 / 51193194 / -2.9% 57722089 / 59428096 / -2.9% 0.86 / 0.86 / +0.0%
tpch_q17/duckdb:parquet 44603681 / 44431512 / +0.4% 53789002 / 56691446 / -5.1% 0.83 / 0.78 / +5.8%
tpch_q18/duckdb:parquet 89527182 / 89742958 / -0.2% 99504420 / 99295748 / +0.2% 0.90 / 0.90 / -0.4%
tpch_q19/duckdb:parquet 61093400 / 61149426 / -0.1% 70623745 / 71092395 / -0.7% 0.87 / 0.86 / +0.6%
tpch_q20/duckdb:parquet 61729398 / 58661779 / +5.2% 70877489 / 71426932 / -0.8% 0.87 / 0.82 / +6.0%
tpch_q21/duckdb:parquet 136768418 / 136957122 / -0.1% 149850161 / 148414327 / +1.0% 0.91 / 0.92 / -1.1%
tpch_q22/duckdb:parquet 50889875 / 53263397 / -4.5% 57730218 / 60697580 / -4.9% 0.88 / 0.88 / +0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-2.8%, low confidence)
Vortex (geomean): hot 0.975x ➖ · cold 0.977x ➖
Parquet (geomean): hot 0.991x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6792718 / 6933892 / -2.0% 20642862 / 21163070 / -2.5% 0.33 / 0.33 / +0.4%
fineweb_q01/datafusion:vortex-file-compressed 12949342 / 13366968 / -3.1% 53978533 / 53818474 / +0.3% 0.24 / 0.25 / -3.4%
fineweb_q02/datafusion:vortex-file-compressed 12866048 / 14944679 / -13.9% 🟢 61689594 / 58521983 / +5.4% 0.21 / 0.26 / -18.3%
fineweb_q03/datafusion:vortex-file-compressed 20214576 / 19993530 / +1.1% 104012182 / 105810200 / -1.7% 0.19 / 0.19 / +2.9%
fineweb_q04/datafusion:vortex-file-compressed 73948370 / 74080634 / -0.2% 154325511 / 158724515 / -2.8% 0.48 / 0.47 / +2.7%
fineweb_q05/datafusion:vortex-file-compressed 57344482 / 57540900 / -0.3% 141272724 / 136842244 / +3.2% 0.41 / 0.42 / -3.5%
fineweb_q06/datafusion:vortex-file-compressed 19003222 / 18800776 / +1.1% 109552755 / 108562773 / +0.9% 0.17 / 0.17 / +0.2%
fineweb_q07/datafusion:vortex-file-compressed 17803318 / 18174960 / -2.0% 104110944 / 105750658 / -1.6% 0.17 / 0.17 / -0.5%
fineweb_q08/datafusion:vortex-file-compressed 11320410 / 9745000 / +16.2% 🔴 48499119 / 57611014 / -15.8% 🟢 0.23 / 0.17 / +38.0%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9223171 / 9350429 / -1.4% 34063243 / 34563694 / -1.4% 0.27 / 0.27 / +0.1%
fineweb_q01/datafusion:parquet 70658021 / 71525332 / -1.2% 153462931 / 155057792 / -1.0% 0.46 / 0.46 / -0.2%
fineweb_q02/datafusion:parquet 71127741 / 70238682 / +1.3% 158050991 / 160673560 / -1.6% 0.45 / 0.44 / +2.9%
fineweb_q03/datafusion:parquet 69561558 / 69374764 / +0.3% 146789356 / 154548656 / -5.0% 0.47 / 0.45 / +5.6%
fineweb_q04/datafusion:parquet 76047327 / 77635751 / -2.0% 151299954 / 160270689 / -5.6% 0.50 / 0.48 / +3.8%
fineweb_q05/datafusion:parquet 75310213 / 74404374 / +1.2% 151555289 / 158867877 / -4.6% 0.50 / 0.47 / +6.1%
fineweb_q06/datafusion:parquet 71092454 / 71361066 / -0.4% 157556157 / 149918384 / +5.1% 0.45 / 0.48 / -5.2%
fineweb_q07/datafusion:parquet 69186918 / 70168166 / -1.4% 151156933 / 150120898 / +0.7% 0.46 / 0.47 / -2.1%
fineweb_q08/datafusion:parquet 69650217 / 68762889 / +1.3% 151126994 / 158123433 / -4.4% 0.46 / 0.43 / +6.0%
duckdb / vortex-file-compressed / ns (0.956x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2022997 / 2600714 / -22.2% 🟢 5092916 / 5198790 / -2.0% 0.40 / 0.50 / -20.6%
fineweb_q01/duckdb:vortex-file-compressed 16948988 / 18822480 / -10.0% 50546831 / 61660505 / -18.0% 🟢 0.34 / 0.31 / +9.8%
fineweb_q02/duckdb:vortex-file-compressed 19738459 / 18378053 / +7.4% 51344900 / 56475750 / -9.1% 0.38 / 0.33 / +18.1%
fineweb_q03/duckdb:vortex-file-compressed 23399600 / 23105446 / +1.3% 103250509 / 100617005 / +2.6% 0.23 / 0.23 / -1.3%
fineweb_q04/duckdb:vortex-file-compressed 80858272 / 80013718 / +1.1% 138261229 / 134492863 / +2.8% 0.58 / 0.59 / -1.7%
fineweb_q05/duckdb:vortex-file-compressed 60324768 / 61343553 / -1.7% 117427472 / 120252523 / -2.3% 0.51 / 0.51 / +0.7%
fineweb_q06/duckdb:vortex-file-compressed 23901544 / 26068471 / -8.3% 108289355 / 106382126 / +1.8% 0.22 / 0.25 / -9.9%
fineweb_q07/duckdb:vortex-file-compressed 22145452 / 22969954 / -3.6% 97146833 / 96901365 / +0.3% 0.23 / 0.24 / -3.8%
fineweb_q08/duckdb:vortex-file-compressed 11719288 / 11718420 / +0.0% 51852865 / 51575488 / +0.5% 0.23 / 0.23 / -0.5%
duckdb / parquet / ns (0.984x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23042467 / 23861620 / -3.4% 22897019 / 22874882 / +0.1% 1.01 / 1.04 / -3.5%
fineweb_q01/duckdb:parquet 44481690 / 44470458 / +0.0% 55731317 / 58577292 / -4.9% 0.80 / 0.76 / +5.1%
fineweb_q02/duckdb:parquet 44030236 / 43768548 / +0.6% 54480184 / 56379401 / -3.4% 0.81 / 0.78 / +4.1%
fineweb_q03/duckdb:parquet 94845162 / 94624602 / +0.2% 187955479 / 190437695 / -1.3% 0.50 / 0.50 / +1.6%
fineweb_q04/duckdb:parquet 152231045 / 152106854 / +0.1% 213303944 / 221536200 / -3.7% 0.71 / 0.69 / +3.9%
fineweb_q05/duckdb:parquet 143559548 / 143024662 / +0.4% 205832209 / 192549521 / +6.9% 0.70 / 0.74 / -6.1%
fineweb_q06/duckdb:parquet 70884068 / 70958282 / -0.1% 127880554 / 130520181 / -2.0% 0.55 / 0.54 / +2.0%
fineweb_q07/duckdb:parquet 72046148 / 73256394 / -1.7% 161133270 / 160617805 / +0.3% 0.45 / 0.46 / -2.0%
fineweb_q08/duckdb:parquet 22671446 / 25173345 / -9.9% 27331488 / 27283243 / +0.2% 0.83 / 0.92 / -10.1%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.9%
Engines: DataFusion No clear signal (+13.6%, low confidence) · DuckDB No clear signal (-3.2%, low confidence)
Vortex (geomean): hot 1.062x ➖ · cold 1.040x ➖
Parquet (geomean): hot 1.012x ➖ · cold 1.041x ➖
Shifts: Parquet (control) +1.2% · Median polish +1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.138x ❌, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 796117582 / 251501782 / +216.5% 🔴 1031392584 / 556890967 / +85.2% 🔴 0.77 / 0.45 / +70.9%
clickbench-sorted_q24/datafusion:vortex-file-compressed 14353074 / 13680078 / +4.9% 52071110 / 50464520 / +3.2% 0.28 / 0.27 / +1.7%
clickbench-sorted_q26/datafusion:vortex-file-compressed 14090548 / 13637408 / +3.3% 53430860 / 53414835 / +0.0% 0.26 / 0.26 / +3.3%
clickbench-sorted_q36/datafusion:vortex-file-compressed 30079173 / 29494162 / +2.0% 75717449 / 70068484 / +8.1% 0.40 / 0.42 / -5.6%
clickbench-sorted_q37/datafusion:vortex-file-compressed 25080342 / 24450628 / +2.6% 58605181 / 64703476 / -9.4% 0.43 / 0.38 / +13.2%
clickbench-sorted_q38/datafusion:vortex-file-compressed 36139796 / 35204837 / +2.7% 77325996 / 72232871 / +7.1% 0.47 / 0.49 / -4.1%
clickbench-sorted_q39/datafusion:vortex-file-compressed 87848460 / 94269514 / -6.8% 121556358 / 128727166 / -5.6% 0.72 / 0.73 / -1.3%
clickbench-sorted_q40/datafusion:vortex-file-compressed 16305668 / 16158896 / +0.9% 53135103 / 49765767 / +6.8% 0.31 / 0.32 / -5.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed 15238168 / 15014597 / +1.5% 49570089 / 50788324 / -2.4% 0.31 / 0.30 / +4.0%
clickbench-sorted_q42/datafusion:vortex-file-compressed 13774602 / 13256777 / +3.9% 41283753 / 40575129 / +1.7% 0.33 / 0.33 / +2.1%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 755240932 / 749065280 / +0.8% 951642440 / 943202336 / +0.9% 0.79 / 0.79 / -0.1%
clickbench-sorted_q24/datafusion:parquet 8716782 / 8723236 / -0.1% 72261495 / 72215865 / +0.1% 0.12 / 0.12 / -0.1%
clickbench-sorted_q26/datafusion:parquet 9079100 / 9677314 / -6.2% 73741530 / 73550951 / +0.3% 0.12 / 0.13 / -6.4%
clickbench-sorted_q36/datafusion:parquet 94132145 / 93493466 / +0.7% 170598052 / 167664329 / +1.7% 0.55 / 0.56 / -1.0%
clickbench-sorted_q37/datafusion:parquet 65075682 / 64584417 / +0.8% 133100523 / 132490866 / +0.5% 0.49 / 0.49 / +0.3%
clickbench-sorted_q38/datafusion:parquet 88049728 / 87171660 / +1.0% 165100802 / 163685647 / +0.9% 0.53 / 0.53 / +0.1%
clickbench-sorted_q39/datafusion:parquet 159856852 / 159469294 / +0.2% 240771040 / 237434721 / +1.4% 0.66 / 0.67 / -1.1%
clickbench-sorted_q40/datafusion:parquet 45049927 / 44172736 / +2.0% 116152003 / 116072283 / +0.1% 0.39 / 0.38 / +1.9%
clickbench-sorted_q41/datafusion:parquet 43018600 / 41637992 / +3.3% 116557223 / 111161766 / +4.9% 0.37 / 0.37 / -1.5%
clickbench-sorted_q42/datafusion:parquet 26700454 / 26742787 / -0.2% 88402614 / 88189405 / +0.2% 0.30 / 0.30 / -0.4%
duckdb / vortex-file-compressed / ns (0.990x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 65978848 / 69320033 / -4.8% 100911271 / 86673031 / +16.4% 🔴 0.65 / 0.80 / -18.2%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21583238 / 20689810 / +4.3% 33833246 / 33478784 / +1.1% 0.64 / 0.62 / +3.2%
clickbench-sorted_q26/duckdb:vortex-file-compressed 13891921 / 17880314 / -22.3% 🟢 29453367 / 28550914 / +3.2% 0.47 / 0.63 / -24.7%
clickbench-sorted_q36/duckdb:vortex-file-compressed 43518242 / 44003756 / -1.1% 74490621 / 76080222 / -2.1% 0.58 / 0.58 / +1.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed 38777080 / 37076540 / +4.6% 62120083 / 62555769 / -0.7% 0.62 / 0.59 / +5.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed 50126166 / 49278379 / +1.7% 73884226 / 73815017 / +0.1% 0.68 / 0.67 / +1.6%
clickbench-sorted_q39/duckdb:vortex-file-compressed 119974940 / 108375056 / +10.7% 🔴 149705341 / 140362258 / +6.7% 0.80 / 0.77 / +3.8%
clickbench-sorted_q40/duckdb:vortex-file-compressed 21160845 / 21423104 / -1.2% 41905786 / 41466390 / +1.1% 0.50 / 0.52 / -2.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed 21050028 / 21726433 / -3.1% 41324847 / 44132269 / -6.4% 0.51 / 0.49 / +3.5%
clickbench-sorted_q42/duckdb:vortex-file-compressed 19613823 / 18590588 / +5.5% 34443267 / 37887728 / -9.1% 0.57 / 0.49 / +16.1%
duckdb / parquet / ns (1.023x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 130055048 / 126156384 / +3.1% 149177149 / 142441699 / +4.7% 0.87 / 0.89 / -1.6%
clickbench-sorted_q24/duckdb:parquet 17902268 / 17800278 / +0.6% 30365496 / 26780841 / +13.4% 🔴 0.59 / 0.66 / -11.3%
clickbench-sorted_q26/duckdb:parquet 13043101 / 12762350 / +2.2% 28075846 / 22442850 / +25.1% 🔴 0.46 / 0.57 / -18.3%
clickbench-sorted_q36/duckdb:parquet 44478724 / 44840704 / -0.8% 68424731 / 65067879 / +5.2% 0.65 / 0.69 / -5.7%
clickbench-sorted_q37/duckdb:parquet 31253158 / 31648348 / -1.2% 58422522 / 51785921 / +12.8% 🔴 0.53 / 0.61 / -12.5%
clickbench-sorted_q38/duckdb:parquet 44107830 / 41114302 / +7.3% 62685525 / 57731069 / +8.6% 0.70 / 0.71 / -1.2%
clickbench-sorted_q39/duckdb:parquet 73435058 / 69950901 / +5.0% 92705066 / 83410750 / +11.1% 🔴 0.79 / 0.84 / -5.5%
clickbench-sorted_q40/duckdb:parquet 17785620 / 17212734 / +3.3% 44333112 / 49264463 / -10.0% 🟢 0.40 / 0.35 / +14.8%
clickbench-sorted_q41/duckdb:parquet 17142618 / 16822926 / +1.9% 43363866 / 42482403 / +2.1% 0.40 / 0.40 / -0.2%
clickbench-sorted_q42/duckdb:parquet 11475675 / 11276597 / +1.8% 23842664 / 23088893 / +3.3% 0.48 / 0.49 / -1.5%

File Size Changes (100 files changed, -0.0% overall, 41↑ 59↓)
File Scale Format Base HEAD Change %
hits_012.vortex 1.0 vortex-file-compressed 189.73 MB 192.08 MB +2.35 MB +1.2%
hits_084.vortex 1.0 vortex-file-compressed 152.24 MB 153.51 MB +1.27 MB +0.8%
hits_077.vortex 1.0 vortex-file-compressed 171.73 MB 173.09 MB +1.37 MB +0.8%
hits_048.vortex 1.0 vortex-file-compressed 197.49 MB 198.76 MB +1.27 MB +0.6%
hits_050.vortex 1.0 vortex-file-compressed 160.06 MB 160.79 MB +741.09 KB +0.5%
hits_057.vortex 1.0 vortex-file-compressed 158.82 MB 159.48 MB +682.87 KB +0.4%
hits_056.vortex 1.0 vortex-file-compressed 134.51 MB 135.05 MB +546.53 KB +0.4%
hits_051.vortex 1.0 vortex-file-compressed 171.62 MB 172.26 MB +659.86 KB +0.4%
hits_029.vortex 1.0 vortex-file-compressed 198.38 MB 199.05 MB +685.22 KB +0.3%
hits_066.vortex 1.0 vortex-file-compressed 162.33 MB 162.87 MB +559.94 KB +0.3%
hits_079.vortex 1.0 vortex-file-compressed 179.92 MB 180.48 MB +578.58 KB +0.3%
hits_035.vortex 1.0 vortex-file-compressed 102.26 MB 102.57 MB +320.48 KB +0.3%
hits_058.vortex 1.0 vortex-file-compressed 154.31 MB 154.77 MB +469.60 KB +0.3%
hits_052.vortex 1.0 vortex-file-compressed 129.80 MB 130.05 MB +259.49 KB +0.2%
hits_068.vortex 1.0 vortex-file-compressed 159.31 MB 159.61 MB +310.83 KB +0.2%
hits_030.vortex 1.0 vortex-file-compressed 130.84 MB 131.06 MB +227.01 KB +0.2%
hits_095.vortex 1.0 vortex-file-compressed 153.44 MB 153.67 MB +232.71 KB +0.1%
hits_060.vortex 1.0 vortex-file-compressed 191.96 MB 192.24 MB +289.96 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 166.30 MB 166.55 MB +248.70 KB +0.1%
hits_047.vortex 1.0 vortex-file-compressed 153.52 MB 153.73 MB +214.57 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 196.97 MB 197.24 MB +269.54 KB +0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.43 MB 130.57 MB +138.24 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 160.13 MB 160.28 MB +154.34 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 159.51 MB 159.66 MB +152.94 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.35 MB 171.51 MB +164.26 KB +0.1%
hits_088.vortex 1.0 vortex-file-compressed 171.53 MB 171.67 MB +148.88 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.26 MB 130.37 MB +109.40 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 159.91 MB 160.01 MB +99.24 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 194.26 MB 194.36 MB +106.91 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 170.49 MB 170.57 MB +80.70 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.44 MB 130.49 MB +53.34 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.08 MB 156.14 MB +60.10 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.63 MB 125.67 MB +45.34 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 159.99 MB 160.05 MB +57.59 KB +0.0%
hits_055.vortex 1.0 vortex-file-compressed 198.96 MB 199.02 MB +66.99 KB +0.0%
hits_042.vortex 1.0 vortex-file-compressed 200.61 MB 200.67 MB +61.00 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.30 MB 160.35 MB +46.78 KB +0.0%
hits_064.vortex 1.0 vortex-file-compressed 189.92 MB 189.98 MB +54.10 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 159.95 MB 159.96 MB +11.05 KB +0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.74 MB 130.74 MB +3.07 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 176.35 MB 176.35 MB +320 B +0.0%
hits_096.vortex 1.0 vortex-file-compressed 198.79 MB 198.78 MB 3.10 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 198.83 MB 198.83 MB 8.77 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.26 MB 126.25 MB 10.92 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.02 MB 189.01 MB 17.30 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.84 MB 145.82 MB 18.83 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.09 MB 146.07 MB 22.15 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 198.56 MB 198.53 MB 32.14 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.93 MB 159.90 MB 29.74 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.20 MB 191.16 MB 36.23 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 190.44 MB 190.40 MB 36.12 KB -0.0%
hits_001.vortex 1.0 vortex-file-compressed 188.11 MB 188.07 MB 36.55 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 150.75 MB 150.72 MB 30.95 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 139.68 MB 139.65 MB 33.07 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.01 MB 188.97 MB 45.52 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.31 MB 179.25 MB 66.29 KB -0.0%
hits_045.vortex 1.0 vortex-file-compressed 138.70 MB 138.64 MB 53.70 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.40 MB 153.33 MB 64.53 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.88 MB 130.82 MB 62.42 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.69 MB 101.64 MB 50.16 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.88 MB 125.82 MB 66.94 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.14 MB 159.05 MB 84.84 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 171.96 MB 171.87 MB 93.05 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 188.45 MB 188.34 MB 113.22 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.80 MB 130.72 MB 81.79 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 157.79 MB 157.69 MB 104.23 KB -0.1%
hits_097.vortex 1.0 vortex-file-compressed 193.68 MB 193.54 MB 137.41 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.93 MB 153.80 MB 125.68 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.60 MB 100.52 MB 83.24 KB -0.1%
hits_054.vortex 1.0 vortex-file-compressed 146.08 MB 145.96 MB 122.52 KB -0.1%
hits_007.vortex 1.0 vortex-file-compressed 199.42 MB 199.25 MB 179.62 KB -0.1%
hits_003.vortex 1.0 vortex-file-compressed 135.80 MB 135.67 MB 130.66 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 136.84 MB 136.71 MB 135.76 KB -0.1%
hits_022.vortex 1.0 vortex-file-compressed 198.44 MB 198.25 MB 200.72 KB -0.1%
hits_027.vortex 1.0 vortex-file-compressed 189.29 MB 189.07 MB 222.85 KB -0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.25 MB 168.05 MB 204.16 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 170.85 MB 170.64 MB 212.05 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.10 MB 129.94 MB 164.05 KB -0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.51 MB 199.26 MB 254.56 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 191.62 MB 191.37 MB 255.30 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.77 MB 100.64 MB 137.36 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.89 MB 199.62 MB 284.60 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.15 MB 130.94 MB 218.19 KB -0.2%
hits_008.vortex 1.0 vortex-file-compressed 138.81 MB 138.58 MB 236.65 KB -0.2%
hits_040.vortex 1.0 vortex-file-compressed 142.41 MB 142.17 MB 244.41 KB -0.2%
hits_089.vortex 1.0 vortex-file-compressed 131.10 MB 130.85 MB 253.98 KB -0.2%
hits_011.vortex 1.0 vortex-file-compressed 198.55 MB 198.15 MB 400.54 KB -0.2%
hits_015.vortex 1.0 vortex-file-compressed 130.35 MB 130.08 MB 273.41 KB -0.2%
hits_031.vortex 1.0 vortex-file-compressed 158.78 MB 158.39 MB 397.03 KB -0.2%
hits_092.vortex 1.0 vortex-file-compressed 198.85 MB 198.25 MB 609.27 KB -0.3%
hits_069.vortex 1.0 vortex-file-compressed 142.08 MB 141.62 MB 476.06 KB -0.3%
hits_081.vortex 1.0 vortex-file-compressed 199.87 MB 199.22 MB 670.46 KB -0.3%
hits_071.vortex 1.0 vortex-file-compressed 139.19 MB 138.71 MB 491.27 KB -0.3%
hits_014.vortex 1.0 vortex-file-compressed 171.89 MB 171.29 MB 609.84 KB -0.3%
hits_082.vortex 1.0 vortex-file-compressed 139.10 MB 138.60 MB 508.22 KB -0.4%
hits_062.vortex 1.0 vortex-file-compressed 170.61 MB 169.59 MB 1.03 MB -0.6%
hits_018.vortex 1.0 vortex-file-compressed 199.12 MB 197.89 MB 1.23 MB -0.6%
hits_070.vortex 1.0 vortex-file-compressed 199.54 MB 198.17 MB 1.36 MB -0.7%
hits_076.vortex 1.0 vortex-file-compressed 159.94 MB 158.18 MB 1.76 MB -1.1%
hits_034.vortex 1.0 vortex-file-compressed 183.87 MB 181.02 MB 2.85 MB -1.5%

Totals:

  • vortex-file-compressed: 15.87 GB → 15.87 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-1.8%, environment too noisy confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): hot 1.027x ➖ · cold 1.027x ➖
Parquet (geomean): hot 1.035x ➖ · cold 0.955x ➖
Shifts: Parquet (control) +3.5% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.032x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 48300049 / 49205207 / -1.8% 109889991 / 125873000 / -12.7% 0.44 / 0.39 / +12.4%
fineweb_q01/datafusion:vortex-file-compressed 380299728 / 422633017 / -10.0% 600077656 / 676574538 / -11.3% 0.63 / 0.62 / +1.5%
fineweb_q02/datafusion:vortex-file-compressed 379963068 / 391146703 / -2.9% 465877336 / 719605234 / -35.3% 🟢 0.82 / 0.54 / +50.0%
fineweb_q03/datafusion:vortex-file-compressed 480633278 / 546327659 / -12.0% 727494101 / 793818167 / -8.4% 0.66 / 0.69 / -4.0%
fineweb_q04/datafusion:vortex-file-compressed 480504366 / 425391480 / +13.0% 548096842 / 454378174 / +20.6% 0.88 / 0.94 / -6.4%
fineweb_q05/datafusion:vortex-file-compressed 510562698 / 403148144 / +26.6% 643247914 / 392849065 / +63.7% 🔴 0.79 / 1.03 / -22.7%
fineweb_q06/datafusion:vortex-file-compressed 734522800 / 673835674 / +9.0% 731492751 / 689200827 / +6.1% 1.00 / 0.98 / +2.7%
fineweb_q07/datafusion:vortex-file-compressed 532875298 / 473849290 / +12.5% 526888795 / 432339574 / +21.9% 1.01 / 1.10 / -7.7%
fineweb_q08/datafusion:vortex-file-compressed 175135720 / 174323752 / +0.5% 189756789 / 209849403 / -9.6% 0.92 / 0.83 / +11.1%
datafusion / parquet / ns (1.051x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 438489769 / 432742542 / +1.3% 764897345 / 722710376 / +5.8% 0.57 / 0.60 / -4.3%
fineweb_q01/datafusion:parquet 687395803 / 688063536 / -0.1% 612627544 / 716747159 / -14.5% 1.12 / 0.96 / +16.9%
fineweb_q02/datafusion:parquet 793086939 / 745359583 / +6.4% 762689465 / 711320012 / +7.2% 1.04 / 1.05 / -0.8%
fineweb_q03/datafusion:parquet 700396640 / 710369023 / -1.4% 765878351 / 715129537 / +7.1% 0.91 / 0.99 / -7.9%
fineweb_q04/datafusion:parquet 1198712444 / 755548800 / +58.7% 🔴 982083349 / 851742313 / +15.3% 1.22 / 0.89 / +37.6%
fineweb_q05/datafusion:parquet 683117152 / 795393534 / -14.1% 646781631 / 646363949 / +0.1% 1.06 / 1.23 / -14.2%
fineweb_q06/datafusion:parquet 663531088 / 709667849 / -6.5% 611394049 / 843195711 / -27.5% 1.09 / 0.84 / +28.9%
fineweb_q07/datafusion:parquet 699428240 / 698285108 / +0.2% 600828251 / 762872378 / -21.2% 1.16 / 0.92 / +27.2%
fineweb_q08/datafusion:parquet 813048998 / 706756702 / +15.0% 640493744 / 827301228 / -22.6% 1.27 / 0.85 / +48.6%
duckdb / vortex-file-compressed / ns (1.021x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 65666842 / 54400692 / +20.7% 80887583 / 62288009 / +29.9% 0.81 / 0.87 / -7.0%
fineweb_q01/duckdb:vortex-file-compressed 511587683 / 507202272 / +0.9% 595427904 / 511520464 / +16.4% 0.86 / 0.99 / -13.3%
fineweb_q02/duckdb:vortex-file-compressed 642282208 / 663191472 / -3.2% 675388625 / 704477197 / -4.1% 0.95 / 0.94 / +1.0%
fineweb_q03/duckdb:vortex-file-compressed 1449044854 / 1486482330 / -2.5% 1524579487 / 1418743686 / +7.5% 0.95 / 1.05 / -9.3%
fineweb_q04/duckdb:vortex-file-compressed 1567372500 / 1551401424 / +1.0% 1507959642 / 1521361168 / -0.9% 1.04 / 1.02 / +1.9%
fineweb_q05/duckdb:vortex-file-compressed 1410836091 / 1409011393 / +0.1% 1444565885 / 1438233433 / +0.4% 0.98 / 0.98 / -0.3%
fineweb_q06/duckdb:vortex-file-compressed 1558248235 / 1552542935 / +0.4% 1533320845 / 1586347166 / -3.3% 1.02 / 0.98 / +3.8%
fineweb_q07/duckdb:vortex-file-compressed 1453201180 / 1384736524 / +4.9% 1475657373 / 1411726130 / +4.5% 0.98 / 0.98 / +0.4%
fineweb_q08/duckdb:vortex-file-compressed 593586332 / 600890837 / -1.2% 613861267 / 627903294 / -2.2% 0.97 / 0.96 / +1.0%
duckdb / parquet / ns (1.019x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 467544220 / 506660430 / -7.7% 506629467 / 662113362 / -23.5% 0.92 / 0.77 / +20.6%
fineweb_q01/duckdb:parquet 708284608 / 664152426 / +6.6% 536261023 / 622525976 / -13.9% 1.32 / 1.07 / +23.8%
fineweb_q02/duckdb:parquet 629420346 / 651138440 / -3.3% 759365163 / 527504239 / +44.0% 🔴 0.83 / 1.23 / -32.9%
fineweb_q03/duckdb:parquet 1360485920 / 1338508440 / +1.6% 1381220954 / 1309519286 / +5.5% 0.98 / 1.02 / -3.6%
fineweb_q04/duckdb:parquet 756757024 / 709819826 / +6.6% 756882611 / 732719520 / +3.3% 1.00 / 0.97 / +3.2%
fineweb_q05/duckdb:parquet 1014772194 / 833241714 / +21.8% 1023268512 / 807346224 / +26.7% 0.99 / 1.03 / -3.9%
fineweb_q06/duckdb:parquet 1571962340 / 1741856041 / -9.8% 1656575893 / 2088007841 / -20.7% 0.95 / 0.83 / +13.7%
fineweb_q07/duckdb:parquet 1087162010 / 1034670304 / +5.1% 1114789447 / 1231978229 / -9.5% 0.98 / 0.84 / +16.1%
fineweb_q08/duckdb:parquet 510693288 / 514098860 / -0.7% 512420581 / 587422733 / -12.8% 1.00 / 0.88 / +13.9%

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+5.3%, low confidence) · DuckDB No clear signal (-1.1%, environment too noisy confidence)
Vortex (geomean): hot 1.014x ➖ · cold 0.964x ➖
Parquet (geomean): hot 0.994x ➖ · cold 0.976x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.051x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1224274 / 1245523 / -1.7% 20271513 / 22561619 / -10.2% 🟢 0.06 / 0.06 / +9.4%
clickbench_q01/datafusion:vortex-file-compressed 6663416 / 6840983 / -2.6% 31231156 / 34629154 / -9.8% 0.21 / 0.20 / +8.0%
clickbench_q02/datafusion:vortex-file-compressed 12370470 / 13149214 / -5.9% 36732506 / 43829480 / -16.2% 🟢 0.34 / 0.30 / +12.3%
clickbench_q03/datafusion:vortex-file-compressed 13356256 / 13395373 / -0.3% 49010726 / 50735994 / -3.4% 0.27 / 0.26 / +3.2%
clickbench_q04/datafusion:vortex-file-compressed 53607034 / 53806924 / -0.4% 86811380 / 91108880 / -4.7% 0.62 / 0.59 / +4.6%
clickbench_q05/datafusion:vortex-file-compressed 76125364 / 78180112 / -2.6% 111875419 / 115987188 / -3.5% 0.68 / 0.67 / +1.0%
clickbench_q06/datafusion:vortex-file-compressed 1211340 / 1221309 / -0.8% 19956727 / 22082364 / -9.6% 0.06 / 0.06 / +9.7%
clickbench_q07/datafusion:vortex-file-compressed 13017248 / 13069802 / -0.4% 36938265 / 39253942 / -5.9% 0.35 / 0.33 / +5.8%
clickbench_q08/datafusion:vortex-file-compressed 80411024 / 81775472 / -1.7% 119565148 / 122429591 / -2.3% 0.67 / 0.67 / +0.7%
clickbench_q09/datafusion:vortex-file-compressed 173969820 / 174705734 / -0.4% 203594967 / 204838075 / -0.6% 0.85 / 0.85 / +0.2%
clickbench_q10/datafusion:vortex-file-compressed 39868242 / 42754042 / -6.7% 66549338 / 73603377 / -9.6% 0.60 / 0.58 / +3.1%
clickbench_q11/datafusion:vortex-file-compressed 51474900 / 53683230 / -4.1% 78337817 / 84298274 / -7.1% 0.66 / 0.64 / +3.2%
clickbench_q12/datafusion:vortex-file-compressed 77017750 / 76867642 / +0.2% 119113667 / 120801450 / -1.4% 0.65 / 0.64 / +1.6%
clickbench_q13/datafusion:vortex-file-compressed 124299749 / 124718466 / -0.3% 172516143 / 184690370 / -6.6% 0.72 / 0.68 / +6.7%
clickbench_q14/datafusion:vortex-file-compressed 85817794 / 85445066 / +0.4% 124376129 / 129784720 / -4.2% 0.69 / 0.66 / +4.8%
clickbench_q15/datafusion:vortex-file-compressed 61660637 / 62610662 / -1.5% 94601909 / 95451250 / -0.9% 0.65 / 0.66 / -0.6%
clickbench_q16/datafusion:vortex-file-compressed 153690688 / 153737626 / -0.0% 199743129 / 210464020 / -5.1% 0.77 / 0.73 / +5.3%
clickbench_q17/datafusion:vortex-file-compressed 156700058 / 153630384 / +2.0% 205053326 / 206395072 / -0.7% 0.76 / 0.74 / +2.7%
clickbench_q18/datafusion:vortex-file-compressed 303805697 / 300371172 / +1.1% 374094839 / 357061141 / +4.8% 0.81 / 0.84 / -3.5%
clickbench_q19/datafusion:vortex-file-compressed 8205888 / 8233724 / -0.3% 46781107 / 48492850 / -3.5% 0.18 / 0.17 / +3.3%
clickbench_q20/datafusion:vortex-file-compressed 96928896 / 67364869 / +43.9% 🔴 241888800 / 231276565 / +4.6% 0.40 / 0.29 / +37.6%
clickbench_q21/datafusion:vortex-file-compressed 114614114 / 98813997 / +16.0% 🔴 263561642 / 266783939 / -1.2% 0.43 / 0.37 / +17.4%
clickbench_q22/datafusion:vortex-file-compressed 182584168 / 122370401 / +49.2% 🔴 384744381 / 345908054 / +11.2% 🔴 0.47 / 0.35 / +34.1%
clickbench_q23/datafusion:vortex-file-compressed 1742925709 / 362113736 / +381.3% 🔴 1689748648 / 645495898 / +161.8% 🔴 1.03 / 0.56 / +83.9%
clickbench_q24/datafusion:vortex-file-compressed 21362855 / 21277176 / +0.4% 61800862 / 71892682 / -14.0% 🟢 0.35 / 0.30 / +16.8%
clickbench_q25/datafusion:vortex-file-compressed 25407882 / 26104898 / -2.7% 60377631 / 63443239 / -4.8% 0.42 / 0.41 / +2.3%
clickbench_q26/datafusion:vortex-file-compressed 20224890 / 21831440 / -7.4% 62611799 / 71363620 / -12.3% 🟢 0.32 / 0.31 / +5.6%
clickbench_q27/datafusion:vortex-file-compressed 101570309 / 104399663 / -2.7% 243687136 / 247551196 / -1.6% 0.42 / 0.42 / -1.2%
clickbench_q28/datafusion:vortex-file-compressed 577314458 / 578163991 / -0.1% 621620524 / 614028639 / +1.2% 0.93 / 0.94 / -1.4%
clickbench_q29/datafusion:vortex-file-compressed 24878146 / 24670994 / +0.8% 49292159 / 53534143 / -7.9% 0.50 / 0.46 / +9.5%
clickbench_q30/datafusion:vortex-file-compressed 86011884 / 83564254 / +2.9% 127030958 / 128855065 / -1.4% 0.68 / 0.65 / +4.4%
clickbench_q31/datafusion:vortex-file-compressed 85374524 / 83083936 / +2.8% 146711219 / 155924191 / -5.9% 0.58 / 0.53 / +9.2%
clickbench_q32/datafusion:vortex-file-compressed 298983336 / 297616066 / +0.5% 375462156 / 374596680 / +0.2% 0.80 / 0.79 / +0.2%
clickbench_q33/datafusion:vortex-file-compressed 336933416 / 339965750 / -0.9% 408242710 / 409405984 / -0.3% 0.83 / 0.83 / -0.6%
clickbench_q34/datafusion:vortex-file-compressed 333294544 / 342488260 / -2.7% 419395752 / 412954860 / +1.6% 0.79 / 0.83 / -4.2%
clickbench_q35/datafusion:vortex-file-compressed 58425732 / 58498450 / -0.1% 84996068 / 91146581 / -6.7% 0.69 / 0.64 / +7.1%
clickbench_q36/datafusion:vortex-file-compressed 37695121 / 37864940 / -0.4% 66017438 / 69828569 / -5.5% 0.57 / 0.54 / +5.3%
clickbench_q37/datafusion:vortex-file-compressed 21960900 / 22396134 / -1.9% 46261102 / 51328004 / -9.9% 0.47 / 0.44 / +8.8%
clickbench_q38/datafusion:vortex-file-compressed 12490522 / 12311691 / +1.5% 38940204 / 43212244 / -9.9% 0.32 / 0.28 / +12.6%
clickbench_q39/datafusion:vortex-file-compressed 79285090 / 80174516 / -1.1% 110339522 / 114261504 / -3.4% 0.72 / 0.70 / +2.4%
clickbench_q40/datafusion:vortex-file-compressed 11233947 / 11322452 / -0.8% 36081147 / 39239176 / -8.0% 0.31 / 0.29 / +7.9%
clickbench_q41/datafusion:vortex-file-compressed 10676218 / 10762786 / -0.8% 35066445 / 39881008 / -12.1% 🟢 0.30 / 0.27 / +12.8%
clickbench_q42/datafusion:vortex-file-compressed 11411278 / 10977736 / +3.9% 34830929 / 38538571 / -9.6% 0.33 / 0.28 / +15.0%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1245863 / 1256895 / -0.9% 49137923 / 51469823 / -4.5% 0.03 / 0.02 / +3.8%
clickbench_q01/datafusion:parquet 16305463 / 16238660 / +0.4% 74580886 / 69482331 / +7.3% 0.22 / 0.23 / -6.5%
clickbench_q02/datafusion:parquet 19248998 / 19447389 / -1.0% 81549154 / 83716983 / -2.6% 0.24 / 0.23 / +1.6%
clickbench_q03/datafusion:parquet 16979670 / 17795100 / -4.6% 82383435 / 83548633 / -1.4% 0.21 / 0.21 / -3.2%
clickbench_q04/datafusion:parquet 60633816 / 59362818 / +2.1% 126320840 / 126554186 / -0.2% 0.48 / 0.47 / +2.3%
clickbench_q05/datafusion:parquet 86643449 / 89194004 / -2.9% 156933936 / 154588057 / +1.5% 0.55 / 0.58 / -4.3%
clickbench_q06/datafusion:parquet 1262978 / 1277538 / -1.1% 48445674 / 50355364 / -3.8% 0.03 / 0.03 / +2.8%
clickbench_q07/datafusion:parquet 17286508 / 17101328 / +1.1% 71561744 / 74119009 / -3.5% 0.24 / 0.23 / +4.7%
clickbench_q08/datafusion:parquet 83023094 / 83038230 / -0.0% 162471495 / 164282322 / -1.1% 0.51 / 0.51 / +1.1%
clickbench_q09/datafusion:parquet 188466658 / 190412686 / -1.0% 265239665 / 268317971 / -1.1% 0.71 / 0.71 / +0.1%
clickbench_q10/datafusion:parquet 35503690 / 35193130 / +0.9% 100630536 / 105507652 / -4.6% 0.35 / 0.33 / +5.8%
clickbench_q11/datafusion:parquet 42427168 / 42468958 / -0.1% 111251927 / 114976677 / -3.2% 0.38 / 0.37 / +3.2%
clickbench_q12/datafusion:parquet 94706439 / 94484402 / +0.2% 159629134 / 163625384 / -2.4% 0.59 / 0.58 / +2.7%
clickbench_q13/datafusion:parquet 141995473 / 142683131 / -0.5% 219645787 / 228630049 / -3.9% 0.65 / 0.62 / +3.6%
clickbench_q14/datafusion:parquet 100513305 / 100169054 / +0.3% 173383930 / 177581431 / -2.4% 0.58 / 0.56 / +2.8%
clickbench_q15/datafusion:parquet 71612893 / 72607644 / -1.4% 129492526 / 139573932 / -7.2% 0.55 / 0.52 / +6.3%
clickbench_q16/datafusion:parquet 155005477 / 154926462 / +0.1% 231618246 / 232668951 / -0.5% 0.67 / 0.67 / +0.5%
clickbench_q17/datafusion:parquet 152974628 / 153192300 / -0.1% 230026207 / 234181075 / -1.8% 0.67 / 0.65 / +1.7%
clickbench_q18/datafusion:parquet 309841290 / 311387464 / -0.5% 408921789 / 408243892 / +0.2% 0.76 / 0.76 / -0.7%
clickbench_q19/datafusion:parquet 19850577 / 19848738 / +0.0% 75404614 / 78789209 / -4.3% 0.26 / 0.25 / +4.5%
clickbench_q20/datafusion:parquet 168696528 / 168628616 / +0.0% 278132210 / 296658386 / -6.2% 0.61 / 0.57 / +6.7%
clickbench_q21/datafusion:parquet 163385152 / 165450005 / -1.2% 283937583 / 310901704 / -8.7% 0.58 / 0.53 / +8.1%
clickbench_q22/datafusion:parquet 247318315 / 247290412 / +0.0% 408965397 / 454969395 / -10.1% 🟢 0.60 / 0.54 / +11.3%
clickbench_q23/datafusion:parquet 977479486 / 949790700 / +2.9% 1162618224 / 1191636881 / -2.4% 0.84 / 0.80 / +5.5%
clickbench_q24/datafusion:parquet 29860703 / 29600306 / +0.9% 85506638 / 93250095 / -8.3% 0.35 / 0.32 / +10.0%
clickbench_q25/datafusion:parquet 36260570 / 36092682 / +0.5% 100316235 / 103950314 / -3.5% 0.36 / 0.35 / +4.1%
clickbench_q26/datafusion:parquet 30685640 / 30724232 / -0.1% 87021846 / 93396804 / -6.8% 0.35 / 0.33 / +7.2%
clickbench_q27/datafusion:parquet 182369238 / 181823468 / +0.3% 271868346 / 292516961 / -7.1% 0.67 / 0.62 / +7.9%
clickbench_q28/datafusion:parquet 619545750 / 619559321 / -0.0% 695574208 / 700413475 / -0.7% 0.89 / 0.88 / +0.7%
clickbench_q29/datafusion:parquet 28810092 / 28163768 / +2.3% 89617926 / 92560679 / -3.2% 0.32 / 0.30 / +5.7%
clickbench_q30/datafusion:parquet 88367746 / 88601664 / -0.3% 165291738 / 172389863 / -4.1% 0.53 / 0.51 / +4.0%
clickbench_q31/datafusion:parquet 99659144 / 100731162 / -1.1% 188359409 / 194279732 / -3.0% 0.53 / 0.52 / +2.0%
clickbench_q32/datafusion:parquet 312631685 / 317865202 / -1.6% 414782181 / 416773336 / -0.5% 0.75 / 0.76 / -1.2%
clickbench_q33/datafusion:parquet 365894872 / 369092164 / -0.9% 448454615 / 460084388 / -2.5% 0.82 / 0.80 / +1.7%
clickbench_q34/datafusion:parquet 371540730 / 370070314 / +0.4% 457300542 / 460565928 / -0.7% 0.81 / 0.80 / +1.1%
clickbench_q35/datafusion:parquet 63741156 / 64072940 / -0.5% 121718881 / 125715513 / -3.2% 0.52 / 0.51 / +2.7%
clickbench_q36/datafusion:parquet 73325872 / 73630645 / -0.4% 133275658 / 138188189 / -3.6% 0.55 / 0.53 / +3.3%
clickbench_q37/datafusion:parquet 36016477 / 35622491 / +1.1% 90299379 / 94844155 / -4.8% 0.40 / 0.38 / +6.2%
clickbench_q38/datafusion:parquet 47416640 / 47640830 / -0.5% 104902196 / 110805342 / -5.3% 0.45 / 0.43 / +5.1%
clickbench_q39/datafusion:parquet 143342815 / 144040690 / -0.5% 207197110 / 213301504 / -2.9% 0.69 / 0.68 / +2.4%
clickbench_q40/datafusion:parquet 20649460 / 20839260 / -0.9% 76905381 / 80996078 / -5.1% 0.27 / 0.26 / +4.4%
clickbench_q41/datafusion:parquet 19328422 / 19409724 / -0.4% 75616370 / 78719473 / -3.9% 0.26 / 0.25 / +3.7%
clickbench_q42/datafusion:parquet 19552528 / 19829224 / -1.4% 73533456 / 77823474 / -5.5% 0.27 / 0.25 / +4.4%
duckdb / vortex-file-compressed / ns (0.979x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1551526 / 1712154 / -9.4% 27754278 / 25211085 / +10.1% 🔴 0.06 / 0.07 / -17.7%
clickbench_q01/duckdb:vortex-file-compressed 11862213 / 13757478 / -13.8% 🟢 30342632 / 29787612 / +1.9% 0.39 / 0.46 / -15.4%
clickbench_q02/duckdb:vortex-file-compressed 13276634 / 16322958 / -18.7% 🟢 30465223 / 32828720 / -7.2% 0.44 / 0.50 / -12.4%
clickbench_q03/duckdb:vortex-file-compressed 18052977 / 18464118 / -2.2% 40420572 / 48325401 / -16.4% 🟢 0.45 / 0.38 / +16.9%
clickbench_q04/duckdb:vortex-file-compressed 68250768 / 70380235 / -3.0% 94205087 / 104114672 / -9.5% 0.72 / 0.68 / +7.2%
clickbench_q05/duckdb:vortex-file-compressed 71324989 / 69454868 / +2.7% 95711570 / 95338325 / +0.4% 0.75 / 0.73 / +2.3%
clickbench_q06/duckdb:vortex-file-compressed 1931136 / 2048982 / -5.8% 31809457 / 32109237 / -0.9% 0.06 / 0.06 / -4.9%
clickbench_q07/duckdb:vortex-file-compressed 15423590 / 14352193 / +7.5% 32783938 / 32182445 / +1.9% 0.47 / 0.45 / +5.5%
clickbench_q08/duckdb:vortex-file-compressed 90192166 / 85943976 / +4.9% 125880420 / 128546658 / -2.1% 0.72 / 0.67 / +7.2%
clickbench_q09/duckdb:vortex-file-compressed 109797780 / 107068753 / +2.5% 149423938 / 159529617 / -6.3% 0.73 / 0.67 / +9.5%
clickbench_q10/duckdb:vortex-file-compressed 44300126 / 43660252 / +1.5% 73986445 / 77327337 / -4.3% 0.60 / 0.56 / +6.0%
clickbench_q11/duckdb:vortex-file-compressed 57345432 / 58604652 / -2.1% 83601515 / 89934802 / -7.0% 0.69 / 0.65 / +5.3%
clickbench_q12/duckdb:vortex-file-compressed 75283358 / 76213712 / -1.2% 104464774 / 104504417 / -0.0% 0.72 / 0.73 / -1.2%
clickbench_q13/duckdb:vortex-file-compressed 141738702 / 142282160 / -0.4% 179345011 / 182540079 / -1.8% 0.79 / 0.78 / +1.4%
clickbench_q14/duckdb:vortex-file-compressed 84075597 / 83891556 / +0.2% 112296141 / 112467995 / -0.2% 0.75 / 0.75 / +0.4%
clickbench_q15/duckdb:vortex-file-compressed 91512176 / 92993753 / -1.6% 129401014 / 138064469 / -6.3% 0.71 / 0.67 / +5.0%
clickbench_q16/duckdb:vortex-file-compressed 164770618 / 164246716 / +0.3% 209422221 / 214513283 / -2.4% 0.79 / 0.77 / +2.8%
clickbench_q17/duckdb:vortex-file-compressed 163932468 / 167288120 / -2.0% 205748463 / 226527302 / -9.2% 0.80 / 0.74 / +7.9%
clickbench_q18/duckdb:vortex-file-compressed 327708382 / 341660748 / -4.1% 398340743 / 409280657 / -2.7% 0.82 / 0.83 / -1.4%
clickbench_q19/duckdb:vortex-file-compressed 17622062 / 17664082 / -0.2% 38051424 / 41243258 / -7.7% 0.46 / 0.43 / +8.1%
clickbench_q20/duckdb:vortex-file-compressed 128053176 / 126882042 / +0.9% 201639448 / 208734891 / -3.4% 0.64 / 0.61 / +4.5%
clickbench_q21/duckdb:vortex-file-compressed 180724328 / 180152445 / +0.3% 298913993 / 324907761 / -8.0% 0.60 / 0.55 / +9.0%
clickbench_q22/duckdb:vortex-file-compressed 282227359 / 287880068 / -2.0% 467764184 / 542677099 / -13.8% 🟢 0.60 / 0.53 / +13.7%
clickbench_q23/duckdb:vortex-file-compressed 69857924 / 72789988 / -4.0% 104061516 / 118673810 / -12.3% 🟢 0.67 / 0.61 / +9.4%
clickbench_q24/duckdb:vortex-file-compressed 28789813 / 28108308 / +2.4% 42088422 / 47275953 / -11.0% 🟢 0.68 / 0.59 / +15.0%
clickbench_q25/duckdb:vortex-file-compressed 34980998 / 35259392 / -0.8% 53010429 / 55011796 / -3.6% 0.66 / 0.64 / +3.0%
clickbench_q26/duckdb:vortex-file-compressed 20490052 / 21628731 / -5.3% 35847109 / 36152259 / -0.8% 0.57 / 0.60 / -4.5%
clickbench_q27/duckdb:vortex-file-compressed 170079294 / 172896180 / -1.6% 262471306 / 281416260 / -6.7% 0.65 / 0.61 / +5.5%
clickbench_q28/duckdb:vortex-file-compressed 589450114 / 689069028 / -14.5% 🟢 685849124 / 697960522 / -1.7% 0.86 / 0.99 / -12.9%
clickbench_q29/duckdb:vortex-file-compressed 17533367 / 19682209 / -10.9% 🟢 41435400 / 42217944 / -1.9% 0.42 / 0.47 / -9.2%
clickbench_q30/duckdb:vortex-file-compressed 94783338 / 94518078 / +0.3% 128847841 / 132980415 / -3.1% 0.74 / 0.71 / +3.5%
clickbench_q31/duckdb:vortex-file-compressed 142941450 / 142729297 / +0.1% 209041138 / 233218333 / -10.4% 🟢 0.68 / 0.61 / +11.7%
clickbench_q32/duckdb:vortex-file-compressed 448549524 / 457181883 / -1.9% 547112908 / 497031032 / +10.1% 🔴 0.82 / 0.92 / -10.9%
clickbench_q33/duckdb:vortex-file-compressed 409302220 / 410717963 / -0.3% 510935005 / 538956080 / -5.2% 0.80 / 0.76 / +5.1%
clickbench_q34/duckdb:vortex-file-compressed 418721038 / 428097652 / -2.2% 541171638 / 550558118 / -1.7% 0.77 / 0.78 / -0.5%
clickbench_q35/duckdb:vortex-file-compressed 105640388 / 104084764 / +1.5% 137797956 / 154159533 / -10.6% 🟢 0.77 / 0.68 / +13.5%
clickbench_q36/duckdb:vortex-file-compressed 17484829 / 17087112 / +2.3% 31824662 / 38334975 / -17.0% 🟢 0.55 / 0.45 / +23.3%
clickbench_q37/duckdb:vortex-file-compressed 12931920 / 13253437 / -2.4% 28730311 / 28001721 / +2.6% 0.45 / 0.47 / -4.9%
clickbench_q38/duckdb:vortex-file-compressed 14585334 / 15464252 / -5.7% 30206232 / 29752039 / +1.5% 0.48 / 0.52 / -7.1%
clickbench_q39/duckdb:vortex-file-compressed 26164734 / 27493765 / -4.8% 40628803 / 47690986 / -14.8% 🟢 0.64 / 0.58 / +11.7%
clickbench_q40/duckdb:vortex-file-compressed 13223140 / 13236668 / -0.1% 26351505 / 29387750 / -10.3% 🟢 0.50 / 0.45 / +11.4%
clickbench_q41/duckdb:vortex-file-compressed 13229254 / 13121468 / +0.8% 28069776 / 30232494 / -7.2% 0.47 / 0.43 / +8.6%
clickbench_q42/duckdb:vortex-file-compressed 14641021 / 13506384 / +8.4% 32070297 / 29113655 / +10.2% 🔴 0.46 / 0.46 / -1.6%
duckdb / parquet / ns (0.990x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 10992348 / 10058288 / +9.3% 23475513 / 24196569 / -3.0% 0.47 / 0.42 / +12.6%
clickbench_q01/duckdb:parquet 10566576 / 10415772 / +1.4% 22937388 / 22096886 / +3.8% 0.46 / 0.47 / -2.3%
clickbench_q02/duckdb:parquet 15571572 / 19160524 / -18.7% 🟢 30212632 / 34657782 / -12.8% 🟢 0.52 / 0.55 / -6.8%
clickbench_q03/duckdb:parquet 15570646 / 16934224 / -8.1% 53260412 / 53864091 / -1.1% 0.29 / 0.31 / -7.0%
clickbench_q04/duckdb:parquet 70297977 / 70994103 / -1.0% 93890549 / 97359156 / -3.6% 0.75 / 0.73 / +2.7%
clickbench_q05/duckdb:parquet 81766696 / 83050498 / -1.5% 130011677 / 125218650 / +3.8% 0.63 / 0.66 / -5.2%
clickbench_q06/duckdb:parquet 15473478 / 15516976 / -0.3% 23094404 / 24360662 / -5.2% 0.67 / 0.64 / +5.2%
clickbench_q07/duckdb:parquet 14057889 / 12344893 / +13.9% 🔴 23552266 / 22077500 / +6.7% 0.60 / 0.56 / +6.7%
clickbench_q08/duckdb:parquet 85847369 / 89185530 / -3.7% 129016898 / 125791374 / +2.6% 0.67 / 0.71 / -6.1%
clickbench_q09/duckdb:parquet 121080790 / 115878353 / +4.5% 154619870 / 158214142 / -2.3% 0.78 / 0.73 / +6.9%
clickbench_q10/duckdb:parquet 32852554 / 33912052 / -3.1% 67689210 / 69700832 / -2.9% 0.49 / 0.49 / -0.2%
clickbench_q11/duckdb:parquet 35869388 / 38947598 / -7.9% 75065048 / 74942688 / +0.2% 0.48 / 0.52 / -8.1%
clickbench_q12/duckdb:parquet 91305942 / 93689246 / -2.5% 133289554 / 132091719 / +0.9% 0.69 / 0.71 / -3.4%
clickbench_q13/duckdb:parquet 146614100 / 156911142 / -6.6% 218095834 / 215290106 / +1.3% 0.67 / 0.73 / -7.8%
clickbench_q14/duckdb:parquet 99416836 / 97776847 / +1.7% 137728692 / 152195838 / -9.5% 0.72 / 0.64 / +12.4%
clickbench_q15/duckdb:parquet 94002680 / 94526044 / -0.6% 123387620 / 118156654 / +4.4% 0.76 / 0.80 / -4.8%
clickbench_q16/duckdb:parquet 173753173 / 176850161 / -1.8% 221938934 / 234391040 / -5.3% 0.78 / 0.75 / +3.8%
clickbench_q17/duckdb:parquet 178964760 / 179547160 / -0.3% 231837472 / 239483932 / -3.2% 0.77 / 0.75 / +3.0%
clickbench_q18/duckdb:parquet 324015571 / 326819139 / -0.9% 404980003 / 421960177 / -4.0% 0.80 / 0.77 / +3.3%
clickbench_q19/duckdb:parquet 13303142 / 14080410 / -5.5% 41695595 / 43060912 / -3.2% 0.32 / 0.33 / -2.4%
clickbench_q20/duckdb:parquet 140801395 / 136670278 / +3.0% 248287615 / 250304293 / -0.8% 0.57 / 0.55 / +3.9%
clickbench_q21/duckdb:parquet 188443594 / 186377248 / +1.1% 329707246 / 326001692 / +1.1% 0.57 / 0.57 / -0.0%
clickbench_q22/duckdb:parquet 243028996 / 256322316 / -5.2% 401490322 / 422843740 / -5.0% 0.61 / 0.61 / -0.1%
clickbench_q23/duckdb:parquet 144611276 / 145801442 / -0.8% 187024496 / 168889928 / +10.7% 🔴 0.77 / 0.86 / -10.4%
clickbench_q24/duckdb:parquet 43769954 / 43570504 / +0.5% 63956163 / 63171206 / +1.2% 0.68 / 0.69 / -0.8%
clickbench_q25/duckdb:parquet 40928366 / 40016216 / +2.3% 88741776 / 93942869 / -5.5% 0.46 / 0.43 / +8.3%
clickbench_q26/duckdb:parquet 32065000 / 30022046 / +6.8% 57521655 / 49540117 / +16.1% 🔴 0.56 / 0.61 / -8.0%
clickbench_q27/duckdb:parquet 145063432 / 147167856 / -1.4% 256748080 / 262692807 / -2.3% 0.57 / 0.56 / +0.9%
clickbench_q28/duckdb:parquet 903913282 / 904778150 / -0.1% 1000813729 / 1008550676 / -0.8% 0.90 / 0.90 / +0.7%
clickbench_q29/duckdb:parquet 18155052 / 17486018 / +3.8% 33395516 / 31960998 / +4.5% 0.54 / 0.55 / -0.6%
clickbench_q30/duckdb:parquet 91070086 / 91532238 / -0.5% 171631610 / 174841180 / -1.8% 0.53 / 0.52 / +1.4%
clickbench_q31/duckdb:parquet 147065538 / 146371248 / +0.5% 261970827 / 357044338 / -26.6% 🟢 0.56 / 0.41 / +36.9%
clickbench_q32/duckdb:parquet 448304152 / 442153258 / +1.4% 493714680 / 489118006 / +0.9% 0.91 / 0.90 / +0.4%
clickbench_q33/duckdb:parquet 438966389 / 449550294 / -2.4% 482881375 / 489888622 / -1.4% 0.91 / 0.92 / -0.9%
clickbench_q34/duckdb:parquet 454076870 / 459288414 / -1.1% 484087746 / 495641565 / -2.3% 0.94 / 0.93 / +1.2%
clickbench_q35/duckdb:parquet 100096628 / 102576345 / -2.4% 126468522 / 131639462 / -3.9% 0.79 / 0.78 / +1.6%
clickbench_q36/duckdb:parquet 31079274 / 31495830 / -1.3% 41242735 / 42310257 / -2.5% 0.75 / 0.74 / +1.2%
clickbench_q37/duckdb:parquet 22326104 / 23069703 / -3.2% 31133425 / 32044507 / -2.8% 0.72 / 0.72 / -0.4%
clickbench_q38/duckdb:parquet 23605672 / 24686998 / -4.4% 34569282 / 33464773 / +3.3% 0.68 / 0.74 / -7.4%
clickbench_q39/duckdb:parquet 56669439 / 57520846 / -1.5% 66175540 / 66563610 / -0.6% 0.86 / 0.86 / -0.9%
clickbench_q40/duckdb:parquet 12705770 / 12597993 / +0.9% 21536459 / 22497487 / -4.3% 0.59 / 0.56 / +5.4%
clickbench_q41/duckdb:parquet 13133294 / 13303444 / -1.3% 22604559 / 22650028 / -0.2% 0.58 / 0.59 / -1.1%
clickbench_q42/duckdb:parquet 15022332 / 15181109 / -1.0% 25047459 / 25279349 / -0.9% 0.60 / 0.60 / -0.1%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+0.4%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 23877298 / 23743401 / +0.6% 43316178 / 44205108 / -2.0% 0.55 / 0.54 / +2.6%
tpcds_q02/datafusion:vortex-file-compressed 44930484 / 44834000 / +0.2% 63510138 / 64618186 / -1.7% 0.71 / 0.69 / +2.0%
tpcds_q03/datafusion:vortex-file-compressed 11482402 / 11430046 / +0.5% 31265548 / 31213574 / +0.2% 0.37 / 0.37 / +0.3%
tpcds_q04/datafusion:vortex-file-compressed 113256388 / 111937174 / +1.2% 145146640 / 141536446 / +2.6% 0.78 / 0.79 / -1.3%
tpcds_q05/datafusion:vortex-file-compressed 58249922 / 58723031 / -0.8% 80616410 / 83044760 / -2.9% 0.72 / 0.71 / +2.2%
tpcds_q06/datafusion:vortex-file-compressed 23740326 / 23290077 / +1.9% 44136773 / 47352766 / -6.8% 0.54 / 0.49 / +9.4%
tpcds_q07/datafusion:vortex-file-compressed 31801862 / 31632394 / +0.5% 55729483 / 58374874 / -4.5% 0.57 / 0.54 / +5.3%
tpcds_q08/datafusion:vortex-file-compressed 26188374 / 26047226 / +0.5% 45007797 / 44719593 / +0.6% 0.58 / 0.58 / -0.1%
tpcds_q09/datafusion:vortex-file-compressed 18086262 / 17918916 / +0.9% 35262569 / 34593372 / +1.9% 0.51 / 0.52 / -1.0%
tpcds_q10/datafusion:vortex-file-compressed 29063430 / 29317236 / -0.9% 50716249 / 51228902 / -1.0% 0.57 / 0.57 / +0.1%
tpcds_q11/datafusion:vortex-file-compressed 60252564 / 60574202 / -0.5% 84787647 / 86109767 / -1.5% 0.71 / 0.70 / +1.0%
tpcds_q12/datafusion:vortex-file-compressed 16803016 / 16452180 / +2.1% 33256439 / 33564415 / -0.9% 0.51 / 0.49 / +3.1%
tpcds_q13/datafusion:vortex-file-compressed 36548108 / 37279780 / -2.0% 60217814 / 61525460 / -2.1% 0.61 / 0.61 / +0.2%
tpcds_q14/datafusion:vortex-file-compressed 92722797 / 92441222 / +0.3% 119560268 / 118739545 / +0.7% 0.78 / 0.78 / -0.4%
tpcds_q15/datafusion:vortex-file-compressed 24980186 / 24508936 / +1.9% 45075169 / 46209582 / -2.5% 0.55 / 0.53 / +4.5%
tpcds_q16/datafusion:vortex-file-compressed 20876229 / 20823877 / +0.3% 43212433 / 43496660 / -0.7% 0.48 / 0.48 / +0.9%
tpcds_q17/datafusion:vortex-file-compressed 61945173 / 60446951 / +2.5% 83645752 / 85805627 / -2.5% 0.74 / 0.70 / +5.1%
tpcds_q18/datafusion:vortex-file-compressed 68181640 / 68086845 / +0.1% 89310563 / 95180086 / -6.2% 0.76 / 0.72 / +6.7%
tpcds_q19/datafusion:vortex-file-compressed 17996001 / 18306282 / -1.7% 39672097 / 42266699 / -6.1% 0.45 / 0.43 / +4.7%
tpcds_q20/datafusion:vortex-file-compressed 17470168 / 17570485 / -0.6% 35067619 / 35933299 / -2.4% 0.50 / 0.49 / +1.9%
tpcds_q21/datafusion:vortex-file-compressed 16919628 / 16655540 / +1.6% 40550768 / 42440656 / -4.5% 0.42 / 0.39 / +6.3%
tpcds_q22/datafusion:vortex-file-compressed 49554622 / 49284092 / +0.5% 70777901 / 70853767 / -0.1% 0.70 / 0.70 / +0.7%
tpcds_q23/datafusion:vortex-file-compressed 70587253 / 70185505 / +0.6% 95612142 / 99037147 / -3.5% 0.74 / 0.71 / +4.2%
tpcds_q24/datafusion:vortex-file-compressed 68495148 / 68543478 / -0.1% 93492703 / 94817847 / -1.4% 0.73 / 0.72 / +1.3%
tpcds_q25/datafusion:vortex-file-compressed 54834663 / 54077870 / +1.4% 79119348 / 72839366 / +8.6% 0.69 / 0.74 / -6.6%
tpcds_q26/datafusion:vortex-file-compressed 30137348 / 29883386 / +0.8% 52161828 / 53548674 / -2.6% 0.58 / 0.56 / +3.5%
tpcds_q27/datafusion:vortex-file-compressed 61055297 / 61005695 / +0.1% 85060398 / 90674001 / -6.2% 0.72 / 0.67 / +6.7%
tpcds_q28/datafusion:vortex-file-compressed 18156348 / 17446284 / +4.1% 37110166 / 40171158 / -7.6% 0.49 / 0.43 / +12.7%
tpcds_q29/datafusion:vortex-file-compressed 53134040 / 54952501 / -3.3% 75326440 / 81955904 / -8.1% 0.71 / 0.67 / +5.2%
tpcds_q30/datafusion:vortex-file-compressed 27713118 / 27276713 / +1.6% 48388317 / 46252364 / +4.6% 0.57 / 0.59 / -2.9%
tpcds_q31/datafusion:vortex-file-compressed 63587274 / 63516748 / +0.1% 89977598 / 93320346 / -3.6% 0.71 / 0.68 / +3.8%
tpcds_q32/datafusion:vortex-file-compressed 13705838 / 13674476 / +0.2% 31548962 / 31623106 / -0.2% 0.43 / 0.43 / +0.5%
tpcds_q33/datafusion:vortex-file-compressed 26676489 / 26409190 / +1.0% 49325756 / 49577345 / -0.5% 0.54 / 0.53 / +1.5%
tpcds_q34/datafusion:vortex-file-compressed 18224298 / 17919202 / +1.7% 35425242 / 40411900 / -12.3% 🟢 0.51 / 0.44 / +16.0%
tpcds_q35/datafusion:vortex-file-compressed 35672504 / 34824013 / +2.4% 59208067 / 57252487 / +3.4% 0.60 / 0.61 / -0.9%
tpcds_q36/datafusion:vortex-file-compressed 46162906 / 46983224 / -1.7% 68175053 / 71865606 / -5.1% 0.68 / 0.65 / +3.6%
tpcds_q37/datafusion:vortex-file-compressed 13411480 / 13203715 / +1.6% 38001961 / 36516591 / +4.1% 0.35 / 0.36 / -2.4%
tpcds_q38/datafusion:vortex-file-compressed 29661404 / 29261160 / +1.4% 51904093 / 51349322 / +1.1% 0.57 / 0.57 / +0.3%
tpcds_q39/datafusion:vortex-file-compressed 64438612 / 64013852 / +0.7% 88786664 / 94382746 / -5.9% 0.73 / 0.68 / +7.0%
tpcds_q40/datafusion:vortex-file-compressed 25137911 / 24761358 / +1.5% 45071010 / 46454362 / -3.0% 0.56 / 0.53 / +4.6%
tpcds_q41/datafusion:vortex-file-compressed 17722412 / 16171974 / +9.6% 32213266 / 32201932 / +0.0% 0.55 / 0.50 / +9.5%
tpcds_q42/datafusion:vortex-file-compressed 10846715 / 10776108 / +0.7% 27977301 / 30425500 / -8.0% 0.39 / 0.35 / +9.5%
tpcds_q43/datafusion:vortex-file-compressed 12584792 / 13129670 / -4.1% 33448858 / 34699575 / -3.6% 0.38 / 0.38 / -0.6%
tpcds_q44/datafusion:vortex-file-compressed 25962715 / 25810210 / +0.6% 50035077 / 51016667 / -1.9% 0.52 / 0.51 / +2.6%
tpcds_q45/datafusion:vortex-file-compressed 28329097 / 27822328 / +1.8% 48720657 / 51795399 / -5.9% 0.58 / 0.54 / +8.2%
tpcds_q46/datafusion:vortex-file-compressed 23908267 / 23882754 / +0.1% 47727537 / 48276608 / -1.1% 0.50 / 0.49 / +1.3%
tpcds_q47/datafusion:vortex-file-compressed 77065402 / 77001496 / +0.1% 103809102 / 103999216 / -0.2% 0.74 / 0.74 / +0.3%
tpcds_q48/datafusion:vortex-file-compressed 31633627 / 31985916 / -1.1% 55107628 / 55489796 / -0.7% 0.57 / 0.58 / -0.4%
tpcds_q49/datafusion:vortex-file-compressed 59133292 / 58749288 / +0.7% 84446845 / 84886667 / -0.5% 0.70 / 0.69 / +1.2%
tpcds_q50/datafusion:vortex-file-compressed 33055743 / 32546488 / +1.6% 54391622 / 54855955 / -0.8% 0.61 / 0.59 / +2.4%
tpcds_q51/datafusion:vortex-file-compressed 60458130 / 60820087 / -0.6% 87676906 / 85735435 / +2.3% 0.69 / 0.71 / -2.8%
tpcds_q52/datafusion:vortex-file-compressed 11320836 / 11317024 / +0.0% 28746037 / 30009371 / -4.2% 0.39 / 0.38 / +4.4%
tpcds_q53/datafusion:vortex-file-compressed 17028009 / 18106146 / -6.0% 35745191 / 39741573 / -10.1% 🟢 0.48 / 0.46 / +4.6%
tpcds_q54/datafusion:vortex-file-compressed 33685742 / 33668494 / +0.1% 57383078 / 60579413 / -5.3% 0.59 / 0.56 / +5.6%
tpcds_q55/datafusion:vortex-file-compressed 11042418 / 10938404 / +1.0% 28554427 / 30609807 / -6.7% 0.39 / 0.36 / +8.2%
tpcds_q56/datafusion:vortex-file-compressed 26168268 / 25883602 / +1.1% 47208329 / 49620200 / -4.9% 0.55 / 0.52 / +6.3%
tpcds_q57/datafusion:vortex-file-compressed 73470522 / 73099385 / +0.5% 99626507 / 100813205 / -1.2% 0.74 / 0.73 / +1.7%
tpcds_q58/datafusion:vortex-file-compressed 39883992 / 40760280 / -2.1% 65468022 / 67687695 / -3.3% 0.61 / 0.60 / +1.2%
tpcds_q59/datafusion:vortex-file-compressed 30556914 / 31047288 / -1.6% 51215095 / 52964463 / -3.3% 0.60 / 0.59 / +1.8%
tpcds_q60/datafusion:vortex-file-compressed 25934479 / 25632363 / +1.2% 47772957 / 49252577 / -3.0% 0.54 / 0.52 / +4.3%
tpcds_q61/datafusion:vortex-file-compressed 23535028 / 23295760 / +1.0% 47423503 / 48759395 / -2.7% 0.50 / 0.48 / +3.9%
tpcds_q62/datafusion:vortex-file-compressed 17265797 / 17108032 / +0.9% 35389182 / 37053316 / -4.5% 0.49 / 0.46 / +5.7%
tpcds_q63/datafusion:vortex-file-compressed 17136118 / 17755346 / -3.5% 35364908 / 39044954 / -9.4% 0.48 / 0.45 / +6.6%
tpcds_q64/datafusion:vortex-file-compressed 324539978 / 324304501 / +0.1% 358604618 / 351318584 / +2.1% 0.91 / 0.92 / -2.0%
tpcds_q65/datafusion:vortex-file-compressed 74720919 / 74585139 / +0.2% 96444954 / 96664868 / -0.2% 0.77 / 0.77 / +0.4%
tpcds_q66/datafusion:vortex-file-compressed 52899232 / 52539096 / +0.7% 75982989 / 78173965 / -2.8% 0.70 / 0.67 / +3.6%
tpcds_q67/datafusion:vortex-file-compressed 55029434 / 54796740 / +0.4% 82004823 / 84412405 / -2.9% 0.67 / 0.65 / +3.4%
tpcds_q68/datafusion:vortex-file-compressed 23548820 / 23361164 / +0.8% 47963917 / 48481578 / -1.1% 0.49 / 0.48 / +1.9%
tpcds_q69/datafusion:vortex-file-compressed 28470672 / 28626674 / -0.5% 48074775 / 50536473 / -4.9% 0.59 / 0.57 / +4.5%
tpcds_q70/datafusion:vortex-file-compressed 68914587 / 69830955 / -1.3% 92335949 / 92530139 / -0.2% 0.75 / 0.75 / -1.1%
tpcds_q71/datafusion:vortex-file-compressed 18735478 / 18833955 / -0.5% 41151263 / 41913644 / -1.8% 0.46 / 0.45 / +1.3%
tpcds_q72/datafusion:vortex-file-compressed 458583694 / 458688464 / -0.0% 484319380 / 482947048 / +0.3% 0.95 / 0.95 / -0.3%
tpcds_q73/datafusion:vortex-file-compressed 16748312 / 16951968 / -1.2% 36704261 / 39748205 / -7.7% 0.46 / 0.43 / +7.0%
tpcds_q74/datafusion:vortex-file-compressed 45314296 / 44897793 / +0.9% 69254442 / 69036172 / +0.3% 0.65 / 0.65 / +0.6%
tpcds_q75/datafusion:vortex-file-compressed 131203790 / 129839015 / +1.1% 157401169 / 157066733 / +0.2% 0.83 / 0.83 / +0.8%
tpcds_q76/datafusion:vortex-file-compressed 41960923 / 43047582 / -2.5% 61253150 / 63024317 / -2.8% 0.69 / 0.68 / +0.3%
tpcds_q77/datafusion:vortex-file-compressed 34640371 / 33806438 / +2.5% 55643993 / 58299996 / -4.6% 0.62 / 0.58 / +7.4%
tpcds_q78/datafusion:vortex-file-compressed 78659300 / 78045846 / +0.8% 104978239 / 107780440 / -2.6% 0.75 / 0.72 / +3.5%
tpcds_q79/datafusion:vortex-file-compressed 20329434 / 20376236 / -0.2% 39184390 / 41505906 / -5.6% 0.52 / 0.49 / +5.7%
tpcds_q80/datafusion:vortex-file-compressed 76495856 / 76737014 / -0.3% 108321759 / 107025738 / +1.2% 0.71 / 0.72 / -1.5%
tpcds_q81/datafusion:vortex-file-compressed 28383912 / 27955528 / +1.5% 45133704 / 46109563 / -2.1% 0.63 / 0.61 / +3.7%
tpcds_q82/datafusion:vortex-file-compressed 13704440 / 13689555 / +0.1% 38209807 / 38800489 / -1.5% 0.36 / 0.35 / +1.7%
tpcds_q83/datafusion:vortex-file-compressed 35939121 / 35912222 / +0.1% 56971204 / 55789665 / +2.1% 0.63 / 0.64 / -2.0%
tpcds_q84/datafusion:vortex-file-compressed 12573314 / 12216274 / +2.9% 28637635 / 30703503 / -6.7% 0.44 / 0.40 / +10.3%
tpcds_q85/datafusion:vortex-file-compressed 60579380 / 61586054 / -1.6% 81949567 / 86194740 / -4.9% 0.74 / 0.71 / +3.5%
tpcds_q86/datafusion:vortex-file-compressed 16175005 / 16744014 / -3.4% 33634379 / 34948483 / -3.8% 0.48 / 0.48 / +0.4%
tpcds_q87/datafusion:vortex-file-compressed 29337872 / 29580717 / -0.8% 52100134 / 52765470 / -1.3% 0.56 / 0.56 / +0.4%
tpcds_q88/datafusion:vortex-file-compressed 32706117 / 31888658 / +2.6% 58707522 / 60845081 / -3.5% 0.56 / 0.52 / +6.3%
tpcds_q89/datafusion:vortex-file-compressed 20732412 / 20357876 / +1.8% 41492278 / 41887935 / -0.9% 0.50 / 0.49 / +2.8%
tpcds_q90/datafusion:vortex-file-compressed 10444026 / 10446217 / -0.0% 28663723 / 28940737 / -1.0% 0.36 / 0.36 / +0.9%
tpcds_q91/datafusion:vortex-file-compressed 17702280 / 17812590 / -0.6% 38906336 / 40072722 / -2.9% 0.45 / 0.44 / +2.4%
tpcds_q92/datafusion:vortex-file-compressed 14228116 / 13916882 / +2.2% 31524587 / 34292514 / -8.1% 0.45 / 0.41 / +11.2%
tpcds_q93/datafusion:vortex-file-compressed 22407892 / 22588137 / -0.8% 45062245 / 45362216 / -0.7% 0.50 / 0.50 / -0.1%
tpcds_q94/datafusion:vortex-file-compressed 19867412 / 19975458 / -0.5% 39934899 / 41870083 / -4.6% 0.50 / 0.48 / +4.3%
tpcds_q95/datafusion:vortex-file-compressed 46166120 / 45819392 / +0.8% 70107807 / 70834897 / -1.0% 0.66 / 0.65 / +1.8%
tpcds_q96/datafusion:vortex-file-compressed 8074526 / 8380626 / -3.7% 24494203 / 27291436 / -10.2% 🟢 0.33 / 0.31 / +7.4%
tpcds_q97/datafusion:vortex-file-compressed 20822610 / 20563580 / +1.3% 42745090 / 43459318 / -1.6% 0.49 / 0.47 / +3.0%
tpcds_q98/datafusion:vortex-file-compressed 16949052 / 16374431 / +3.5% 37655891 / 37939779 / -0.7% 0.45 / 0.43 / +4.3%
tpcds_q99/datafusion:vortex-file-compressed 20143843 / 20164646 / -0.1% 38933301 / 40316080 / -3.4% 0.52 / 0.50 / +3.4%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 28874918 / 29764999 / -3.0% 53271076 / 54283382 / -1.9% 0.54 / 0.55 / -1.1%
tpcds_q02/datafusion:parquet 44961786 / 45769924 / -1.8% 63292883 / 64799976 / -2.3% 0.71 / 0.71 / +0.6%
tpcds_q03/datafusion:parquet 18550292 / 18692330 / -0.8% 32969681 / 34118229 / -3.4% 0.56 / 0.55 / +2.7%
tpcds_q04/datafusion:parquet 191729752 / 194274561 / -1.3% 224270942 / 227190161 / -1.3% 0.85 / 0.86 / -0.0%
tpcds_q05/datafusion:parquet 69525180 / 70801524 / -1.8% 94354167 / 93275391 / +1.2% 0.74 / 0.76 / -2.9%
tpcds_q06/datafusion:parquet 35342795 / 34845398 / +1.4% 55232064 / 51910679 / +6.4% 0.64 / 0.67 / -4.7%
tpcds_q07/datafusion:parquet 45621290 / 45420736 / +0.4% 66012397 / 70789403 / -6.7% 0.69 / 0.64 / +7.7%
tpcds_q08/datafusion:parquet 38873557 / 38525314 / +0.9% 57450813 / 58475973 / -1.8% 0.68 / 0.66 / +2.7%
tpcds_q09/datafusion:parquet 28725603 / 30322608 / -5.3% 38402766 / 46177266 / -16.8% 🟢 0.75 / 0.66 / +13.9%
tpcds_q10/datafusion:parquet 49864294 / 49268652 / +1.2% 66888106 / 62610862 / +6.8% 0.75 / 0.79 / -5.3%
tpcds_q11/datafusion:parquet 92134274 / 93761952 / -1.7% 115265849 / 117547310 / -1.9% 0.80 / 0.80 / +0.2%
tpcds_q12/datafusion:parquet 24248128 / 24275918 / -0.1% 36174701 / 36999949 / -2.2% 0.67 / 0.66 / +2.2%
tpcds_q13/datafusion:parquet 44379660 / 44248255 / +0.3% 68561028 / 71396541 / -4.0% 0.65 / 0.62 / +4.4%
tpcds_q14/datafusion:parquet 136127585 / 136480840 / -0.3% 153985066 / 152084965 / +1.2% 0.88 / 0.90 / -1.5%
tpcds_q15/datafusion:parquet 30538499 / 30771174 / -0.8% 48366229 / 51057792 / -5.3% 0.63 / 0.60 / +4.8%
tpcds_q16/datafusion:parquet 37368590 / 38195582 / -2.2% 56178975 / 58144748 / -3.4% 0.67 / 0.66 / +1.3%
tpcds_q17/datafusion:parquet 72881748 / 73952790 / -1.4% 102346809 / 102360976 / -0.0% 0.71 / 0.72 / -1.4%
tpcds_q18/datafusion:parquet 56900404 / 59409619 / -4.2% 80904233 / 83689874 / -3.3% 0.70 / 0.71 / -0.9%
tpcds_q19/datafusion:parquet 31713324 / 32283860 / -1.8% 51035876 / 54542875 / -6.4% 0.62 / 0.59 / +5.0%
tpcds_q20/datafusion:parquet 25143466 / 25521715 / -1.5% 41486355 / 38276788 / +8.4% 0.61 / 0.67 / -9.1%
tpcds_q21/datafusion:parquet 20253110 / 20257558 / -0.0% 34937761 / 38377330 / -9.0% 0.58 / 0.53 / +9.8%
tpcds_q22/datafusion:parquet 77382372 / 77502572 / -0.2% 93524338 / 94057176 / -0.6% 0.83 / 0.82 / +0.4%
tpcds_q23/datafusion:parquet 114632859 / 115534475 / -0.8% 137612598 / 136512373 / +0.8% 0.83 / 0.85 / -1.6%
tpcds_q24/datafusion:parquet 88376808 / 91181514 / -3.1% 117523175 / 116724849 / +0.7% 0.75 / 0.78 / -3.7%
tpcds_q25/datafusion:parquet 74289740 / 73615396 / +0.9% 100208676 / 99334171 / +0.9% 0.74 / 0.74 / +0.0%
tpcds_q26/datafusion:parquet 42155985 / 42880036 / -1.7% 60695213 / 59846134 / +1.4% 0.69 / 0.72 / -3.1%
tpcds_q27/datafusion:parquet 78485307 / 78398616 / +0.1% 104719773 / 103094499 / +1.6% 0.75 / 0.76 / -1.4%
tpcds_q28/datafusion:parquet 27306125 / 26499966 / +3.0% 46453056 / 46255402 / +0.4% 0.59 / 0.57 / +2.6%
tpcds_q29/datafusion:parquet 75427138 / 74731796 / +0.9% 101647971 / 100518311 / +1.1% 0.74 / 0.74 / -0.2%
tpcds_q30/datafusion:parquet 43630160 / 45777044 / -4.7% 64893252 / 64199412 / +1.1% 0.67 / 0.71 / -5.7%
tpcds_q31/datafusion:parquet 88415321 / 90096310 / -1.9% 114095123 / 114498401 / -0.4% 0.77 / 0.79 / -1.5%
tpcds_q32/datafusion:parquet 24781574 / 26046832 / -4.9% 41725766 / 43043386 / -3.1% 0.59 / 0.61 / -1.9%
tpcds_q33/datafusion:parquet 40015643 / 39655250 / +0.9% 57042011 / 55379624 / +3.0% 0.70 / 0.72 / -2.0%
tpcds_q34/datafusion:parquet 23891262 / 23435330 / +1.9% 37792915 / 39780157 / -5.0% 0.63 / 0.59 / +7.3%
tpcds_q35/datafusion:parquet 54681107 / 53366486 / +2.5% 72113528 / 74168170 / -2.8% 0.76 / 0.72 / +5.4%
tpcds_q36/datafusion:parquet 50173716 / 51018608 / -1.7% 77176829 / 76189943 / +1.3% 0.65 / 0.67 / -2.9%
tpcds_q37/datafusion:parquet 25701436 / 25742166 / -0.2% 41884131 / 39898334 / +5.0% 0.61 / 0.65 / -4.9%
tpcds_q38/datafusion:parquet 42969362 / 44344946 / -3.1% 65634345 / 66342361 / -1.1% 0.65 / 0.67 / -2.1%
tpcds_q39/datafusion:parquet 70702233 / 72215902 / -2.1% 89641020 / 90117130 / -0.5% 0.79 / 0.80 / -1.6%
tpcds_q40/datafusion:parquet 29834048 / 29258470 / +2.0% 50071758 / 52662269 / -4.9% 0.60 / 0.56 / +7.2%
tpcds_q41/datafusion:parquet 19858750 / 19823182 / +0.2% 34548936 / 35360254 / -2.3% 0.57 / 0.56 / +2.5%
tpcds_q42/datafusion:parquet 18061819 / 18327713 / -1.5% 33008908 / 33782100 / -2.3% 0.55 / 0.54 / +0.9%
tpcds_q43/datafusion:parquet 18875010 / 19345418 / -2.4% 35465222 / 36763439 / -3.5% 0.53 / 0.53 / +1.1%
tpcds_q44/datafusion:parquet 33755302 / 32992959 / +2.3% 51885557 / 54054003 / -4.0% 0.65 / 0.61 / +6.6%
tpcds_q45/datafusion:parquet 38027082 / 38005345 / +0.1% 55265121 / 55474291 / -0.4% 0.69 / 0.69 / +0.4%
tpcds_q46/datafusion:parquet 29067431 / 29571706 / -1.7% 50194670 / 49036604 / +2.4% 0.58 / 0.60 / -4.0%
tpcds_q47/datafusion:parquet 97018338 / 98280054 / -1.3% 122015981 / 123245951 / -1.0% 0.80 / 0.80 / -0.3%
tpcds_q48/datafusion:parquet 41183108 / 41124637 / +0.1% 61260842 / 61409784 / -0.2% 0.67 / 0.67 / +0.4%
tpcds_q49/datafusion:parquet 74516645 / 71782636 / +3.8% 96465589 / 99287534 / -2.8% 0.77 / 0.72 / +6.8%
tpcds_q50/datafusion:parquet 47079745 / 47019155 / +0.1% 69026650 / 68966780 / +0.1% 0.68 / 0.68 / +0.0%
tpcds_q51/datafusion:parquet 70531570 / 70384935 / +0.2% 94022770 / 92855725 / +1.3% 0.75 / 0.76 / -1.0%
tpcds_q52/datafusion:parquet 18736366 / 18408324 / +1.8% 33837055 / 34035624 / -0.6% 0.55 / 0.54 / +2.4%
tpcds_q53/datafusion:parquet 22918526 / 22531790 / +1.7% 39610400 / 40427042 / -2.0% 0.58 / 0.56 / +3.8%
tpcds_q54/datafusion:parquet 54007250 / 54642774 / -1.2% 72651789 / 78070250 / -6.9% 0.74 / 0.70 / +6.2%
tpcds_q55/datafusion:parquet 18287386 / 18153604 / +0.7% 30215573 / 33522777 / -9.9% 0.61 / 0.54 / +11.8%
tpcds_q56/datafusion:parquet 44825888 / 45684218 / -1.9% 59839416 / 62770596 / -4.7% 0.75 / 0.73 / +2.9%
tpcds_q57/datafusion:parquet 100458969 / 99608346 / +0.9% 120730676 / 119045936 / +1.4% 0.83 / 0.84 / -0.6%
tpcds_q58/datafusion:parquet 62406573 / 64001544 / -2.5% 82041335 / 84271419 / -2.6% 0.76 / 0.76 / +0.2%
tpcds_q59/datafusion:parquet 46644749 / 46613971 / +0.1% 62103083 / 65998363 / -5.9% 0.75 / 0.71 / +6.3%
tpcds_q60/datafusion:parquet 45386391 / 45386672 / -0.0% 62361991 / 61771327 / +1.0% 0.73 / 0.73 / -0.9%
tpcds_q61/datafusion:parquet 36577493 / 37090288 / -1.4% 58122334 / 62249253 / -6.6% 0.63 / 0.60 / +5.6%
tpcds_q62/datafusion:parquet 25038936 / 25222610 / -0.7% 39103357 / 40608187 / -3.7% 0.64 / 0.62 / +3.1%
tpcds_q63/datafusion:parquet 22163848 / 22036594 / +0.6% 38778125 / 41497888 / -6.6% 0.57 / 0.53 / +7.6%
tpcds_q64/datafusion:parquet 205927083 / 203341306 / +1.3% 233308431 / 230740347 / +1.1% 0.88 / 0.88 / +0.2%
tpcds_q65/datafusion:parquet 36989829 / 36168182 / +2.3% 52351698 / 58309226 / -10.2% 🟢 0.71 / 0.62 / +13.9%
tpcds_q66/datafusion:parquet 60854912 / 61796276 / -1.5% 78083310 / 79145493 / -1.3% 0.78 / 0.78 / -0.2%
tpcds_q67/datafusion:parquet 69119402 / 68679319 / +0.6% 93910686 / 96105794 / -2.3% 0.74 / 0.71 / +3.0%
tpcds_q68/datafusion:parquet 28536493 / 28398024 / +0.5% 50840245 / 48600253 / +4.6% 0.56 / 0.58 / -3.9%
tpcds_q69/datafusion:parquet 50017850 / 49572339 / +0.9% 59906227 / 68050196 / -12.0% 🟢 0.83 / 0.73 / +14.6%
tpcds_q70/datafusion:parquet 36611756 / 36717341 / -0.3% 55965440 / 58690386 / -4.6% 0.65 / 0.63 / +4.6%
tpcds_q71/datafusion:parquet 27840026 / 25972396 / +7.2% 45403764 / 46573799 / -2.5% 0.61 / 0.56 / +10.0%
tpcds_q72/datafusion:parquet 549939094 / 553906118 / -0.7% 572449077 / 571536216 / +0.2% 0.96 / 0.97 / -0.9%
tpcds_q73/datafusion:parquet 22560345 / 22557407 / +0.0% 38785571 / 40086841 / -3.2% 0.58 / 0.56 / +3.4%
tpcds_q74/datafusion:parquet 69318324 / 68166098 / +1.7% 82088435 / 88839979 / -7.6% 0.84 / 0.77 / +10.1%
tpcds_q75/datafusion:parquet 145036832 / 142429794 / +1.8% 174785476 / 172060483 / +1.6% 0.83 / 0.83 / +0.2%
tpcds_q76/datafusion:parquet 54398564 / 53790330 / +1.1% 70887569 / 70451481 / +0.6% 0.77 / 0.76 / +0.5%
tpcds_q77/datafusion:parquet 54167859 / 54802226 / -1.2% 74226800 / 75620475 / -1.8% 0.73 / 0.72 / +0.7%
tpcds_q78/datafusion:parquet 89314724 / 90865118 / -1.7% 122062968 / 121891245 / +0.1% 0.73 / 0.75 / -1.8%
tpcds_q79/datafusion:parquet 25978534 / 25593967 / +1.5% 43967519 / 46413265 / -5.3% 0.59 / 0.55 / +7.1%
tpcds_q80/datafusion:parquet 80379664 / 80248154 / +0.2% 111201335 / 113010136 / -1.6% 0.72 / 0.71 / +1.8%
tpcds_q81/datafusion:parquet 41523238 / 42043660 / -1.2% 61722880 / 59085208 / +4.5% 0.67 / 0.71 / -5.5%
tpcds_q82/datafusion:parquet 25507920 / 25875150 / -1.4% 39176199 / 43505428 / -10.0% 0.65 / 0.59 / +9.5%
tpcds_q83/datafusion:parquet 56701378 / 57290068 / -1.0% 75691847 / 79938712 / -5.3% 0.75 / 0.72 / +4.5%
tpcds_q84/datafusion:parquet 30301296 / 30644090 / -1.1% 46254082 / 46650212 / -0.8% 0.66 / 0.66 / -0.3%
tpcds_q85/datafusion:parquet 82620471 / 83031174 / -0.5% 104326423 / 109990321 / -5.1% 0.79 / 0.75 / +4.9%
tpcds_q86/datafusion:parquet 20336346 / 20409910 / -0.4% 33901967 / 35617065 / -4.8% 0.60 / 0.57 / +4.7%
tpcds_q87/datafusion:parquet 45715512 / 47507210 / -3.8% 60714430 / 63872344 / -4.9% 0.75 / 0.74 / +1.2%
tpcds_q88/datafusion:parquet 47266319 / 50007048 / -5.5% 62472522 / 66560450 / -6.1% 0.76 / 0.75 / +0.7%
tpcds_q89/datafusion:parquet 25703735 / 25375091 / +1.3% 41477323 / 45026438 / -7.9% 0.62 / 0.56 / +10.0%
tpcds_q90/datafusion:parquet 19462408 / 19429058 / +0.2% 32662636 / 35346190 / -7.6% 0.60 / 0.55 / +8.4%
tpcds_q91/datafusion:parquet 36160038 / 37163756 / -2.7% 53296228 / 55576564 / -4.1% 0.68 / 0.67 / +1.5%
tpcds_q92/datafusion:parquet 25539828 / 26272221 / -2.8% 39422474 / 43598488 / -9.6% 0.65 / 0.60 / +7.5%
tpcds_q93/datafusion:parquet 25917006 / 25647748 / +1.0% 47453036 / 49981517 / -5.1% 0.55 / 0.51 / +6.4%
tpcds_q94/datafusion:parquet 34419914 / 34381634 / +0.1% 50749065 / 52341057 / -3.0% 0.68 / 0.66 / +3.3%
tpcds_q95/datafusion:parquet 64208984 / 65407130 / -1.8% 83384527 / 83357052 / +0.0% 0.77 / 0.78 / -1.9%
tpcds_q96/datafusion:parquet 16597224 / 16362605 / +1.4% 29473879 / 32308297 / -8.8% 0.56 / 0.51 / +11.2%
tpcds_q97/datafusion:parquet 35074975 / 35224188 / -0.4% 53628840 / 55230247 / -2.9% 0.65 / 0.64 / +2.5%
tpcds_q98/datafusion:parquet 25048674 / 24854254 / +0.8% 38399732 / 39317260 / -2.3% 0.65 / 0.63 / +3.2%
tpcds_q99/datafusion:parquet 30010080 / 29851446 / +0.5% 43059228 / 45895521 / -6.2% 0.70 / 0.65 / +7.2%
duckdb / vortex-file-compressed / ns (0.994x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15605275 / 15504490 / +0.7% 23764345 / 24336130 / -2.3% 0.66 / 0.64 / +3.1%
tpcds_q02/duckdb:vortex-file-compressed 15189894 / 15379848 / -1.2% 21257292 / 20503099 / +3.7% 0.71 / 0.75 / -4.7%
tpcds_q03/duckdb:vortex-file-compressed 12648404 / 12016420 / +5.3% 25298844 / 20172543 / +25.4% 🔴 0.50 / 0.60 / -16.1%
tpcds_q04/duckdb:vortex-file-compressed 52036456 / 51374886 / +1.3% 62057962 / 61076047 / +1.6% 0.84 / 0.84 / -0.3%
tpcds_q05/duckdb:vortex-file-compressed 19517720 / 19183042 / +1.7% 27005108 / 29062167 / -7.1% 0.72 / 0.66 / +9.5%
tpcds_q06/duckdb:vortex-file-compressed 27508501 / 27448972 / +0.2% 40719604 / 39413335 / +3.3% 0.68 / 0.70 / -3.0%
tpcds_q07/duckdb:vortex-file-compressed 16160850 / 16118854 / +0.3% 27956439 / 28116302 / -0.6% 0.58 / 0.57 / +0.8%
tpcds_q08/duckdb:vortex-file-compressed 23400093 / 22972212 / +1.9% 33826517 / 32312025 / +4.7% 0.69 / 0.71 / -2.7%
tpcds_q09/duckdb:vortex-file-compressed 10227806 / 10390119 / -1.6% 17736756 / 18583927 / -4.6% 0.58 / 0.56 / +3.1%
tpcds_q10/duckdb:vortex-file-compressed 30936396 / 31096790 / -0.5% 42203836 / 46135222 / -8.5% 0.73 / 0.67 / +8.8%
tpcds_q11/duckdb:vortex-file-compressed 40817671 / 40784632 / +0.1% 52565729 / 53581095 / -1.9% 0.78 / 0.76 / +2.0%
tpcds_q12/duckdb:vortex-file-compressed 10766998 / 10904878 / -1.3% 17844816 / 17462280 / +2.2% 0.60 / 0.62 / -3.4%
tpcds_q13/duckdb:vortex-file-compressed 21206546 / 21317819 / -0.5% 35183565 / 33898577 / +3.8% 0.60 / 0.63 / -4.2%
tpcds_q14/duckdb:vortex-file-compressed 58469708 / 61019130 / -4.2% 71627243 / 71909775 / -0.4% 0.82 / 0.85 / -3.8%
tpcds_q15/duckdb:vortex-file-compressed 22315618 / 22263748 / +0.2% 27723021 / 28002193 / -1.0% 0.80 / 0.80 / +1.2%
tpcds_q16/duckdb:vortex-file-compressed 19032823 / 19063094 / -0.2% 31635382 / 28989182 / +9.1% 0.60 / 0.66 / -8.5%
tpcds_q17/duckdb:vortex-file-compressed 31579221 / 31778275 / -0.6% 46439440 / 47836162 / -2.9% 0.68 / 0.66 / +2.4%
tpcds_q18/duckdb:vortex-file-compressed 29625587 / 29944049 / -1.1% 39259509 / 39059192 / +0.5% 0.75 / 0.77 / -1.6%
tpcds_q19/duckdb:vortex-file-compressed 25157200 / 24863896 / +1.2% 35810339 / 35688103 / +0.3% 0.70 / 0.70 / +0.8%
tpcds_q20/duckdb:vortex-file-compressed 11906340 / 11228794 / +6.0% 18852377 / 16415649 / +14.8% 🔴 0.63 / 0.68 / -7.7%
tpcds_q21/duckdb:vortex-file-compressed 10405655 / 10478893 / -0.7% 21551271 / 20028680 / +7.6% 0.48 / 0.52 / -7.7%
tpcds_q22/duckdb:vortex-file-compressed 33130037 / 30881854 / +7.3% 45283302 / 42781844 / +5.8% 0.73 / 0.72 / +1.4%
tpcds_q23/duckdb:vortex-file-compressed 35024505 / 35713772 / -1.9% 48886570 / 47911589 / +2.0% 0.72 / 0.75 / -3.9%
tpcds_q24/duckdb:vortex-file-compressed 28801039 / 28902646 / -0.4% 40111546 / 39265889 / +2.2% 0.72 / 0.74 / -2.5%
tpcds_q25/duckdb:vortex-file-compressed 26575264 / 26635864 / -0.2% 40320815 / 40052250 / +0.7% 0.66 / 0.67 / -0.9%
tpcds_q26/duckdb:vortex-file-compressed 14877734 / 15050125 / -1.1% 20621664 / 20755318 / -0.6% 0.72 / 0.73 / -0.5%
tpcds_q27/duckdb:vortex-file-compressed 17370746 / 17232492 / +0.8% 29862295 / 27254706 / +9.6% 0.58 / 0.63 / -8.0%
tpcds_q28/duckdb:vortex-file-compressed 7903318 / 7929062 / -0.3% 12081261 / 12215291 / -1.1% 0.65 / 0.65 / +0.8%
tpcds_q29/duckdb:vortex-file-compressed 30569720 / 30734334 / -0.5% 48509371 / 47107955 / +3.0% 0.63 / 0.65 / -3.4%
tpcds_q30/duckdb:vortex-file-compressed 20040007 / 20013126 / +0.1% 29368698 / 31068309 / -5.5% 0.68 / 0.64 / +5.9%
tpcds_q31/duckdb:vortex-file-compressed 19900196 / 19624990 / +1.4% 29423934 / 30272178 / -2.8% 0.68 / 0.65 / +4.3%
tpcds_q32/duckdb:vortex-file-compressed 11110360 / 11022248 / +0.8% 19660504 / 18352666 / +7.1% 0.57 / 0.60 / -5.9%
tpcds_q33/duckdb:vortex-file-compressed 17684822 / 17663452 / +0.1% 28785847 / 29951645 / -3.9% 0.61 / 0.59 / +4.2%
tpcds_q34/duckdb:vortex-file-compressed 13689447 / 13760664 / -0.5% 20465150 / 21028769 / -2.7% 0.67 / 0.65 / +2.2%
tpcds_q35/duckdb:vortex-file-compressed 48668027 / 49033481 / -0.7% 62538311 / 61483774 / +1.7% 0.78 / 0.80 / -2.4%
tpcds_q36/duckdb:vortex-file-compressed 15474994 / 18118600 / -14.6% 🟢 27343370 / 26697004 / +2.4% 0.57 / 0.68 / -16.6%
tpcds_q37/duckdb:vortex-file-compressed 14122920 / 14014943 / +0.8% 22193510 / 22252040 / -0.3% 0.64 / 0.63 / +1.0%
tpcds_q38/duckdb:vortex-file-compressed 22242772 / 22494424 / -1.1% 28119930 / 30024075 / -6.3% 0.79 / 0.75 / +5.6%
tpcds_q39/duckdb:vortex-file-compressed 18756574 / 18889610 / -0.7% 28379837 / 27296567 / +4.0% 0.66 / 0.69 / -4.5%
tpcds_q40/duckdb:vortex-file-compressed 13557034 / 13718716 / -1.2% 18401149 / 18622177 / -1.2% 0.74 / 0.74 / +0.0%
tpcds_q41/duckdb:vortex-file-compressed 6547578 / 6563535 / -0.2% 11127530 / 9244076 / +20.4% 🔴 0.59 / 0.71 / -17.1%
tpcds_q42/duckdb:vortex-file-compressed 8379216 / 8489390 / -1.3% 17979059 / 17448512 / +3.0% 0.47 / 0.49 / -4.2%
tpcds_q43/duckdb:vortex-file-compressed 10188333 / 12146546 / -16.1% 🟢 19088823 / 18607169 / +2.6% 0.53 / 0.65 / -18.2%
tpcds_q44/duckdb:vortex-file-compressed 14010092 / 13934462 / +0.5% 28019123 / 25558640 / +9.6% 0.50 / 0.55 / -8.3%
tpcds_q45/duckdb:vortex-file-compressed 23896348 / 23842562 / +0.2% 32576774 / 29026640 / +12.2% 🔴 0.73 / 0.82 / -10.7%
tpcds_q46/duckdb:vortex-file-compressed 17102871 / 17346314 / -1.4% 29414929 / 26968742 / +9.1% 0.58 / 0.64 / -9.6%
tpcds_q47/duckdb:vortex-file-compressed 30488394 / 30449468 / +0.1% 44674249 / 44565933 / +0.2% 0.68 / 0.68 / -0.1%
tpcds_q48/duckdb:vortex-file-compressed 19792866 / 20120641 / -1.6% 30880112 / 30249092 / +2.1% 0.64 / 0.67 / -3.6%
tpcds_q49/duckdb:vortex-file-compressed 18540072 / 18133746 / +2.2% 31561953 / 30271584 / +4.3% 0.59 / 0.60 / -1.9%
tpcds_q50/duckdb:vortex-file-compressed 17370954 / 17288171 / +0.5% 29221323 / 27379241 / +6.7% 0.59 / 0.63 / -5.9%
tpcds_q51/duckdb:vortex-file-compressed 51794024 / 52248680 / -0.9% 89479032 / 60919687 / +46.9% 🔴 0.58 / 0.86 / -32.5%
tpcds_q52/duckdb:vortex-file-compressed 10589743 / 10116114 / +4.7% 19307135 / 19561589 / -1.3% 0.55 / 0.52 / +6.1%
tpcds_q53/duckdb:vortex-file-compressed 14137634 / 15147062 / -6.7% 24521937 / 24984699 / -1.9% 0.58 / 0.61 / -4.9%
tpcds_q54/duckdb:vortex-file-compressed 20732422 / 20699270 / +0.2% 29897404 / 32245211 / -7.3% 0.69 / 0.64 / +8.0%
tpcds_q55/duckdb:vortex-file-compressed 8479058 / 8636032 / -1.8% 18996563 / 21546774 / -11.8% 🟢 0.45 / 0.40 / +11.4%
tpcds_q56/duckdb:vortex-file-compressed 17827566 / 17454380 / +2.1% 29786459 / 28826746 / +3.3% 0.60 / 0.61 / -1.2%
tpcds_q57/duckdb:vortex-file-compressed 24978491 / 25081860 / -0.4% 31665573 / 31913388 / -0.8% 0.79 / 0.79 / +0.4%
tpcds_q58/duckdb:vortex-file-compressed 18532450 / 19077824 / -2.9% 28070125 / 27289688 / +2.9% 0.66 / 0.70 / -5.6%
tpcds_q59/duckdb:vortex-file-compressed 18459265 / 20549521 / -10.2% 🟢 25996107 / 24910118 / +4.4% 0.71 / 0.82 / -13.9%
tpcds_q60/duckdb:vortex-file-compressed 18087570 / 18211177 / -0.7% 29719924 / 34773143 / -14.5% 🟢 0.61 / 0.52 / +16.2%
tpcds_q61/duckdb:vortex-file-compressed 21022012 / 20171125 / +4.2% 39361598 / 32369028 / +21.6% 🔴 0.53 / 0.62 / -14.3%
tpcds_q62/duckdb:vortex-file-compressed 10554912 / 10523309 / +0.3% 17220966 / 17355364 / -0.8% 0.61 / 0.61 / +1.1%
tpcds_q63/duckdb:vortex-file-compressed 13538670 / 13510748 / +0.2% 22293637 / 24435965 / -8.8% 0.61 / 0.55 / +9.8%
tpcds_q64/duckdb:vortex-file-compressed 64406426 / 63790015 / +1.0% 82615156 / 78079945 / +5.8% 0.78 / 0.82 / -4.6%
tpcds_q65/duckdb:vortex-file-compressed 13241150 / 13474077 / -1.7% 22823051 / 20460836 / +11.5% 🔴 0.58 / 0.66 / -11.9%
tpcds_q66/duckdb:vortex-file-compressed 23349548 / 23420868 / -0.3% 29966192 / 28770791 / +4.2% 0.78 / 0.81 / -4.3%
tpcds_q67/duckdb:vortex-file-compressed 65813260 / 66221849 / -0.6% 89395481 / 91628032 / -2.4% 0.74 / 0.72 / +1.9%
tpcds_q68/duckdb:vortex-file-compressed 17097350 / 17428267 / -1.9% 32880325 / 29710554 / +10.7% 🔴 0.52 / 0.59 / -11.4%
tpcds_q69/duckdb:vortex-file-compressed 31739122 / 32060174 / -1.0% 51121711 / 45785586 / +11.7% 🔴 0.62 / 0.70 / -11.3%
tpcds_q70/duckdb:vortex-file-compressed 18705182 / 19342374 / -3.3% 32947531 / 29584166 / +11.4% 🔴 0.57 / 0.65 / -13.2%
tpcds_q71/duckdb:vortex-file-compressed 13444855 / 13424776 / +0.1% 25724360 / 25021124 / +2.8% 0.52 / 0.54 / -2.6%
tpcds_q72/duckdb:vortex-file-compressed 63572001 / 63722808 / -0.2% 81462047 / 77948309 / +4.5% 0.78 / 0.82 / -4.5%
tpcds_q73/duckdb:vortex-file-compressed 13817294 / 13264382 / +4.2% 20784409 / 21129018 / -1.6% 0.66 / 0.63 / +5.9%
tpcds_q74/duckdb:vortex-file-compressed 28580710 / 28426314 / +0.5% 38007317 / 39099110 / -2.8% 0.75 / 0.73 / +3.4%
tpcds_q75/duckdb:vortex-file-compressed 28593058 / 29639370 / -3.5% 40176908 / 39010210 / +3.0% 0.71 / 0.76 / -6.3%
tpcds_q76/duckdb:vortex-file-compressed 13427364 / 12963032 / +3.6% 25033757 / 25443742 / -1.6% 0.54 / 0.51 / +5.3%
tpcds_q77/duckdb:vortex-file-compressed 16350484 / 16791869 / -2.6% 27430097 / 25016530 / +9.6% 0.60 / 0.67 / -11.2%
tpcds_q78/duckdb:vortex-file-compressed 37872784 / 37749238 / +0.3% 49409078 / 45395785 / +8.8% 0.77 / 0.83 / -7.8%
tpcds_q79/duckdb:vortex-file-compressed 15624195 / 14528688 / +7.5% 25066212 / 26335212 / -4.8% 0.62 / 0.55 / +13.0%
tpcds_q80/duckdb:vortex-file-compressed 29000203 / 28757818 / +0.8% 49072807 / 41579955 / +18.0% 🔴 0.59 / 0.69 / -14.6%
tpcds_q81/duckdb:vortex-file-compressed 23426394 / 23220332 / +0.9% 33037241 / 31446641 / +5.1% 0.71 / 0.74 / -4.0%
tpcds_q82/duckdb:vortex-file-compressed 31821144 / 32837730 / -3.1% 39579822 / 42805995 / -7.5% 0.80 / 0.77 / +4.8%
tpcds_q83/duckdb:vortex-file-compressed 22685979 / 23608390 / -3.9% 26876209 / 26330595 / +2.1% 0.84 / 0.90 / -5.9%
tpcds_q84/duckdb:vortex-file-compressed 13626617 / 13532604 / +0.7% 23401699 / 23327999 / +0.3% 0.58 / 0.58 / +0.4%
tpcds_q85/duckdb:vortex-file-compressed 33187574 / 33514098 / -1.0% 42768528 / 41473443 / +3.1% 0.78 / 0.81 / -4.0%
tpcds_q86/duckdb:vortex-file-compressed 11364489 / 11114942 / +2.2% 18263254 / 19130891 / -4.5% 0.62 / 0.58 / +7.1%
tpcds_q87/duckdb:vortex-file-compressed 24038476 / 24160869 / -0.5% 30497942 / 33604355 / -9.2% 0.79 / 0.72 / +9.6%
tpcds_q88/duckdb:vortex-file-compressed 35202714 / 37200356 / -5.4% 48110055 / 48091211 / +0.0% 0.73 / 0.77 / -5.4%
tpcds_q89/duckdb:vortex-file-compressed 13987338 / 15030220 / -6.9% 23723844 / 26144794 / -9.3% 0.59 / 0.57 / +2.6%
tpcds_q90/duckdb:vortex-file-compressed 9009620 / 8860585 / +1.7% 18605050 / 14510242 / +28.2% 🔴 0.48 / 0.61 / -20.7%
tpcds_q91/duckdb:vortex-file-compressed 17406286 / 17288798 / +0.7% 23615579 / 22711913 / +4.0% 0.74 / 0.76 / -3.2%
tpcds_q92/duckdb:vortex-file-compressed 14359688 / 14400544 / -0.3% 23438043 / 21908087 / +7.0% 0.61 / 0.66 / -6.8%
tpcds_q93/duckdb:vortex-file-compressed 16322292 / 17416956 / -6.3% 23874750 / 22609175 / +5.6% 0.68 / 0.77 / -11.3%
tpcds_q94/duckdb:vortex-file-compressed 17702299 / 17404038 / +1.7% 29802086 / 27008922 / +10.3% 🔴 0.59 / 0.64 / -7.8%
tpcds_q95/duckdb:vortex-file-compressed 72241310 / 73097182 / -1.2% 79679418 / 79821374 / -0.2% 0.91 / 0.92 / -1.0%
tpcds_q96/duckdb:vortex-file-compressed 8544606 / 8500732 / +0.5% 17132623 / 15647463 / +9.5% 0.50 / 0.54 / -8.2%
tpcds_q97/duckdb:vortex-file-compressed 23001778 / 23207378 / -0.9% 31794152 / 31239572 / +1.8% 0.72 / 0.74 / -2.6%
tpcds_q98/duckdb:vortex-file-compressed 13830502 / 14322364 / -3.4% 23405497 / 21880926 / +7.0% 0.59 / 0.65 / -9.7%
tpcds_q99/duckdb:vortex-file-compressed 14473012 / 14537292 / -0.4% 22125975 / 20903563 / +5.8% 0.65 / 0.70 / -5.9%
duckdb / parquet / ns (0.990x ➖, 5↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23347758 / 23467576 / -0.5% 31715369 / 32002913 / -0.9% 0.74 / 0.73 / +0.4%
tpcds_q02/duckdb:parquet 15220674 / 16120009 / -5.6% 19829340 / 20501826 / -3.3% 0.77 / 0.79 / -2.4%
tpcds_q03/duckdb:parquet 10349274 / 8804851 / +17.5% 🔴 15077661 / 15320493 / -1.6% 0.69 / 0.57 / +19.4%
tpcds_q04/duckdb:parquet 127301362 / 127989110 / -0.5% 132607945 / 135003993 / -1.8% 0.96 / 0.95 / +1.3%
tpcds_q05/duckdb:parquet 21352991 / 21501723 / -0.7% 25562291 / 25921318 / -1.4% 0.84 / 0.83 / +0.7%
tpcds_q06/duckdb:parquet 26626754 / 26736835 / -0.4% 39682553 / 36501981 / +8.7% 0.67 / 0.73 / -8.4%
tpcds_q07/duckdb:parquet 15080568 / 17063968 / -11.6% 🟢 23294067 / 22828114 / +2.0% 0.65 / 0.75 / -13.4%
tpcds_q08/duckdb:parquet 25754941 / 25496532 / +1.0% 33307187 / 33198996 / +0.3% 0.77 / 0.77 / +0.7%
tpcds_q09/duckdb:parquet 18583052 / 18507008 / +0.4% 22786858 / 21709294 / +5.0% 0.82 / 0.85 / -4.3%
tpcds_q10/duckdb:parquet 27394580 / 27966060 / -2.0% 37561187 / 37508093 / +0.1% 0.73 / 0.75 / -2.2%
tpcds_q11/duckdb:parquet 71199481 / 71641614 / -0.6% 76698825 / 79776987 / -3.9% 0.93 / 0.90 / +3.4%
tpcds_q12/duckdb:parquet 12676294 / 12845132 / -1.3% 17336473 / 17528240 / -1.1% 0.73 / 0.73 / -0.2%
tpcds_q13/duckdb:parquet 23861243 / 23720456 / +0.6% 31950641 / 31831147 / +0.4% 0.75 / 0.75 / +0.2%
tpcds_q14/duckdb:parquet 61066694 / 61245614 / -0.3% 66226984 / 73617509 / -10.0% 🟢 0.92 / 0.83 / +10.8%
tpcds_q15/duckdb:parquet 25060014 / 24946310 / +0.5% 30564033 / 31249820 / -2.2% 0.82 / 0.80 / +2.7%
tpcds_q16/duckdb:parquet 19886751 / 19842796 / +0.2% 30139411 / 28635645 / +5.3% 0.66 / 0.69 / -4.8%
tpcds_q17/duckdb:parquet 32282067 / 32536779 / -0.8% 40658141 / 40931234 / -0.7% 0.79 / 0.79 / -0.1%
tpcds_q18/duckdb:parquet 38792552 / 38967032 / -0.4% 49351173 / 52469398 / -5.9% 0.79 / 0.74 / +5.8%
tpcds_q19/duckdb:parquet 24554820 / 24447218 / +0.4% 34738716 / 31636089 / +9.8% 0.71 / 0.77 / -8.5%
tpcds_q20/duckdb:parquet 13481749 / 13946748 / -3.3% 18106681 / 21916009 / -17.4% 🟢 0.74 / 0.64 / +17.0%
tpcds_q21/duckdb:parquet 9382480 / 9375335 / +0.1% 16023672 / 12257542 / +30.7% 🔴 0.59 / 0.76 / -23.4%
tpcds_q22/duckdb:parquet 36055932 / 36585965 / -1.4% 40884890 / 41993970 / -2.6% 0.88 / 0.87 / +1.2%
tpcds_q23/duckdb:parquet 40613835 / 40781064 / -0.4% 46723611 / 47695840 / -2.0% 0.87 / 0.86 / +1.7%
tpcds_q24/duckdb:parquet 33373249 / 33215570 / +0.5% 43818624 / 43951732 / -0.3% 0.76 / 0.76 / +0.8%
tpcds_q25/duckdb:parquet 30135107 / 30140996 / -0.0% 39643224 / 41427620 / -4.3% 0.76 / 0.73 / +4.5%
tpcds_q26/duckdb:parquet 30857618 / 34108842 / -9.5% 38614087 / 42333038 / -8.8% 0.80 / 0.81 / -0.8%
tpcds_q27/duckdb:parquet 31600828 / 33213664 / -4.9% 41175769 / 40290156 / +2.2% 0.77 / 0.82 / -6.9%
tpcds_q28/duckdb:parquet 17215668 / 16989032 / +1.3% 20271905 / 22029747 / -8.0% 0.85 / 0.77 / +10.1%
tpcds_q29/duckdb:parquet 30409775 / 30632157 / -0.7% 38947948 / 38311327 / +1.7% 0.78 / 0.80 / -2.3%
tpcds_q30/duckdb:parquet 33832778 / 32581819 / +3.8% 42207489 / 43970508 / -4.0% 0.80 / 0.74 / +8.2%
tpcds_q31/duckdb:parquet 20385146 / 20139772 / +1.2% 25341330 / 24081138 / +5.2% 0.80 / 0.84 / -3.8%
tpcds_q32/duckdb:parquet 11052552 / 11100442 / -0.4% 17102037 / 17203445 / -0.6% 0.65 / 0.65 / +0.2%
tpcds_q33/duckdb:parquet 15777772 / 16010366 / -1.5% 22967056 / 22942977 / +0.1% 0.69 / 0.70 / -1.6%
tpcds_q34/duckdb:parquet 15840778 / 20782625 / -23.8% 🟢 22005754 / 21943199 / +0.3% 0.72 / 0.95 / -24.0%
tpcds_q35/duckdb:parquet 46841215 / 46843436 / -0.0% 56777922 / 56856122 / -0.1% 0.82 / 0.82 / +0.1%
tpcds_q36/duckdb:parquet 15016572 / 14978558 / +0.3% 26403857 / 23072126 / +14.4% 🔴 0.57 / 0.65 / -12.4%
tpcds_q37/duckdb:parquet 11661172 / 11756110 / -0.8% 16677974 / 19592547 / -14.9% 🟢 0.70 / 0.60 / +16.5%
tpcds_q38/duckdb:parquet 26223706 / 26460472 / -0.9% 30223354 / 30154471 / +0.2% 0.87 / 0.88 / -1.1%
tpcds_q39/duckdb:parquet 24417056 / 24819486 / -1.6% 28780956 / 31097423 / -7.4% 0.85 / 0.80 / +6.3%
tpcds_q40/duckdb:parquet 15970063 / 15960626 / +0.1% 23421640 / 21652019 / +8.2% 0.68 / 0.74 / -7.5%
tpcds_q41/duckdb:parquet 7754294 / 7714015 / +0.5% 12872903 / 13632196 / -5.6% 0.60 / 0.57 / +6.5%
tpcds_q42/duckdb:parquet 11122838 / 8382999 / +32.7% 🔴 15008386 / 19781921 / -24.1% 🟢 0.74 / 0.42 / +74.9%
tpcds_q43/duckdb:parquet 10646394 / 10656260 / -0.1% 15644584 / 15927109 / -1.8% 0.68 / 0.67 / +1.7%
tpcds_q44/duckdb:parquet 16183615 / 16758266 / -3.4% 22708476 / 23207613 / -2.2% 0.71 / 0.72 / -1.3%
tpcds_q45/duckdb:parquet 23362707 / 23318609 / +0.2% 29303431 / 29033820 / +0.9% 0.80 / 0.80 / -0.7%
tpcds_q46/duckdb:parquet 36012876 / 37307336 / -3.5% 45072351 / 48447264 / -7.0% 0.80 / 0.77 / +3.8%
tpcds_q47/duckdb:parquet 30990957 / 31307096 / -1.0% 40627423 / 37993880 / +6.9% 0.76 / 0.82 / -7.4%
tpcds_q48/duckdb:parquet 20993241 / 21205916 / -1.0% 28686591 / 28768628 / -0.3% 0.73 / 0.74 / -0.7%
tpcds_q49/duckdb:parquet 18847023 / 19082490 / -1.2% 28791620 / 26954733 / +6.8% 0.65 / 0.71 / -7.5%
tpcds_q50/duckdb:parquet 17639277 / 18532991 / -4.8% 25770456 / 25145243 / +2.5% 0.68 / 0.74 / -7.1%
tpcds_q51/duckdb:parquet 53374094 / 53285821 / +0.2% 63904395 / 62472617 / +2.3% 0.84 / 0.85 / -2.1%
tpcds_q52/duckdb:parquet 8571873 / 8660308 / -1.0% 15077439 / 15991816 / -5.7% 0.57 / 0.54 / +5.0%
tpcds_q53/duckdb:parquet 11632478 / 11492516 / +1.2% 17195653 / 16998516 / +1.2% 0.68 / 0.68 / +0.1%
tpcds_q54/duckdb:parquet 20227829 / 20228702 / -0.0% 33164798 / 29944636 / +10.8% 🔴 0.61 / 0.68 / -9.7%
tpcds_q55/duckdb:parquet 8514524 / 8531584 / -0.2% 15248979 / 15122883 / +0.8% 0.56 / 0.56 / -1.0%
tpcds_q56/duckdb:parquet 16154724 / 16403677 / -1.5% 24052018 / 25311220 / -5.0% 0.67 / 0.65 / +3.6%
tpcds_q57/duckdb:parquet 30470252 / 28783609 / +5.9% 34521131 / 34953479 / -1.2% 0.88 / 0.82 / +7.2%
tpcds_q58/duckdb:parquet 18347349 / 18272118 / +0.4% 25943434 / 25559627 / +1.5% 0.71 / 0.71 / -1.1%
tpcds_q59/duckdb:parquet 20042874 / 20072640 / -0.1% 25452907 / 26819130 / -5.1% 0.79 / 0.75 / +5.2%
tpcds_q60/duckdb:parquet 16871816 / 16743012 / +0.8% 28257146 / 28288792 / -0.1% 0.60 / 0.59 / +0.9%
tpcds_q61/duckdb:parquet 21476860 / 21722808 / -1.1% 28682953 / 28667543 / +0.1% 0.75 / 0.76 / -1.2%
tpcds_q62/duckdb:parquet 10795194 / 10692014 / +1.0% 14512277 / 14774170 / -1.8% 0.74 / 0.72 / +2.8%
tpcds_q63/duckdb:parquet 10910877 / 10895487 / +0.1% 16298531 / 16681709 / -2.3% 0.67 / 0.65 / +2.5%
tpcds_q64/duckdb:parquet 52625724 / 52923874 / -0.6% 67674788 / 65968778 / +2.6% 0.78 / 0.80 / -3.1%
tpcds_q65/duckdb:parquet 14479581 / 15092318 / -4.1% 21395830 / 23419945 / -8.6% 0.68 / 0.64 / +5.0%
tpcds_q66/duckdb:parquet 24695925 / 24773644 / -0.3% 32257857 / 30705128 / +5.1% 0.77 / 0.81 / -5.1%
tpcds_q67/duckdb:parquet 76896940 / 78656911 / -2.2% 84408549 / 84561983 / -0.2% 0.91 / 0.93 / -2.1%
tpcds_q68/duckdb:parquet 28984134 / 29518034 / -1.8% 40441176 / 39143231 / +3.3% 0.72 / 0.75 / -5.0%
tpcds_q69/duckdb:parquet 28596176 / 28672049 / -0.3% 38343754 / 40933617 / -6.3% 0.75 / 0.70 / +6.5%
tpcds_q70/duckdb:parquet 16493220 / 16094891 / +2.5% 25216862 / 22680262 / +11.2% 🔴 0.65 / 0.71 / -7.8%
tpcds_q71/duckdb:parquet 16492142 / 14749122 / +11.8% 🔴 21181224 / 20603660 / +2.8% 0.78 / 0.72 / +8.8%
tpcds_q72/duckdb:parquet 81528858 / 83501806 / -2.4% 87780131 / 85717990 / +2.4% 0.93 / 0.97 / -4.7%
tpcds_q73/duckdb:parquet 14753669 / 13424874 / +9.9% 18868280 / 21962504 / -14.1% 🟢 0.78 / 0.61 / +27.9%
tpcds_q74/duckdb:parquet 100409780 / 98912762 / +1.5% 108364330 / 109679115 / -1.2% 0.93 / 0.90 / +2.7%
tpcds_q75/duckdb:parquet 39940694 / 40221827 / -0.7% 51767776 / 50203322 / +3.1% 0.77 / 0.80 / -3.7%
tpcds_q76/duckdb:parquet 13567219 / 13484190 / +0.6% 20917448 / 20521466 / +1.9% 0.65 / 0.66 / -1.3%
tpcds_q77/duckdb:parquet 18296024 / 17191805 / +6.4% 26005818 / 25038252 / +3.9% 0.70 / 0.69 / +2.5%
tpcds_q78/duckdb:parquet 48155296 / 48471866 / -0.7% 54696910 / 53796385 / +1.7% 0.88 / 0.90 / -2.3%
tpcds_q79/duckdb:parquet 20421516 / 20580734 / -0.8% 28836129 / 28512511 / +1.1% 0.71 / 0.72 / -1.9%
tpcds_q80/duckdb:parquet 31435500 / 31108012 / +1.1% 40401721 / 38661127 / +4.5% 0.78 / 0.80 / -3.3%
tpcds_q81/duckdb:parquet 29906435 / 29817629 / +0.3% 42249300 / 39536786 / +6.9% 0.71 / 0.75 / -6.1%
tpcds_q82/duckdb:parquet 13418247 / 14316557 / -6.3% 18419999 / 18487404 / -0.4% 0.73 / 0.77 / -5.9%
tpcds_q83/duckdb:parquet 15789780 / 15621389 / +1.1% 21153239 / 20600015 / +2.7% 0.75 / 0.76 / -1.6%
tpcds_q84/duckdb:parquet 17441686 / 18364550 / -5.0% 23608911 / 23104936 / +2.2% 0.74 / 0.79 / -7.1%
tpcds_q85/duckdb:parquet 34360150 / 34942640 / -1.7% 45505369 / 45171633 / +0.7% 0.76 / 0.77 / -2.4%
tpcds_q86/duckdb:parquet 10748714 / 13249873 / -18.9% 🟢 15579032 / 15557195 / +0.1% 0.69 / 0.85 / -19.0%
tpcds_q87/duckdb:parquet 28716184 / 28513317 / +0.7% 31919609 / 33241109 / -4.0% 0.90 / 0.86 / +4.9%
tpcds_q88/duckdb:parquet 27016045 / 28544431 / -5.4% 35456537 / 37689019 / -5.9% 0.76 / 0.76 / +0.6%
tpcds_q89/duckdb:parquet 12582248 / 12918224 / -2.6% 18546450 / 19493375 / -4.9% 0.68 / 0.66 / +2.4%
tpcds_q90/duckdb:parquet 6963093 / 7356436 / -5.3% 12209726 / 11366866 / +7.4% 0.57 / 0.65 / -11.9%
tpcds_q91/duckdb:parquet 20887012 / 20969575 / -0.4% 28779068 / 29827255 / -3.5% 0.73 / 0.70 / +3.2%
tpcds_q92/duckdb:parquet 11325662 / 11433094 / -0.9% 17894212 / 21418875 / -16.5% 🟢 0.63 / 0.53 / +18.6%
tpcds_q93/duckdb:parquet 21229190 / 21250624 / -0.1% 29326854 / 29305057 / +0.1% 0.72 / 0.73 / -0.2%
tpcds_q94/duckdb:parquet 15917994 / 18766328 / -15.2% 🟢 24546293 / 24427477 / +0.5% 0.65 / 0.77 / -15.6%
tpcds_q95/duckdb:parquet 89964660 / 89799717 / +0.2% 99074675 / 97914266 / +1.2% 0.91 / 0.92 / -1.0%
tpcds_q96/duckdb:parquet 6903955 / 6952414 / -0.7% 12302027 / 10544428 / +16.7% 🔴 0.56 / 0.66 / -14.9%
tpcds_q97/duckdb:parquet 25943322 / 28138472 / -7.8% 31887684 / 33494700 / -4.8% 0.81 / 0.84 / -3.2%
tpcds_q98/duckdb:parquet 14886760 / 17021932 / -12.5% 🟢 22070518 / 22125478 / -0.2% 0.67 / 0.77 / -12.3%
tpcds_q99/duckdb:parquet 17329534 / 17215398 / +0.7% 20816733 / 21683028 / -4.0% 0.83 / 0.79 / +4.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.985x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 84418964 / 93900282 / -10.1% 🟢 143450091 / 160940285 / -10.9% 🟢 0.59 / 0.58 / +0.9%
tpch_q02/datafusion:vortex-file-compressed 64300242 / 64107140 / +0.3% 92286108 / 95811295 / -3.7% 0.70 / 0.67 / +4.1%
tpch_q03/datafusion:vortex-file-compressed 66098353 / 65728363 / +0.6% 116880725 / 110450701 / +5.8% 0.57 / 0.60 / -5.0%
tpch_q04/datafusion:vortex-file-compressed 35397010 / 35673267 / -0.8% 72995000 / 70595761 / +3.4% 0.48 / 0.51 / -4.0%
tpch_q05/datafusion:vortex-file-compressed 116381582 / 117253146 / -0.7% 173842542 / 185306432 / -6.2% 0.67 / 0.63 / +5.8%
tpch_q06/datafusion:vortex-file-compressed 14619183 / 14529425 / +0.6% 75371743 / 71929750 / +4.8% 0.19 / 0.20 / -4.0%
tpch_q07/datafusion:vortex-file-compressed 140616807 / 138843422 / +1.3% 180052135 / 185688824 / -3.0% 0.78 / 0.75 / +4.4%
tpch_q08/datafusion:vortex-file-compressed 143799771 / 144707026 / -0.6% 200663665 / 217486805 / -7.7% 0.72 / 0.67 / +7.7%
tpch_q09/datafusion:vortex-file-compressed 185589131 / 191658853 / -3.2% 249483816 / 250859349 / -0.5% 0.74 / 0.76 / -2.6%
tpch_q10/datafusion:vortex-file-compressed 74731329 / 74399216 / +0.4% 129628373 / 138206300 / -6.2% 0.58 / 0.54 / +7.1%
tpch_q11/datafusion:vortex-file-compressed 42578403 / 42580218 / -0.0% 66986209 / 67934155 / -1.4% 0.64 / 0.63 / +1.4%
tpch_q12/datafusion:vortex-file-compressed 47258904 / 47082515 / +0.4% 88755945 / 92091007 / -3.6% 0.53 / 0.51 / +4.1%
tpch_q13/datafusion:vortex-file-compressed 46045660 / 47037158 / -2.1% 75522235 / 77409491 / -2.4% 0.61 / 0.61 / +0.3%
tpch_q14/datafusion:vortex-file-compressed 24837577 / 24560840 / +1.1% 96047333 / 98242993 / -2.2% 0.26 / 0.25 / +3.4%
tpch_q15/datafusion:vortex-file-compressed 36373305 / 37563321 / -3.2% 99931384 / 100137484 / -0.2% 0.36 / 0.38 / -3.0%
tpch_q16/datafusion:vortex-file-compressed 37201172 / 37141885 / +0.2% 64904468 / 65996733 / -1.7% 0.57 / 0.56 / +1.8%
tpch_q17/datafusion:vortex-file-compressed 178007695 / 179331355 / -0.7% 225119840 / 226356738 / -0.5% 0.79 / 0.79 / -0.2%
tpch_q18/datafusion:vortex-file-compressed 200049239 / 197669396 / +1.2% 251098503 / 258639006 / -2.9% 0.80 / 0.76 / +4.2%
tpch_q19/datafusion:vortex-file-compressed 32413387 / 38948475 / -16.8% 🟢 92802195 / 95798165 / -3.1% 0.35 / 0.41 / -14.1%
tpch_q20/datafusion:vortex-file-compressed 62565572 / 62140356 / +0.7% 123893792 / 119079483 / +4.0% 0.50 / 0.52 / -3.2%
tpch_q21/datafusion:vortex-file-compressed 180299154 / 181999555 / -0.9% 231506578 / 234432596 / -1.2% 0.78 / 0.78 / +0.3%
tpch_q22/datafusion:vortex-file-compressed 25581268 / 25433600 / +0.6% 54884467 / 58495364 / -6.2% 0.47 / 0.43 / +7.2%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83377726 / 82624847 / +0.9% 130108073 / 129972784 / +0.1% 0.64 / 0.64 / +0.8%
tpch_q02/datafusion:parquet 135263273 / 134230444 / +0.8% 162651229 / 161853360 / +0.5% 0.83 / 0.83 / +0.3%
tpch_q03/datafusion:parquet 124484867 / 124088397 / +0.3% 189213110 / 190810779 / -0.8% 0.66 / 0.65 / +1.2%
tpch_q04/datafusion:parquet 53998540 / 54689289 / -1.3% 110503321 / 103242849 / +7.0% 0.49 / 0.53 / -7.8%
tpch_q05/datafusion:parquet 163429312 / 161956069 / +0.9% 231805495 / 239784489 / -3.3% 0.71 / 0.68 / +4.4%
tpch_q06/datafusion:parquet 32761001 / 32601679 / +0.5% 81541670 / 83441525 / -2.3% 0.40 / 0.39 / +2.8%
tpch_q07/datafusion:parquet 215666692 / 212771292 / +1.4% 275197009 / 287347172 / -4.2% 0.78 / 0.74 / +5.8%
tpch_q08/datafusion:parquet 209398321 / 209742263 / -0.2% 283556294 / 290421709 / -2.4% 0.74 / 0.72 / +2.3%
tpch_q09/datafusion:parquet 278612438 / 280041285 / -0.5% 363043674 / 365908144 / -0.8% 0.77 / 0.77 / +0.3%
tpch_q10/datafusion:parquet 306279248 / 316283565 / -3.2% 370393585 / 373591688 / -0.9% 0.83 / 0.85 / -2.3%
tpch_q11/datafusion:parquet 96445058 / 96146211 / +0.3% 118123571 / 121818948 / -3.0% 0.82 / 0.79 / +3.4%
tpch_q12/datafusion:parquet 78404660 / 78642679 / -0.3% 134703640 / 133504273 / +0.9% 0.58 / 0.59 / -1.2%
tpch_q13/datafusion:parquet 194764615 / 194762038 / +0.0% 227042910 / 230034142 / -1.3% 0.86 / 0.85 / +1.3%
tpch_q14/datafusion:parquet 73606878 / 75285800 / -2.2% 172327562 / 181988813 / -5.3% 0.43 / 0.41 / +3.3%
tpch_q15/datafusion:parquet 77244499 / 78362693 / -1.4% 138260016 / 136488530 / +1.3% 0.56 / 0.57 / -2.7%
tpch_q16/datafusion:parquet 85046781 / 86878339 / -2.1% 111709586 / 112521982 / -0.7% 0.76 / 0.77 / -1.4%
tpch_q17/datafusion:parquet 205146692 / 204724880 / +0.2% 268388787 / 268845259 / -0.2% 0.76 / 0.76 / +0.4%
tpch_q18/datafusion:parquet 263500571 / 261369950 / +0.8% 314044944 / 313891247 / +0.0% 0.84 / 0.83 / +0.8%
tpch_q19/datafusion:parquet 98031594 / 96948517 / +1.1% 174807129 / 176064158 / -0.7% 0.56 / 0.55 / +1.8%
tpch_q20/datafusion:parquet 152160942 / 152237719 / -0.1% 221063232 / 216326481 / +2.2% 0.69 / 0.70 / -2.2%
tpch_q21/datafusion:parquet 226084212 / 227503840 / -0.6% 304107501 / 307029014 / -1.0% 0.74 / 0.74 / +0.3%
tpch_q22/datafusion:parquet 161065314 / 160888107 / +0.1% 180853345 / 187107979 / -3.3% 0.89 / 0.86 / +3.6%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 55899285 / 56803401 / -1.6% 94979876 / 100833603 / -5.8% 0.59 / 0.56 / +4.5%
tpch_q02/duckdb:vortex-file-compressed 32242164 / 32872168 / -1.9% 50757463 / 47757928 / +6.3% 0.64 / 0.69 / -7.7%
tpch_q03/duckdb:vortex-file-compressed 59439626 / 59952086 / -0.9% 99113179 / 99075960 / +0.0% 0.60 / 0.61 / -0.9%
tpch_q04/duckdb:vortex-file-compressed 79755444 / 79836528 / -0.1% 113269740 / 110095265 / +2.9% 0.70 / 0.73 / -2.9%
tpch_q05/duckdb:vortex-file-compressed 64352742 / 64621083 / -0.4% 108301012 / 104829777 / +3.3% 0.59 / 0.62 / -3.6%
tpch_q06/duckdb:vortex-file-compressed 21257042 / 21886768 / -2.9% 59200427 / 60804148 / -2.6% 0.36 / 0.36 / -0.2%
tpch_q07/duckdb:vortex-file-compressed 59374235 / 61494755 / -3.4% 115858528 / 116906152 / -0.9% 0.51 / 0.53 / -2.6%
tpch_q08/duckdb:vortex-file-compressed 84784658 / 84652871 / +0.2% 141414326 / 142124016 / -0.5% 0.60 / 0.60 / +0.7%
tpch_q09/duckdb:vortex-file-compressed 166356146 / 170486828 / -2.4% 229961875 / 228030498 / +0.8% 0.72 / 0.75 / -3.2%
tpch_q10/duckdb:vortex-file-compressed 114189147 / 115626086 / -1.2% 193820362 / 182945729 / +5.9% 0.59 / 0.63 / -6.8%
tpch_q11/duckdb:vortex-file-compressed 17163409 / 17512029 / -2.0% 31083864 / 33622808 / -7.6% 0.55 / 0.52 / +6.0%
tpch_q12/duckdb:vortex-file-compressed 53770369 / 56002881 / -4.0% 89621097 / 86658220 / +3.4% 0.60 / 0.65 / -7.2%
tpch_q13/duckdb:vortex-file-compressed 92261112 / 91416864 / +0.9% 126503704 / 133076150 / -4.9% 0.73 / 0.69 / +6.2%
tpch_q14/duckdb:vortex-file-compressed 30131647 / 30476397 / -1.1% 72224362 / 71613827 / +0.9% 0.42 / 0.43 / -2.0%
tpch_q15/duckdb:vortex-file-compressed 37460877 / 38056054 / -1.6% 79292333 / 84557557 / -6.2% 0.47 / 0.45 / +5.0%
tpch_q16/duckdb:vortex-file-compressed 42695517 / 42626078 / +0.2% 53433831 / 52931077 / +0.9% 0.80 / 0.81 / -0.8%
tpch_q17/duckdb:vortex-file-compressed 77758723 / 54404613 / +42.9% 🔴 153953772 / 99368300 / +54.9% 🔴 0.51 / 0.55 / -7.7%
tpch_q18/duckdb:vortex-file-compressed 135101575 / 135157430 / -0.0% 152335419 / 152181900 / +0.1% 0.89 / 0.89 / -0.1%
tpch_q19/duckdb:vortex-file-compressed 44192778 / 41959792 / +5.3% 104814904 / 95555370 / +9.7% 0.42 / 0.44 / -4.0%
tpch_q20/duckdb:vortex-file-compressed 58915191 / 59812802 / -1.5% 118368826 / 113424196 / +4.4% 0.50 / 0.53 / -5.6%
tpch_q21/duckdb:vortex-file-compressed 245156542 / 241987348 / +1.3% 272332129 / 272009422 / +0.1% 0.90 / 0.89 / +1.2%
tpch_q22/duckdb:vortex-file-compressed 40256205 / 40673990 / -1.0% 56139484 / 54195705 / +3.6% 0.72 / 0.75 / -4.5%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 69956900 / 70413023 / -0.6% 101234709 / 89045575 / +13.7% 🔴 0.69 / 0.79 / -12.6%
tpch_q02/duckdb:parquet 73654429 / 71196573 / +3.5% 81717741 / 82347167 / -0.8% 0.90 / 0.86 / +4.2%
tpch_q03/duckdb:parquet 115191883 / 113213902 / +1.7% 159077120 / 159353365 / -0.2% 0.72 / 0.71 / +1.9%
tpch_q04/duckdb:parquet 75122786 / 74607622 / +0.7% 100635153 / 112338681 / -10.4% 🟢 0.75 / 0.66 / +12.4%
tpch_q05/duckdb:parquet 124939078 / 125487742 / -0.4% 163202682 / 174432967 / -6.4% 0.77 / 0.72 / +6.4%
tpch_q06/duckdb:parquet 34480013 / 34612110 / -0.4% 49199673 / 48470065 / +1.5% 0.70 / 0.71 / -1.9%
tpch_q07/duckdb:parquet 89590209 / 90694202 / -1.2% 132098377 / 128158720 / +3.1% 0.68 / 0.71 / -4.2%
tpch_q08/duckdb:parquet 144461902 / 142856394 / +1.1% 187611471 / 189637061 / -1.1% 0.77 / 0.75 / +2.2%
tpch_q09/duckdb:parquet 221715295 / 223782316 / -0.9% 264582948 / 265200526 / -0.2% 0.84 / 0.84 / -0.7%
tpch_q10/duckdb:parquet 472333704 / 473909340 / -0.3% 509111820 / 509653174 / -0.1% 0.93 / 0.93 / -0.2%
tpch_q11/duckdb:parquet 30606140 / 30818723 / -0.7% 38450562 / 37395911 / +2.8% 0.80 / 0.82 / -3.4%
tpch_q12/duckdb:parquet 74273845 / 74368457 / -0.1% 94503045 / 94870031 / -0.4% 0.79 / 0.78 / +0.3%
tpch_q13/duckdb:parquet 316299456 / 315490459 / +0.3% 331760669 / 328539085 / +1.0% 0.95 / 0.96 / -0.7%
tpch_q14/duckdb:parquet 103604291 / 102996162 / +0.6% 139064816 / 133565844 / +4.1% 0.75 / 0.77 / -3.4%
tpch_q15/duckdb:parquet 43228597 / 43707826 / -1.1% 77446796 / 67249840 / +15.2% 🔴 0.56 / 0.65 / -14.1%
tpch_q16/duckdb:parquet 114227094 / 114661962 / -0.4% 125575576 / 124604311 / +0.8% 0.91 / 0.92 / -1.1%
tpch_q17/duckdb:parquet 76100963 / 73422355 / +3.6% 108546316 / 102688547 / +5.7% 0.70 / 0.72 / -1.9%
tpch_q18/duckdb:parquet 205808443 / 202841181 / +1.5% 168587092 / 177356894 / -4.9% 1.22 / 1.14 / +6.7%
tpch_q19/duckdb:parquet 162314978 / 162559934 / -0.2% 195639886 / 193339806 / +1.2% 0.83 / 0.84 / -1.3%
tpch_q20/duckdb:parquet 127975376 / 128126350 / -0.1% 163842139 / 161838646 / +1.2% 0.78 / 0.79 / -1.3%
tpch_q21/duckdb:parquet 264187473 / 274616193 / -3.8% 300043022 / 312547521 / -4.0% 0.88 / 0.88 / +0.2%
tpch_q22/duckdb:parquet 263895732 / 263107694 / +0.3% 274063591 / 271165000 / +1.1% 0.96 / 0.97 / -0.8%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Engines: DuckDB No clear signal (+2.8%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.973x ➖ · cold 0.987x ➖
Shifts: Parquet (control) -2.7% · Median polish -1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9038698 / 9070546 / -0.4% 9403836 / 9373903 / +0.3% 0.96 / 0.97 / -0.7%
statpopgen_q01/duckdb:vortex-file-compressed 10422903 / 10546083 / -1.2% 14609771 / 16481937 / -11.4% 🟢 0.71 / 0.64 / +11.5%
statpopgen_q02/duckdb:vortex-file-compressed 379689712 / 377153659 / +0.7% 398215834 / 396483808 / +0.4% 0.95 / 0.95 / +0.2%
statpopgen_q03/duckdb:vortex-file-compressed 891755850 / 892837494 / -0.1% 892439946 / 898701105 / -0.7% 1.00 / 0.99 / +0.6%
statpopgen_q04/duckdb:vortex-file-compressed 893876296 / 902992346 / -1.0% 911470262 / 912873531 / -0.2% 0.98 / 0.99 / -0.9%
statpopgen_q05/duckdb:vortex-file-compressed 421705870 / 424046930 / -0.6% 437197774 / 440928905 / -0.8% 0.96 / 0.96 / +0.3%
statpopgen_q06/duckdb:vortex-file-compressed 1166026728 / 1164567858 / +0.1% 1170396295 / 1167536043 / +0.2% 1.00 / 1.00 / -0.1%
statpopgen_q07/duckdb:vortex-file-compressed 185475430 / 181929722 / +1.9% 208410023 / 199884591 / +4.3% 0.89 / 0.91 / -2.2%
statpopgen_q08/duckdb:vortex-file-compressed 200938459 / 197736016 / +1.6% 227291617 / 213921947 / +6.2% 0.88 / 0.92 / -4.4%
statpopgen_q09/duckdb:vortex-file-compressed 713080913 / 709609454 / +0.5% 735024686 / 732247143 / +0.4% 0.97 / 0.97 / +0.1%
statpopgen_q10/duckdb:vortex-file-compressed 1993777660 / 2019272586 / -1.3% 1973846891 / 1972460024 / +0.1% 1.01 / 1.02 / -1.3%
duckdb / parquet / ns (0.973x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 244628028 / 251158082 / -2.6% 244937870 / 245705540 / -0.3% 1.00 / 1.02 / -2.3%
statpopgen_q01/duckdb:parquet 303435802 / 303350614 / +0.0% 305349737 / 306309351 / -0.3% 0.99 / 0.99 / +0.3%
statpopgen_q02/duckdb:parquet 566176750 / 554081088 / +2.2% 579081114 / 582592954 / -0.6% 0.98 / 0.95 / +2.8%
statpopgen_q03/duckdb:parquet 808922190 / 874514976 / -7.5% 839520248 / 863514646 / -2.8% 0.96 / 1.01 / -4.9%
statpopgen_q04/duckdb:parquet 798849148 / 836367826 / -4.5% 842001302 / 841100204 / +0.1% 0.95 / 0.99 / -4.6%
statpopgen_q05/duckdb:parquet 582592892 / 591212680 / -1.5% 571574378 / 618986773 / -7.7% 1.02 / 0.96 / +6.7%
statpopgen_q06/duckdb:parquet 683093322 / 732653149 / -6.8% 689486753 / 696904454 / -1.1% 0.99 / 1.05 / -5.8%
statpopgen_q07/duckdb:parquet 612210346 / 614686632 / -0.4% 706556499 / 719349994 / -1.8% 0.87 / 0.85 / +1.4%
statpopgen_q08/duckdb:parquet 619358005 / 622360592 / -0.5% 685487756 / 702176101 / -2.4% 0.90 / 0.89 / +1.9%
statpopgen_q09/duckdb:parquet 796540252 / 819582917 / -2.8% 809437010 / 822124657 / -1.5% 0.98 / 1.00 / -1.3%
statpopgen_q10/duckdb:parquet 1451269886 / 1519180908 / -4.5% 1336796704 / 1273340704 / +5.0% 1.09 / 1.19 / -9.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 095b9a4b vs base dc1b355d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+4.8%, environment too noisy confidence) · DuckDB No clear signal (-1.5%, environment too noisy confidence)
Vortex (geomean): hot 1.056x ➖ · cold 1.019x ➖
Parquet (geomean): hot 1.039x ➖ · cold 1.062x ➖
Shifts: Parquet (control) +3.9% · Median polish +1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.063x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 207665284 / 217011667 / -4.3% 665412979 / 585802811 / +13.6% 0.31 / 0.37 / -15.8%
tpch_q02/datafusion:vortex-file-compressed 321181929 / 356713532 / -10.0% 591672264 / 608186179 / -2.7% 0.54 / 0.59 / -7.4%
tpch_q03/datafusion:vortex-file-compressed 321498517 / 321088125 / +0.1% 938623235 / 780482135 / +20.3% 0.34 / 0.41 / -16.7%
tpch_q04/datafusion:vortex-file-compressed 195978117 / 165801034 / +18.2% 348689024 / 414298431 / -15.8% 0.56 / 0.40 / +40.4%
tpch_q05/datafusion:vortex-file-compressed 572437060 / 418914187 / +36.6% 🔴 562429511 / 750747073 / -25.1% 1.02 / 0.56 / +82.4%
tpch_q06/datafusion:vortex-file-compressed 249421821 / 231446009 / +7.8% 368546601 / 396521131 / -7.1% 0.68 / 0.58 / +15.9%
tpch_q07/datafusion:vortex-file-compressed 696687063 / 358671629 / +94.2% 🔴 584519375 / 507815886 / +15.1% 1.19 / 0.71 / +68.8%
tpch_q08/datafusion:vortex-file-compressed 562477561 / 664861990 / -15.4% 791554001 / 579380981 / +36.6% 🔴 0.71 / 1.15 / -38.1%
tpch_q09/datafusion:vortex-file-compressed 476833987 / 513812589 / -7.2% 423469920 / 611352575 / -30.7% 🟢 1.13 / 0.84 / +34.0%
tpch_q10/datafusion:vortex-file-compressed 330374121 / 286873911 / +15.2% 457818172 / 445025634 / +2.9% 0.72 / 0.64 / +11.9%
tpch_q11/datafusion:vortex-file-compressed 298085920 / 268462675 / +11.0% 479588165 / 474992973 / +1.0% 0.62 / 0.57 / +10.0%
tpch_q12/datafusion:vortex-file-compressed 343165716 / 341288560 / +0.6% 584720677 / 471692958 / +24.0% 0.59 / 0.72 / -18.9%
tpch_q13/datafusion:vortex-file-compressed 133064854 / 112946536 / +17.8% 361312833 / 531152453 / -32.0% 🟢 0.37 / 0.21 / +73.2%
tpch_q14/datafusion:vortex-file-compressed 162403251 / 202401411 / -19.8% 282263744 / 350285124 / -19.4% 0.58 / 0.58 / -0.4%
tpch_q15/datafusion:vortex-file-compressed 691034553 / 276112955 / +150.3% 🔴 681996645 / 445332153 / +53.1% 🔴 1.01 / 0.62 / +63.4%
tpch_q16/datafusion:vortex-file-compressed 128162303 / 174183250 / -26.4% 279734395 / 309896302 / -9.7% 0.46 / 0.56 / -18.5%
tpch_q17/datafusion:vortex-file-compressed 262986245 / 324655518 / -19.0% 471258150 / 440062888 / +7.1% 0.56 / 0.74 / -24.4%
tpch_q18/datafusion:vortex-file-compressed 217182961 / 231663459 / -6.3% 396073380 / 387276525 / +2.3% 0.55 / 0.60 / -8.3%
tpch_q19/datafusion:vortex-file-compressed 427061043 / 340884917 / +25.3% 452325663 / 441036298 / +2.6% 0.94 / 0.77 / +22.2%
tpch_q20/datafusion:vortex-file-compressed 297432576 / 261919562 / +13.6% 469880127 / 439545861 / +6.9% 0.63 / 0.60 / +6.2%
tpch_q21/datafusion:vortex-file-compressed 410713111 / 468900977 / -12.4% 537526248 / 548805862 / -2.1% 0.76 / 0.85 / -10.6%
tpch_q22/datafusion:vortex-file-compressed 170614316 / 215575386 / -20.9% 582613842 / 408025834 / +42.8% 🔴 0.29 / 0.53 / -44.6%
datafusion / parquet / ns (1.015x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 165389645 / 165749699 / -0.2% 572242868 / 541713821 / +5.6% 0.29 / 0.31 / -5.5%
tpch_q02/datafusion:parquet 268471140 / 265677913 / +1.1% 487480489 / 578779938 / -15.8% 0.55 / 0.46 / +20.0%
tpch_q03/datafusion:parquet 295541948 / 283011190 / +4.4% 738379427 / 685932859 / +7.6% 0.40 / 0.41 / -3.0%
tpch_q04/datafusion:parquet 149710292 / 143065528 / +4.6% 413324886 / 552746386 / -25.2% 0.36 / 0.26 / +39.9%
tpch_q05/datafusion:parquet 386459653 / 384510196 / +0.5% 524385769 / 493529308 / +6.3% 0.74 / 0.78 / -5.4%
tpch_q06/datafusion:parquet 142424589 / 125249054 / +13.7% 249247029 / 436629857 / -42.9% 🟢 0.57 / 0.29 / +99.2%
tpch_q07/datafusion:parquet 339115489 / 366671797 / -7.5% 528689694 / 462243898 / +14.4% 0.64 / 0.79 / -19.1%
tpch_q08/datafusion:parquet 422594219 / 439280450 / -3.8% 542551952 / 667732794 / -18.7% 0.78 / 0.66 / +18.4%
tpch_q09/datafusion:parquet 480363287 / 417589465 / +15.0% 718329398 / 625463946 / +14.8% 0.67 / 0.67 / +0.2%
tpch_q10/datafusion:parquet 381684345 / 432073440 / -11.7% 533306588 / 820518733 / -35.0% 🟢 0.72 / 0.53 / +35.9%
tpch_q11/datafusion:parquet 251906613 / 268248876 / -6.1% 490555106 / 398205540 / +23.2% 0.51 / 0.67 / -23.8%
tpch_q12/datafusion:parquet 221305809 / 170177988 / +30.0% 🔴 644040092 / 339545329 / +89.7% 🔴 0.34 / 0.50 / -31.4%
tpch_q13/datafusion:parquet 404977325 / 393803371 / +2.8% 698859934 / 476126478 / +46.8% 🔴 0.58 / 0.83 / -29.9%
tpch_q14/datafusion:parquet 183980353 / 178173822 / +3.3% 304211407 / 337026769 / -9.7% 0.60 / 0.53 / +14.4%
tpch_q15/datafusion:parquet 285359465 / 257179661 / +11.0% 439512096 / 392895944 / +11.9% 0.65 / 0.65 / -0.8%
tpch_q16/datafusion:parquet 108945515 / 108150213 / +0.7% 275056706 / 247622806 / +11.1% 0.40 / 0.44 / -9.3%
tpch_q17/datafusion:parquet 278412274 / 273416385 / +1.8% 391860886 / 387318007 / +1.2% 0.71 / 0.71 / +0.6%
tpch_q18/datafusion:parquet 432446844 / 415400799 / +4.1% 594948357 / 545329641 / +9.1% 0.73 / 0.76 / -4.6%
tpch_q19/datafusion:parquet 162806397 / 178636506 / -8.9% 275693034 / 295341815 / -6.7% 0.59 / 0.60 / -2.4%
tpch_q20/datafusion:parquet 250192781 / 274427913 / -8.8% 444634140 / 423919491 / +4.9% 0.56 / 0.65 / -13.1%
tpch_q21/datafusion:parquet 336667145 / 347716604 / -3.2% 474664880 / 413021504 / +14.9% 0.71 / 0.84 / -15.8%
tpch_q22/datafusion:parquet 163739540 / 167787527 / -2.4% 318875897 / 392296540 / -18.7% 0.51 / 0.43 / +20.1%
duckdb / vortex-file-compressed / ns (1.048x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 195873518 / 189421275 / +3.4% 248111432 / 236478277 / +4.9% 0.79 / 0.80 / -1.4%
tpch_q02/duckdb:vortex-file-compressed 406565850 / 380795226 / +6.8% 502160868 / 440683146 / +14.0% 0.81 / 0.86 / -6.3%
tpch_q03/duckdb:vortex-file-compressed 373600683 / 386140410 / -3.2% 431693013 / 430563075 / +0.3% 0.87 / 0.90 / -3.5%
tpch_q04/duckdb:vortex-file-compressed 275101599 / 230486126 / +19.4% 353536205 / 263362044 / +34.2% 🔴 0.78 / 0.88 / -11.1%
tpch_q05/duckdb:vortex-file-compressed 467582127 / 381475680 / +22.6% 405465285 / 412873100 / -1.8% 1.15 / 0.92 / +24.8%
tpch_q06/duckdb:vortex-file-compressed 250031155 / 255065434 / -2.0% 262408470 / 226984581 / +15.6% 0.95 / 1.12 / -15.2%
tpch_q07/duckdb:vortex-file-compressed 416589582 / 406648156 / +2.4% 542937299 / 430853988 / +26.0% 0.77 / 0.94 / -18.7%
tpch_q08/duckdb:vortex-file-compressed 508747580 / 547145338 / -7.0% 570742846 / 601674736 / -5.1% 0.89 / 0.91 / -2.0%
tpch_q09/duckdb:vortex-file-compressed 447391949 / 424640294 / +5.4% 513573663 / 437959527 / +17.3% 0.87 / 0.97 / -10.2%
tpch_q10/duckdb:vortex-file-compressed 437753137 / 436249494 / +0.3% 442913175 / 455999646 / -2.9% 0.99 / 0.96 / +3.3%
tpch_q11/duckdb:vortex-file-compressed 139336594 / 140585246 / -0.9% 158626967 / 187548231 / -15.4% 0.88 / 0.75 / +17.2%
tpch_q12/duckdb:vortex-file-compressed 668358241 / 462092922 / +44.6% 🔴 453882909 / 665495998 / -31.8% 🟢 1.47 / 0.69 / +112.1%
tpch_q13/duckdb:vortex-file-compressed 268197781 / 260417045 / +3.0% 283269935 / 246960848 / +14.7% 0.95 / 1.05 / -10.2%
tpch_q14/duckdb:vortex-file-compressed 228806918 / 209902092 / +9.0% 263168436 / 239235374 / +10.0% 0.87 / 0.88 / -0.9%
tpch_q15/duckdb:vortex-file-compressed 144446091 / 138327981 / +4.4% 186338945 / 187856447 / -0.8% 0.78 / 0.74 / +5.3%
tpch_q16/duckdb:vortex-file-compressed 169998327 / 185014692 / -8.1% 203078759 / 204587661 / -0.7% 0.84 / 0.90 / -7.4%
tpch_q17/duckdb:vortex-file-compressed 366362792 / 395360291 / -7.3% 368736593 / 419415145 / -12.1% 0.99 / 0.94 / +5.4%
tpch_q18/duckdb:vortex-file-compressed 279787290 / 293499059 / -4.7% 338698583 / 595694530 / -43.1% 🟢 0.83 / 0.49 / +67.7%
tpch_q19/duckdb:vortex-file-compressed 324175853 / 343866735 / -5.7% 359722280 / 360261392 / -0.1% 0.90 / 0.95 / -5.6%
tpch_q20/duckdb:vortex-file-compressed 354689475 / 364225843 / -2.6% 441059375 / 385173581 / +14.5% 0.80 / 0.95 / -15.0%
tpch_q21/duckdb:vortex-file-compressed 582272774 / 519487321 / +12.1% 633946229 / 586825803 / +8.0% 0.92 / 0.89 / +3.8%
tpch_q22/duckdb:vortex-file-compressed 139305153 / 106730123 / +30.5% 🔴 180291314 / 118810354 / +51.7% 🔴 0.77 / 0.90 / -14.0%
duckdb / parquet / ns (1.064x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 292674152 / 292586121 / +0.0% 302230642 / 283720898 / +6.5% 0.97 / 1.03 / -6.1%
tpch_q02/duckdb:parquet 645591994 / 628418218 / +2.7% 662293302 / 639080155 / +3.6% 0.97 / 0.98 / -0.9%
tpch_q03/duckdb:parquet 864633728 / 771450046 / +12.1% 857833424 / 736064655 / +16.5% 1.01 / 1.05 / -3.8%
tpch_q04/duckdb:parquet 425672237 / 436735708 / -2.5% 566853802 / 503893443 / +12.5% 0.75 / 0.87 / -13.4%
tpch_q05/duckdb:parquet 983786936 / 842228602 / +16.8% 993020112 / 868313570 / +14.4% 0.99 / 0.97 / +2.1%
tpch_q06/duckdb:parquet 304291196 / 268680761 / +13.3% 336112649 / 251292746 / +33.8% 🔴 0.91 / 1.07 / -15.3%
tpch_q07/duckdb:parquet 864188708 / 819909705 / +5.4% 883201192 / 781250187 / +13.0% 0.98 / 1.05 / -6.8%
tpch_q08/duckdb:parquet 1093410860 / 973301171 / +12.3% 1115099882 / 1087401215 / +2.5% 0.98 / 0.90 / +9.5%
tpch_q09/duckdb:parquet 1016747642 / 1046399970 / -2.8% 947854729 / 1010569300 / -6.2% 1.07 / 1.04 / +3.6%
tpch_q10/duckdb:parquet 1055949079 / 886075672 / +19.2% 901866185 / 977219289 / -7.7% 1.17 / 0.91 / +29.1%
tpch_q11/duckdb:parquet 434449518 / 404737067 / +7.3% 602183917 / 383629797 / +57.0% 🔴 0.72 / 1.06 / -31.6%
tpch_q12/duckdb:parquet 516452070 / 476826111 / +8.3% 700463083 / 567691561 / +23.4% 0.74 / 0.84 / -12.2%
tpch_q13/duckdb:parquet 785151939 / 737232719 / +6.5% 858176990 / 765289781 / +12.1% 0.91 / 0.96 / -5.0%
tpch_q14/duckdb:parquet 456935530 / 459157765 / -0.5% 452243048 / 423667066 / +6.7% 1.01 / 1.08 / -6.8%
tpch_q15/duckdb:parquet 378112905 / 362726602 / +4.2% 299337179 / 321988620 / -7.0% 1.26 / 1.13 / +12.1%
tpch_q16/duckdb:parquet 488791026 / 460982284 / +6.0% 508062491 / 477204784 / +6.5% 0.96 / 0.97 / -0.4%
tpch_q17/duckdb:parquet 448590902 / 452138894 / -0.8% 426760216 / 443879513 / -3.9% 1.05 / 1.02 / +3.2%
tpch_q18/duckdb:parquet 582106669 / 542140373 / +7.4% 616713592 / 547072166 / +12.7% 0.94 / 0.99 / -4.8%
tpch_q19/duckdb:parquet 533705570 / 522801266 / +2.1% 547592225 / 550703064 / -0.6% 0.97 / 0.95 / +2.7%
tpch_q20/duckdb:parquet 841687518 / 777407261 / +8.3% 850447395 / 734441554 / +15.8% 0.99 / 1.06 / -6.5%
tpch_q21/duckdb:parquet 705230332 / 633849021 / +11.3% 786144766 / 669939856 / +17.3% 0.90 / 0.95 / -5.2%
tpch_q22/duckdb:parquet 402732561 / 374715218 / +7.5% 628092651 / 381103631 / +64.8% 🔴 0.64 / 0.98 / -34.8%

@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch 3 times, most recently from 93d694a to 637a954 Compare September 8, 2026 12:46
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 5a76dc2 to 2dd2e1a Compare September 8, 2026 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix ext/datafusion Relates to the DataFusion integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant