/
githubmirror
/
spark
Обзор
Документация
Войти
/
githubmirror
/
spark
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
master
sql/core/benchmarks/WindowBenchmark-results.txt
170 строк
12 KB
Dongjoon Hyun
[SPARK-58415][INFRA][TEST] Regenerate benchmark results
29 июл 2026, 10:51
29 июл 2026, 10:51
6b793ce
Код
Авторство
О чём код?
================================================================================================ Section A - MIN (non-invertible) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor MIN sliding window, W=1001, 256K rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ MIN naive (current, baseline) 4014 4035 17 0.1 15313.6 1.0X MIN segtree (default) 392 407 16 0.7 1496.8 10.2X MIN segtree (blockSize=256) 2199 2214 12 0.1 8388.4 1.8X ================================================================================================ Section A - MAX (non-invertible) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor MAX sliding window, W=1001, 256K rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ MAX naive (current, baseline) 4244 4266 21 0.1 16190.5 1.0X MAX segtree (default) 367 373 4 0.7 1401.2 11.6X MAX segtree (blockSize=256) 2231 2238 12 0.1 8510.3 1.9X ================================================================================================ Section A - SUM (Spark has no inverse; full recompute) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM sliding window, W=1001, 256K rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ SUM naive (current, baseline) 4111 4131 30 0.1 15683.8 1.0X SUM segtree (default) 358 365 8 0.7 1364.2 11.5X SUM segtree (blockSize=256) 2228 2245 12 0.1 8498.3 1.8X ================================================================================================ Section A - COUNT ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor COUNT sliding window, W=1001, 256K rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ COUNT naive (current, baseline) 3663 3690 22 0.1 13974.5 1.0X COUNT segtree (default) 325 335 9 0.8 1238.6 11.3X COUNT segtree (blockSize=256) 2161 2165 6 0.1 8242.5 1.7X ================================================================================================ Section A - AVG (multi-buffer) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor AVG sliding window, W=1001, 192K rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ AVG naive (current, baseline) 4441 4463 19 0.0 22588.2 1.0X AVG segtree (default) 337 340 4 0.6 1713.3 13.2X AVG segtree (blockSize=256) 1398 1415 14 0.1 7111.1 3.2X ================================================================================================ Section A - STDDEV_SAMP (multi-buffer, stress) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor STDDEV_SAMP sliding window, W=1001, 2M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------------ STDDEV_SAMP naive (current, baseline) 102720 102801 91 0.0 51360.1 1.0X STDDEV_SAMP segtree (default) 6107 6132 35 0.3 3053.4 16.8X STDDEV_SAMP segtree (blockSize=256) 113831 113863 29 0.0 56915.6 0.9X ================================================================================================ Section B - W=10 scaling (stress: Pareto loss zone) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM scaling, W=11, 2M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ SUM naive W=11 959 964 4 2.1 479.6 1.0X SUM segtree (default) W=11 1926 1933 9 1.0 963.2 0.5X ================================================================================================ Section B - W=50 scaling (stress: Pareto loss zone) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM scaling, W=51, 2M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ SUM naive W=51 2226 2242 27 0.9 1113.0 1.0X SUM segtree (default) W=51 2193 2203 12 0.9 1096.5 1.0X ================================================================================================ Section B - W=201 scaling ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM scaling, W=201, 1M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ SUM naive W=201 3466 3556 187 0.3 3466.0 1.0X SUM segtree (default) W=201 1224 1232 7 0.8 1224.1 2.8X ================================================================================================ Section B - W=4001 scaling (stress, + bs=256 cross-block) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM scaling, W=4001, 2M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ SUM naive W=4001 125108 125307 192 0.0 62553.9 1.0X SUM segtree (default) W=4001 3308 3320 21 0.6 1653.9 37.8X SUM segtree (blockSize=256) W=4001 110622 111593 1667 0.0 55311.1 1.1X ================================================================================================ Section F - spill regression guard (String, stress) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor MAX String spill guard, W=1001, 1M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------------- MAX naive (String) 59293 59370 67 0.0 59292.7 1.0X MAX segtree default (String) 2796 2808 16 0.4 2796.2 21.2X ================================================================================================ Section C - N-sweep small (stress) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM N-sweep (segtree-only), W=1001, 2M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------------ SUM segtree (default) N=2M 2804 2815 16 0.7 1402.1 1.0X ================================================================================================ Section C - N-sweep mid (stress) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM N-sweep (segtree-only), W=1001, 8M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------------ SUM segtree (default) N=8M 13613 13648 32 0.6 1701.6 1.0X ================================================================================================ Section C - N-sweep large (stress) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor SUM N-sweep (segtree-only), W=1001, 16M rows (stress): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------------- SUM segtree (default) N=16M 33919 33948 49 0.5 2119.9 1.0X