/
githubmirror
/
spark
Обзор
Документация
Войти
/
githubmirror
/
spark
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
master
sql/core/benchmarks/UnionBenchmark-results.txt
478 строк
32 KB
YangJie
[SPARK-56482][SQL] Enable whole-stage codegen fusion for `UnionExec`
06 май 2026, 17:46
06 май 2026, 17:46
3bed886
Код
Авторство
О чём код?
================================================================================================ Union plain (N=2) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 52 74 17 0.4 2598.0 1.0X codegen=on 26 38 6 0.8 1313.5 2.0X ================================================================================================ Union plain (N=4) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=4: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 32 42 5 1.2 809.5 1.0X codegen=on 31 41 5 1.3 776.9 1.0X ================================================================================================ Union plain (N=8) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 54 63 6 1.5 672.4 1.0X codegen=on 42 54 7 1.9 522.9 1.3X ================================================================================================ Union plain (N=16) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=16: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 93 112 15 1.7 583.9 1.0X codegen=on 71 88 12 2.2 445.8 1.3X ================================================================================================ Union plain (N=32) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=32: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 183 205 19 1.7 572.1 1.0X codegen=on 146 156 9 2.2 455.8 1.3X ================================================================================================ Union plain (N=64) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=64: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 1226 1291 93 0.5 1915.4 1.0X codegen=on 364 384 22 1.8 568.3 3.4X ================================================================================================ Union plain (N=128) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=128: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 2841 2941 141 0.5 2219.9 1.0X codegen=on 1035 1039 5 1.2 808.6 2.7X ================================================================================================ Union plain (N=256) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=256: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 7282 7372 126 0.4 2844.7 1.0X codegen=on 3490 3560 99 0.7 1363.1 2.1X ================================================================================================ Union plain (N=512) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=512: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 21272 21287 21 0.2 4154.8 1.0X codegen=on 12509 12760 355 0.4 2443.1 1.7X ================================================================================================ Union plain (N=1024) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union plain, N=1024: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 71083 71242 225 0.1 6941.7 1.0X codegen=on 50694 52393 2403 0.2 4950.6 1.4X ================================================================================================ Union type widening (N=2) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 16 20 3 1.2 820.7 1.0X codegen=on 15 17 2 1.3 745.6 1.1X ================================================================================================ Union type widening (N=4) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=4: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 23 26 3 1.7 582.0 1.0X codegen=on 22 24 3 1.8 543.2 1.1X ================================================================================================ Union type widening (N=8) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 42 46 3 1.9 522.5 1.0X codegen=on 36 39 2 2.2 450.5 1.2X ================================================================================================ Union type widening (N=16) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=16: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 84 90 6 1.9 527.2 1.0X codegen=on 71 75 4 2.3 442.3 1.2X ================================================================================================ Union type widening (N=32) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=32: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 194 202 9 1.7 605.1 1.0X codegen=on 157 162 4 2.0 490.4 1.2X ================================================================================================ Union type widening (N=64) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=64: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 1230 1233 4 0.5 1922.0 1.0X codegen=on 407 412 4 1.6 635.2 3.0X ================================================================================================ Union type widening (N=128) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=128: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 2936 2944 11 0.4 2294.0 1.0X codegen=on 1204 1218 20 1.1 940.6 2.4X ================================================================================================ Union type widening (N=256) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=256: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 7922 7955 47 0.3 3094.5 1.0X codegen=on 4070 4106 51 0.6 1589.8 1.9X ================================================================================================ Union type widening (N=512) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=512: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 23551 23582 45 0.2 4599.7 1.0X codegen=on 14854 15112 364 0.3 2901.3 1.6X ================================================================================================ Union type widening (N=1024) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union type widening, N=1024: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 77463 77935 668 0.1 7564.8 1.0X codegen=on 59960 61705 2468 0.2 5855.4 1.3X ================================================================================================ Union per-child ops (N=2) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 17 21 4 1.2 831.1 1.0X codegen=on 15 18 2 1.3 772.4 1.1X ================================================================================================ Union per-child ops (N=4) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=4: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 27 29 3 1.5 664.0 1.0X codegen=on 24 26 2 1.7 597.4 1.1X ================================================================================================ Union per-child ops (N=8) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 48 51 2 1.7 604.3 1.0X codegen=on 43 45 3 1.9 532.5 1.1X ================================================================================================ Union per-child ops (N=16) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=16: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 97 102 4 1.6 608.7 1.0X codegen=on 83 87 3 1.9 521.8 1.2X ================================================================================================ Union per-child ops (N=32) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=32: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 225 233 6 1.4 703.2 1.0X codegen=on 188 194 5 1.7 587.2 1.2X ================================================================================================ Union per-child ops (N=64) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=64: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 1583 1648 92 0.4 2474.0 1.0X codegen=on 483 487 3 1.3 755.2 3.3X ================================================================================================ Union per-child ops (N=128) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=128: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 3933 3941 11 0.3 3072.8 1.0X codegen=on 1399 1425 37 0.9 1093.0 2.8X ================================================================================================ Union per-child ops (N=256) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=256: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 9835 9873 53 0.3 3841.9 1.0X codegen=on 4583 4650 95 0.6 1790.3 2.1X ================================================================================================ Union per-child ops (N=512) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=512: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 26998 27179 256 0.2 5273.1 1.0X codegen=on 16455 16719 373 0.3 3213.9 1.6X ================================================================================================ Union per-child ops (N=1024) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union per-child ops, N=1024: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 88874 88916 60 0.1 8679.1 1.0X codegen=on 65006 67695 3803 0.2 6348.2 1.4X ================================================================================================ Union + downstream aggregate (N=2) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 54 65 6 0.4 2708.4 1.0X codegen=on 36 45 6 0.6 1776.2 1.5X ================================================================================================ Union + downstream aggregate (N=4) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=4: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 60 76 9 0.7 1511.7 1.0X codegen=on 48 57 7 0.8 1196.3 1.3X ================================================================================================ Union + downstream aggregate (N=8) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 80 94 12 1.0 995.3 1.0X codegen=on 73 83 7 1.1 912.3 1.1X ================================================================================================ Union + downstream aggregate (N=16) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=16: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 151 173 18 1.1 942.2 1.0X codegen=on 136 148 13 1.2 852.9 1.1X ================================================================================================ Union + downstream aggregate (N=32) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=32: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 389 401 15 0.8 1215.3 1.0X codegen=on 375 414 36 0.9 1170.7 1.0X ================================================================================================ Union + downstream aggregate (N=64) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=64: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 1662 1667 6 0.4 2597.6 1.0X codegen=on 771 786 20 0.8 1205.0 2.2X ================================================================================================ Union + downstream aggregate (N=128) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=128: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 4128 4158 42 0.3 3225.3 1.0X codegen=on 2244 2247 5 0.6 1752.7 1.8X ================================================================================================ Union + downstream aggregate (N=256) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=256: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 11367 11549 257 0.2 4440.4 1.0X codegen=on 7226 7719 697 0.4 2822.5 1.6X ================================================================================================ Union + downstream aggregate (N=512) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=512: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 35591 35784 273 0.1 6951.3 1.0X codegen=on 26016 26668 922 0.2 5081.3 1.4X ================================================================================================ Union + downstream aggregate (N=1024) ================================================================================================ OpenJDK 64-Bit Server VM 17.0.19+10-LTS on Linux 6.17.0-1010-azure AMD EPYC 7763 64-Core Processor Union + downstream aggregate, N=1024: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ codegen=off 121937 122855 1299 0.1 11907.9 1.0X codegen=on 105631 109213 5066 0.1 10315.5 1.2X