/
githubmirror
/
spark
Обзор
Документация
Войти
/
githubmirror
/
spark
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
master
sql/core/benchmarks/MiscBenchmark-results.txt
125 строк
9 KB
Dongjoon Hyun
[SPARK-58415][INFRA][TEST] Regenerate benchmark results
29 июл 2026, 10:51
29 июл 2026, 10:51
6b793ce
Код
Авторство
О чём код?
================================================================================================ filter & aggregate without group ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ range/filter/sum wholestage off 39990 40520 749 52.4 19.1 1.0X range/filter/sum wholestage on 2543 2996 254 824.6 1.2 15.7X ================================================================================================ range/limit/sum ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ range/limit/sum wholestage off 77 80 5 6801.7 0.1 1.0X range/limit/sum wholestage on 91 102 10 5790.9 0.2 0.9X ================================================================================================ sample ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ sample with replacement wholestage off 7775 7807 44 16.9 59.3 1.0X sample with replacement wholestage on 4445 4453 17 29.5 33.9 1.7X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- sample without replacement wholestage off 2564 2571 10 51.1 19.6 1.0X sample without replacement wholestage on 798 811 13 164.3 6.1 3.2X ================================================================================================ collect ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ collect 1 million 160 219 66 6.6 152.6 1.0X collect 2 millions 308 425 73 3.4 294.0 0.5X collect 4 millions 674 789 108 1.6 642.7 0.2X ================================================================================================ collect limit ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ collect limit 1 million 152 211 69 6.9 145.1 1.0X collect limit 2 millions 288 420 84 3.6 274.5 0.5X ================================================================================================ generate explode ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ generate explode array wholestage off 11318 11321 5 1.5 674.6 1.0X generate explode array wholestage on 3062 3170 61 5.5 182.5 3.7X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ generate explode map wholestage off 22117 22127 15 0.8 1318.3 1.0X generate explode map wholestage on 9393 9519 98 1.8 559.9 2.4X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ generate posexplode array wholestage off 12250 12277 38 1.4 730.2 1.0X generate posexplode array wholestage on 3083 3135 60 5.4 183.8 4.0X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ generate inline array wholestage off 6740 6749 12 2.5 401.8 1.0X generate inline array wholestage on 2365 2470 94 7.1 141.0 2.8X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ generate big struct array wholestage off 222 225 4 0.3 3701.9 1.0X generate big struct array wholestage on 187 206 20 0.3 3114.7 1.2X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------- generate big nested struct array wholestage off 18215 18295 113 0.0 303587.0 1.0X generate big nested struct array wholestage on 184 197 13 0.3 3069.3 98.9X ================================================================================================ generate regular generator ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 9V74 80-Core Processor generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ generate stack wholestage off 13161 13224 88 1.3 784.5 1.0X generate stack wholestage on 3257 3274 25 5.2 194.1 4.0X