/
githubmirror
/
spark
Обзор
Документация
Войти
/
githubmirror
/
spark
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
master
sql/core/benchmarks/DatasetBenchmark-results.txt
44 строки
4 KB
Dongjoon Hyun
[SPARK-58415][INFRA][TEST] Regenerate benchmark results
29 июл 2026, 10:51
29 июл 2026, 10:51
6b793ce
Код
Авторство
О чём код?
================================================================================================ Dataset Benchmark ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ RDD 5823 5872 69 17.2 58.2 1.0X DataFrame 1222 1256 48 81.8 12.2 4.8X Dataset 1674 1681 10 59.7 16.7 3.5X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ RDD 6959 6990 44 14.4 69.6 1.0X DataFrame 2892 2898 9 34.6 28.9 2.4X Dataset 6997 7012 21 14.3 70.0 1.0X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ RDD 4197 4305 152 23.8 42.0 1.0X DataFrame 707 716 10 141.4 7.1 5.9X Dataset 1617 1630 17 61.8 16.2 2.6X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ RDD 2082 2094 18 48.0 20.8 1.0X DataFrame 124 141 18 805.3 1.2 16.8X Dataset 2526 2530 6 39.6 25.3 0.8X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ RDD sum 1433 1455 31 69.8 14.3 1.0X DataFrame sum 68 87 13 1469.6 0.7 21.1X Dataset sum using Aggregator 2128 2129 1 47.0 21.3 0.7X Dataset complex Aggregator 5125 5277 216 19.5 51.2 0.3X