/
githubmirror
/
spark
Обзор
Документация
Войти
/
githubmirror
/
spark
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
master
sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt
68 строк
5 KB
Dongjoon Hyun
[SPARK-58415][INFRA][TEST] Regenerate benchmark results
29 июл 2026, 10:51
29 июл 2026, 10:51
6b793ce
Код
Авторство
О чём код?
================================================================================================ Parquet writer benchmark ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor Parquet(PARQUET_1_0) writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Output Single Int Column 1778 1819 59 8.8 113.0 1.0X Output Single Double Column 1846 1861 21 8.5 117.4 1.0X Output Int and String Column 4613 4679 92 3.4 293.3 0.4X Output Partitions 3318 3370 74 4.7 210.9 0.5X Output Buckets 4452 4477 36 3.5 283.0 0.4X OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor Parquet(PARQUET_2_0) writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Output Single Int Column 1805 1824 26 8.7 114.8 1.0X Output Single Double Column 1880 1884 5 8.4 119.5 1.0X Output Int and String Column 4677 4679 3 3.4 297.4 0.4X Output Partitions 3273 3328 78 4.8 208.1 0.6X Output Buckets 4239 4246 10 3.7 269.5 0.4X ================================================================================================ ORC writer benchmark ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Output Single Int Column 1013 1016 4 15.5 64.4 1.0X Output Single Double Column 1603 1605 2 9.8 101.9 0.6X Output Int and String Column 3904 3926 32 4.0 248.2 0.3X Output Partitions 2537 2539 3 6.2 161.3 0.4X Output Buckets 3274 3287 18 4.8 208.2 0.3X ================================================================================================ JSON writer benchmark ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor JSON writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Output Single Int Column 1471 1478 10 10.7 93.5 1.0X Output Single Double Column 2157 2177 28 7.3 137.2 0.7X Output Int and String Column 3647 3658 16 4.3 231.9 0.4X Output Partitions 2968 2969 1 5.3 188.7 0.5X Output Buckets 3690 3712 31 4.3 234.6 0.4X ================================================================================================ CSV writer benchmark ================================================================================================ OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure AMD EPYC 7763 64-Core Processor CSV writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Output Single Int Column 3240 3264 34 4.9 206.0 1.0X Output Single Double Column 4003 4006 5 3.9 254.5 0.8X Output Int and String Column 5851 5866 22 2.7 372.0 0.6X Output Partitions 5131 5133 4 3.1 326.2 0.6X Output Buckets 6157 6168 16 2.6 391.4 0.5X