githubmirror/spark | Gitverse

/

/

Обзор ДокументацияВойти

/

/

Аналитика

Безопасность

.../pyspark/sql/

[SPARK-53696][PYTHON][CONNECT][SQL] Default to bytes for BinaryType in PySpark

10 месяцев назад

[SPARK-53841][PYTHON][CONNECT] Implement `transform()` in Column API

10 месяцев назад

[SPARK-53759][PYTHON][4.1] Fix missing flush in simple-worker path

4 месяца назад

[SPARK-54785][SQL] Add support for binary sketch aggregations in KLL

7 месяцев назад

[SPARK-55502][PYTHON][4.1] Unify UDF and UDTF Arrow conversion error handling

5 месяцев назад

[SPARK-53584][PYTHON] Improve process_column_param validation and column parameter docstring

год назад

[SPARK-50867][PYTHON][TESTS] Move `search_jar` and `SPARK_HOME` to `sqlutils.py`

2 года назад

[SPARK-53759][PYTHON][4.1] Fix missing flush in simple-worker path

4 месяца назад

[SPARK-56584][PYTHON][4.1] Generalize `RESULT_TYPE_MISMATCH_FOR_ARROW_UDF` error class and remove dead `SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF`

3 месяца назад

[SPARK-53759][PYTHON][4.1] Fix missing flush in simple-worker path

4 месяца назад

[SPARK-54166][GEO][PYTHON] Introduce type encoders for geospatial types in PySpark

9 месяцев назад

[SPARK-52980][PYTHON] Support Arrow Python UDTFs

год назад

[SPARK-50498][PYTHON] Avoid unnecessary py4j call in `listFunctions`

2 года назад

[SPARK-53841][PYTHON][CONNECT] Implement `transform()` in Column API

10 месяцев назад

[SPARK-48961][PYTHON] Make the parameter naming of `PySparkException` consistent with JVM

2 года назад

[SPARK-48220][PYTHON] Allow passing PyArrow Table to createDataFrame()

2 года назад

[SPARK-54176][GEO][PYTHON] Introduce Geography and Geometry data types to PySpark Connect

9 месяцев назад

[SPARK-54728][PYTHON][DOCS] Remove a wrong note in `dataframe.isEmpty`

8 месяцев назад

[SPARK-53030][PYTHON] Support Arrow writer for streaming Python data sources

год назад

datasource_internal.py

[SPARK-55416][SS][PYTHON][4.1] Streaming Python Data Source memory leak when end-offset is not updated

6 месяцев назад

[SPARK-54096][GEO][PYTHON] Support Spatial Reference System mapping in PySpark

9 месяцев назад

[MINOR][PYTHON][DOCS] Fix the doctest of `pivot`

9 месяцев назад

[SPARK-51282][ML][PYTHON][CONNECT] Optimize OneVsRestModel transform by eliminating the JVM-Python data exchange

год назад

[SPARK-48714][SPARK-48794][FOLLOW-UP][PYTHON][DOCS] Add `mergeInto` to API reference

2 года назад

[SPARK-54068][PYTHON] Fix `to_feather` to support PyArrow 22.0.0

8 месяцев назад

[SPARK-53544][PYTHON] Support complex types on observations

год назад

[SPARK-53602][PYTHON] Profile dump improvement and profiler doc fix

год назад

[SPARK-50685][PYTHON][FOLLOW-UP] Improve Py4J performance by leveraging getattr

2 года назад

[SPARK-53602][PYTHON] Profile dump improvement and profiler doc fix

год назад

sql_formatter.py

[SPARK-49025][CONNECT] Make Column implementation agnostic

2 года назад

[SPARK-53597][PYTHON][SQL][DOCS] Add `asTable()` and `TableArg` examples

9 месяцев назад

[SPARK-54323][PYTHON] Change the way to access logs to TVF instead of system view

9 месяцев назад

tvf_argument.py

[SPARK-51103][PYTHON][DOCS] Add DataFrame conversion to table argument to API documentation

2 года назад

[SPARK-56463][PYTHON] Disallow unpickling UDT

4 месяца назад

[SPARK-54298][PYTHON][DOCS] Fix doctest of UDFRegistration

9 месяцев назад

[SPARK-53012][PYHTON] Support Arrow Python UDTF in Spark Connect

год назад

Revert "[SPARK-48516][PYTHON][CONNECT] Turn on Arrow optimization for Python UDFs by default"

год назад

variant_utils.py

[SPARK-50790][PYTHON] Implement parse json in pyspark

2 года назад

[SPARK-49035][PYTHON] Eliminate TypeVar `ColumnOrName_`

2 года назад