master
[SPARK-54269][PYTHON] Upgrade `cloudpickle` to 3.1.2 for Python 3.14
[SPARK-57723][CORE] Enable `spark.rdd.compress` by default like PySpark
[SPARK-58547][CONNECT] Expose operation IDs for end-to-end request attribution
[SPARK-57977][PYTHON] Remove obsolete encoding declarations from Python files
[SPARK-58241][PYTHON] Fix the columnar Arrow Python UDF runner writing the input schema in the legacy protocol position
[SPARK-57978][PYTHON] Use explicit UTF-8 encoding in text-mode I/O to prepare for PEP 686
[SPARK-58636][PYTHON] Remove unnecessary type: ignore[union-attr] in streaming MLlib trainers
[SPARK-58553][PS][FOLLOWUP] Preserve signed zero in NumPy fmax and fmin
[SPARK-57594][SDP] Add spark_confs support to create_auto_cdc_flow
[SPARK-58192][CORE] Support fractional spark.task.cpus
[SPARK-58021][CONNECT] Generalize local Connect server launching
[MINOR][PYTHON][TEST] Use assertEqual instead of assertTrue in PySpark tests
[SPARK-58037][PYTHON][TEST][FOLLOWUP] Keep DataFrame golden tests internal
[SPARK-58656][PYTHON][TEST] Centralize the to_pandas golden test inventory into a shared base
[SPARK-55610][PYTHON] Add getExecutorInfos to StatusTracker in Python
[SPARK-56271][PYTHON] Fix type hint and remove unused method for _globals.py
[SPARK-55364][PYTHON] Make SupportsIAdd and SupportsOrdering protocol more reasonable
[SPARK-57066][SECURITY] Use constant-time comparison for authentication secrets
[SPARK-55986][PYTHON] Upgrade black to 26.3.1
[SPARK-58348][PYTHON][DOC] Move PySpark error doc header into global variable
[SPARK-56270][PYTHON] Fix type hints and import issue for find_spark_home
[SPARK-57962][PYTHON] Guard against path traversal in install_spark tar extraction
[SPARK-51789][CORE][FOLLOW-UP] Set the initial Spark Connect mode properly
[SPARK-45450][PYTHON] Fix imports according to PEP8: pyspark.pandas and pyspark (core)
[SPARK-45390][PYTHON] Remove `distutils` usage
[SPARK-56430][PYTHON] Remove unnecessary .keys() in dict iterations
[SPARK-32714][PYTHON] Initial pyspark-stubs port
[SPARK-56313][PYTHON][FOLLOWUP] Use old way to label generic for a class
[SPARK-56324] Introducing message-based communication to Spark -> PySpark communication channel
[SPARK-56066][PYTHON] Lazy import numpy to improve import speed
[SPARK-58192][CORE][FOLLOWUP] Preserve exact task CPU amounts in PySpark
[SPARK-54925][PYTHON][FOLLOWUP] Ignore missing import for pystack
[SPARK-27052][SQL][PYTHON] Support Python UDFs inside higher-order function lambdas
[SPARK-56740][BUILD] Change version in development branch to 5.0.0