master
[SPARK-55986][PYTHON] Upgrade black to 26.3.1
[SPARK-58358][SQL] Add tag validation to removeTag
[SPARK-51975][SQL] Add variant_from_arrays and variant_from_entries
[SPARK-58247][CONNECT][SDP] Support SCD Type 2 in the Auto CDC Python and Spark Connect APIs
[SPARK-46812][CONNECT][PYTHON] Make mapInPandas / mapInArrow support ResourceProfile
[SPARK-58135][PYTHON] Consolidate VALUE_NOT_TRUE into VALUE_NOT_ALLOWED
[SPARK-55667][PYTHON][CONNECT] Move check_dependencies to __init__
[SPARK-56221][SQL][PYTHON][FOLLOWUP] Rename TablePartition and remove SHOW CACHED TABLES / listCachedTables
[SPARK-55206][PYTHON][SQL] Transpilation minimal functional implementation with python
[SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 3
[SPARK-57021][CONNECT][PYTHON] Add SQLContext wrapper for Spark Connect
[SPARK-58244][PYTHON] Remove type: ignore[name-defined] for DataFrame.plot and streaming _test() in pyspark.sql
[MINOR][PYTHON][DOC] Fix single-colon ``.. versionadded:`` typos in docstrings
[SPARK-56329][PYTHON] Fix all E721 type comparison violations
[SPARK-58021][CONNECT] Generalize local Connect server launching
[SPARK-50427][CONNECT][PYTHON] Expose configure_logging as a public API
[SPARK-56018][PYTHON] Use ruff as formatter
[SPARK-57247][SQL][CONNECT] Support DataFrame.zip in Spark Connect
[SPARK-56387][PYTHON][FOLLOWUP] Keep the original profiler result and create v2 for new format
[SPARK-56854][PYTHON] Filter None values in DataFrame[Stream]Reader/Writer .option(s)
[SPARK-58159][PYTHON] Support `with` statement for connect session
[SPARK-54628][PYTHON] Remove all unnecessary explicit super() arguments
[SPARK-50393][PYTHON][CONNECT] Introduce common TableArg for Spark Classic and Spark Connect
[SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 2
[SPARK-55667][PYTHON][CONNECT][FOLLOWUP] Detect REPL for doctest check
[SPARK-56607][PYTHON] Remove unnecessary __new__ and __init__