v4.2.0-preview5
[SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 3
[SPARK-53845] SDP Sinks
[SPARK-54020] Support `spark.sql(...)` Python API inside query functions for Spark Declarative Pipeline
[SPARK-52853][SDP] Prevent imperative PySpark methods in declarative pipelines
[SPARK-56430][PYTHON] Remove unnecessary .keys() in dict iterations
[SPARK-52851][SDP] Remove public APIs for append once flows
[SPARK-53850][SDP] Define proto for Sinks and Rename DefineDataset to DefineOutput
[SPARK-54440][SDP] Give default pipeline spec file more idiomatic name, `spark-pipeline.yml`
[SPARK-52348][CONNECT] Add support for Spark Connect handlers for pipeline commands
[SPARK-52463][SDP] Add support for cluster_by in Python Pipelines APIs
[SPARK-52640][SDP] Propagate Python Source Code Location
[SPARK-54562] Block eager analysis / execution inside flow function from the server side
[SPARK-55986][PYTHON] Upgrade black to 26.3.1