v4.2.0
[SPARK-57595][PYTHON] Declarative Pipelines analysis context should not mask the original error when registration fails
[SPARK-56651][CONNECT][SDP] Add Python APIs for Auto CDC SCD Type 1
[SPARK-56956][SPARK-56651][CONNECT][SDP][FOLLOWUP] Address review comments for AutoCDC flow dataclasses and Python APIs
[SPARK-52853][SDP] Prevent imperative PySpark methods in declarative pipelines
[SPARK-57613][PYTHON] Stop the Spark session when a Declarative Pipelines run step fails
[SPARK-56572][SDP] Inject Spark session into Python files
[SPARK-52348][CONNECT] Add support for Spark Connect handlers for pipeline commands
[SPARK-52463][SDP] Add support for cluster_by in Python Pipelines APIs
[SPARK-56888][PYTHON][DOCS] Simplify `get_caller_source_code_location` docstring
[SPARK-55986][PYTHON] Upgrade black to 26.3.1
[SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 3