v4.0.2
[SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default
[SPARK-54485][SPARK-54494][PYTHON][TESTS][4.0] Re-enable tests in test_parity_udf_profiler and test_parity_memory_profiler
[SPARK-37022][PYTHON] Use black as a formatter for PySpark
[SPARK-47909][PYTHON][CONNECT] Parent DataFrame class for Spark Connect and Spark Classic
[SPARK-51701][PYTHON][TESTS] Move test objects to a separate file
[SPARK-50388][PYTHON][TESTS] Further centralize import checks
[SPARK-50867][PYTHON][TESTS] Move `search_jar` and `SPARK_HOME` to `sqlutils.py`
[SPARK-53424][PYTHON][TESTS] Hide traceback in `assertSchemaEqual/assertDataFrameEqual/assert_rows_equal`