v4.0.2
[SPARK-52026][PS][4.0] Block pandas API on Spark on ANSI mode by default
[SPARK-50821][PYTHON] Upgrade Py4J from 0.10.9.8 to 0.10.9.9
[SPARK-54015][PYTHON] Relax Py4J requirement to py4j>=0.10.9.7,<0.10.9.10
Preparing Spark release v4.0.2-rc1
[SPARK-46802][PYTHON][TESTS] Clean up obsolete code in PySpark coverage script
[SPARK-51876][PYTHON][TESTS] Add configuration for `log4j.configurationFile` in the PySpark submission args of `run_individual_python_test`
[SPARK-7721][PYTHON][TESTS] Adds PySpark coverage generation script
[SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default
[SPARK-48107][PYTHON] Exclude tests from Python distribution
[SPARK-44442][MESOS] Remove Mesos support
[SPARK-47993][PYTHON] Drop Python 3.8
[SPARK-46802][PYTHON][TESTS][FOLLOWUP] Remove obsolete comment in run-tests-with-coverage