v4.0.4
[SPARK-58033][PYTHON][DOC] Fix `py4j` version requirement in PySpark installation guide
[SPARK-50821][PYTHON] Upgrade Py4J from 0.10.9.8 to 0.10.9.9
[SPARK-57393] Build: PySpark and SparkR source distributions are missing LICENSE and NOTICE files
Preparing Spark release v4.0.4-rc1
[SPARK-46802][PYTHON][TESTS] Clean up obsolete code in PySpark coverage script
[SPARK-51876][PYTHON][TESTS] Add configuration for `log4j.configurationFile` in the PySpark submission args of `run_individual_python_test`
[SPARK-7721][PYTHON][TESTS] Adds PySpark coverage generation script
[SPARK-44442][MESOS] Remove Mesos support
[SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default
[SPARK-47993][PYTHON] Drop Python 3.8
[SPARK-46802][PYTHON][TESTS][FOLLOWUP] Remove obsolete comment in run-tests-with-coverage