v4.0.2
[MINOR] Fix some typos
[SPARK-37022][PYTHON] Use black as a formatter for PySpark
[SPARK-47683][PYTHON][BUILD] Decouple PySpark core API to pyspark.core package
[SPARK-38881][DSTREAMS][KINESIS][PYSPARK] Added Support for CloudWatch MetricsLevel Config
[SPARK-37632][PYTHON] Drop code that targets Python < 3.7
[SPARK-37836][PYTHON][INFRA] Enable F841, E722, E305 and E226 for PEP 8 compliance