master
[SPARK-57897][BUILD][CORE] Create `connector/credential-aws` module with CI/release integration
[SPARK-58665][BUILD] Upgrade `lz4-java` to 1.11.2
[SPARK-58388][INFRA] Clean up the dependency list for lint/docs/gen-protos docker image
[SPARK-27052][SQL][PYTHON] Support Python UDFs inside higher-order function lambdas
[SPARK-58037][PYTHON][TEST] Add DataFrame API golden file test framework for PySpark
[SPARK-51194][BUILD] Upgrade `scalafmt` to 3.8.6
Merge pull request #565 from pwendell/dev-scripts. Closes #565.
[SPARK-46764][DOCS] Reorganize script to build API docs
[SPARK-56180][INFRA] `build/mvn` prefer to download tgz from Google mirror of Maven Central
[SPARK-50543][BUILD] Fix log printing in `dev/check-protos.py`
[SPARK-53307][CONNECT][CLIENT][PYTHON][SCALA] Remove RetriesExceeded error from Spark Connect Python and Scala clients
[SPARK-53327][SQL] Workaround datasketches-memory Java 25 support
[SPARK-56161][K8S] Ban `org.apache.hadoop.util.StringUtils.stringifyException`
[SPARK-50139][INFRA][SS][PYTHON] Introduce scripts to re-generate and checking StateMessage_pb2.py and StateMessage_pb2.pyi
[SPARK-44832][CONNECT] Make transitive dependencies work properly for Scala Client
[SPARK-56415][INFRA][FOLLOWUP] Fix `ruff format` violations in `dev/` JIRA scripts
[SPARK-57862][INFRA] Allow create_spark_jira.py to set the issue description
[SPARK-55927][WEBUI][FOLLOWUP] Remove `"jquery.mustache.js"` from `ignorePatterns` in `eslint.js`
[SPARK-54520][INFRA] Ignore Missing Packages in CI free_disk_space Step
[SPARK-53836][INFRA] Update script `free_disk_space_container`
[SPARK-56018][PYTHON] Use ruff as formatter
[SPARK-56606][SQL] Bump embedded SRS registry to PROJ 9.8.1
[SPARK-56556][INFRA] Reject `.jar` and `.class` files in CI
[SPARK-48256][BUILD] Add a rule to check file headers for the java side, and fix inconsistent files
[SPARK-51632][INFRA] Passing Command Line Arguments of lint-js to eslint
[SPARK-58127][INFRA] Remove flake8 from the Python lint tooling
[SPARK-29932][R][TESTS] lint-r should do non-zero exit in case of errors
[MINOR][R] small tidying of sh scripts for R
[SPARK-58618][BUILD] Fix duplicated path in lint-scala scalafmt failure message
[SPARK-57393][BUILD][FOLLOWUP] Clean out old PySpark sdists
[SPARK-58638][INFRA] Recognize Examples as a primary component tag in the merge script
[SPARK-57444][INFRA] Document versioning and branch policy in AGENTS.md and add dev/next_version_candidates.py
[SPARK-58256][INFRA][TEST] Fix npm vulnerabilities in ui-test and dev
[SPARK-57502][INFRA][TEST] Fix npm vulnerabilities in ui-test and dev
[SPARK-37837][INFRA] Enable black formatter in dev Python scripts
[SPARK-58561][INFRA] Support backporting a PR merged into a non-default branch
[SPARK-49428][SQL] Move Connect Scala Client from Connector to SQL
[SPARK-49720][PYTHON][INFRA] Add a script to clean up PySpark temp files
[SPARK-55206][PYTHON][SQL] Transpilation minimal functional implementation with python
[SPARK-55367][PYTHON] Use venv for run-pip-tests
[SPARK-54277][INFRA] Make `dev/run-tests` to ban `Python 3.9` and older versions
[MINOR][BUILD] Remove undefined -Pscala-2.13 profile from dev scripts
[MINOR][INFRA] Fix doubled braces in structured logging style-check hint
[MINOR][BUILD] Mark spark-deps manifest as auto-generated