master
[SPARK-46658][DOCS] Loosen Ruby dependency specification
[SPARK-57268][SQL] Add Apache Arrow as a native cache format for in-memory Dataset caching
[SPARK-54784][ML][DOCS] Document the security policy on ml models
[SPARK-55753][UI] Upgrade Bootstrap from 4.6.2 to 5.3.8
[SPARK-57897][BUILD][CORE] Create `connector/credential-aws` module with CI/release integration
[SPARK-55011][DOCS] CURSORs docs
[SPARK-57362][DOC] Prevent content from overlapping left navigation
[SPARK-55846][DOCS] Update Web UI documentation for UI modernization
[SPARK-54235][UI][DOCS] Upgrade jQuery from 3.5.1 to 3.7.1
[MINOR][DOC] Fix typo 'commited' in state data source docs
Revert "[SPARK-46437][DOCS] Remove cruft from the built-in SQL functions documentation"
[SPARK-39055][DOC] Fix documentation 404 page
[SPARK-53653][DOC] Update `rexml` gem version to 3.4.4
[SPARK-58371][DOC] Update `json` gem version to 2.21.1
[SPARK-58015][INFRA] Move dependency list from requirements.txt to pyproject.toml
[SPARK-58031][BUILD][DOC] Update `docs/_config.yml` version to 5.0.0-SNAPSHOT
[SPARK-50605][CONNECT] Support SQL API mode for easier migration to Spark Connect
[SPARK-58053][DOC] Update `building-spark.md` to require Hadoop 3.4.0 or later
[MINOR][DOCS] Miscellaneous link and anchor fixes
[SPARK-46188][DOC] Fix the CSS of Spark doc's generated tables
[MINOR][DOC] Fix grammar in spark.speculation.efficiency.processRateMultiplier doc
[SPARK-58192][CORE] Support fractional spark.task.cpus
[SPARK-56572][SDP] Inject Spark session into Python files
[MINOR][DOC] Fix typo in md files under docs directory
[SPARK-29574][K8S] Add SPARK_DIST_CLASSPATH to the executor class path
[SPARK-44442][MESOS] Remove Mesos support
[SPARK-57767][R] Drop R 3.x Support
[MINOR][DOCS] Fix several nit issues in documentation
[SPARK-49378][DOCS][SS] Break apart the Structured Streaming Programming Guide
[SPARK-30803][DOCS] Fix the home page link for Scala API document
[SPARK-26918][DOCS] All .md should have ASF license header
[MINOR][DOCS] Fix broken ML paper links
[SPARK-42642][DOCS][PYTHON] Updating remaining Spark documentation code examples to show Python by default
[SPARK-37178][ML] Add Target Encoding to ml.feature
[SPARK-58046][DOC] Fix the required NumPy version to 1.23.2 in MLlib guide
[SPARK-55605][BUILD][DOCS] Bump dev.ludovic.netlib 3.1.1 and update docs
[SPARK-51132][ML][BUILD] Upgrade `JPMML` to 1.7.1
[SPARK-44997][DOCS] Align example order (Python -> Scala/Java -> R) in all Spark Doc Content
[MINOR][DOCS] Fix various broken links and link anchors
[SPARK-50997][DOCS] Remove `\t` character in `docs`
[MINOR][DOCS] Miscellaneous documentation improvements
[SPARK-58468][CORE] Support on-demand loading for single event logs in SHS
[SPARK-34398][DOCS] Fix PySpark migration link
[DOCS] Clarify DataFrames in quickstart
[SPARK-58586][DOC] Use a supported Python version in the RDD guide PYSPARK_PYTHON example
[MINOR][DOC] Fix typos and add missing references to standalone and YARN deployment docs
[SPARK-38954][CORE] Support delegation token renewal and distribution without Kerberos
[SPARK-56846][DOCS][CONNECT] Document DataFrame column resolution behavior in spark-connect-gotchas
[SPARK-57787][CONNECT] Reuse a persistent local Spark Connect server for faster local startup
[SPARK-49347][R] Deprecate SparkR
[SPARK-57807][R][DOC] Document that SparkR does not support nanosecond-precision timestamp types
[SPARK-57459][SQL] Support nanosecond-precision timestamp types in the Avro datasource (v1 and v2)
[SPARK-57030][SPARK-57031][DOC] Document the TIME data type, functions, and ANSI behavior in the SQL reference
[SPARK-57354][SQL] Add ignoredPathSegmentRegex data source option and config
[SPARK-57263][SQL] Support Hive 4.2 metastore
[SPARK-54821][DOCS] Deprecate support for Derby JDBC datasource
[SPARK-57678][SQL] Add explodeEmbeddedArray JSON option for streaming scans of embedded arrays.
[MINOR][DOCS][TESTS] Update repo name and link from `parquet-mr` to `parquet-java`
[SPARK-47456][SQL] Support ORC Brotli codec
[SPARK-58401][DOC] Update Parquet links to 1.17.1 in Parquet data source docs
[SPARK-57573][CONNECT] Support the TIME data type in the Protobuf connector
[SPARK-49650][SQL][DOCS] Updates references to deprecated Hive JDBC client params in tests and docs
[SPARK-49174][BUILD][DOCS] Exclude the dir `docs/util` from `_site`
[SPARK-52688][SQL][DOCS] Fixing broken links to python reference in the getting started guide
[SPARK-58420][SQL] Normalize map values in distinct aggregates
[SPARK-58639][DOC] Replace stale listCachedTables reference in the SQL performance tuning guide
[SPARK-50772][SQL] Retain table aliases after SET, EXTEND, DROP operators
[MINOR][DOCS] Fix links in the sql-pyspark-pandas-with-arrow
[SPARK-58366][SQL] Support JSON_TABLE table-valued function
[SPARK-57808][SQL][DOC] Document the microsecond-only limitation of typed encoders and UDFs for nanosecond timestamps
[SPARK-56984][DOC] Document the SQL PATH feature
[SPARK-46908][SQL] Support star clause in WHERE clause
[SPARK-31636][SQL][DOCS] Remove HTML syntax in SQL reference
[SPARK-40243][DOCS] Enhance Hive UDF support documentation
[SPARK-56813][DOCS] Refine the documentation for geospatial types and functions
[SPARK-54343][DOCS] Docs for parameter markers, identifier improvements, string coalescing
[SPARK-58679][DOC] Fix typos and grammar in the SQL name resolution reference doc
[MINOR][DOCS] Clean markup in NULL semantics documentation
[MINOR][DOCS] Fix typos in docs/sql-ref-number-pattern.md
[SPARK-48426][SQL][DOCS] Add documentation for SQL operator precedence
[MINOR][DOCS] Fix a typo of "KLL" initialism
[SPARK-47271][DOCS] Explain importance of statistics on SQL performance tuning page
[SPARK-56221][SQL][PYTHON][FOLLOWUP] Rename TablePartition and remove SHOW CACHED TABLES / listCachedTables
[SPARK-31999][SQL] Add REFRESH FUNCTION command
[SPARK-54653][DOCS] Add cross-session note to cache/persist public APIs
[MINOR][DOCS] Fix typos
[SPARK-57109][SQL] SYSTEM.SESSION should not be part of SYSTEM_PATH
[MINOR] Spelling bin core docs external mllib repl
[SPARK-31383][SQL][DOC] Clean up the SQL documents in docs/sql-ref*
[SPARK-35105][SQL] Support multiple paths for ADD FILE/JAR/ARCHIVE commands
[SPARK-50787][DOCS] Fix typos and add missing semicolons in sql examples
[SPARK-34603][SQL] Support ADD ARCHIVE and LIST ARCHIVES command
[MINOR][DOCS] Fix miss semicolon on list file sql example
[SPARK-48976][SQL][DOCS] Improve the docs related to `variable`
[SPARK-49543][SQL] Add SHOW COLLATIONS command
[SPARK-37818][DOCS] Add option in the description document for show create table
[SPARK-37777][SQL] Update the SQL syntax of SHOW FUNCTIONS
[SPARK-54710][SQL] Show Partitions As Json
[SPARK-32887][DOC] Correct the typo for SHOW TABLE
[MINOR][DOCS] Update doc `sql/README.md`
[SPARK-48668][SQL] Support ALTER NAMESPACE ... UNSET PROPERTIES in v2
[SPARK-48031][SQL] Support view schema evolution
[SPARK-54831][SQL] Support COMMENT ON COLUMN for table columns
[MINOR][DOCS] Update `CTAS` with `LOCATION` behavior with Spark 3.2+
[MINOR][DOCS] Fix miss semicolon on create table example sql
[MINOR] Fix some typos
[SPARK-40574][DOCS] Enhance DROP TABLE documentation
[SPARK-48990][SQL] Unified variable related SQL syntax keywords
[SPARK-40943][SQL] Make `MSCK` keyword optional in `REPAIR TABLE` syntax
[SPARK-34401][SQL][DOCS] Update docs about altering cached tables/views
[SPARK-32171][SQL][DOCS] Change file locations for use db and refresh table
[SPARK-36980][SQL] Insert support query with CTE
[SPARK-57316][DOC] Document WITH SCHEMA EVOLUTION and BY NAME for SQL INSERT
[SPARK-57643][DOCS] Document MERGE INTO schema evolution
[SPARK-35159][SQL][DOCS] Extract hive format doc
[SPARK-58176][DOC] Add SQL reference documentation for ASOF JOIN
[SPARK-43483][SQL][DOCS] Adds SQL references for OFFSET clause
[SPARK-46141][SQL] Change default for spark.sql.legacy.ctePrecedencePolicy to CORRECTED
[SPARK-33264][SQL][DOCS] Add a dedicated page for SQL-on-file in SQL documents
[SPARK-57993][SQL] Support advisory partition size in rebalance hint
[SPARK-35208][SQL][DOCS] Add docs for LATERAL subqueries
[SPARK-33977][SQL][DOCS] Add doc for "'like any' and 'like all' operators"
[SPARK-55356][SQL] Support alias for PIVOT clause
[SPARK-31561][SQL] Add QUALIFY Clause
[SPARK-31866][SQL][DOCS] Add COALESCE/REPARTITION/REPARTITION_BY_RANGE Hints to SQL Reference
[SPARK-28734][DOC] Initial table of content in the left hand side bar for SQL doc
[SPARK-51765][DOCS] Document `SQL Scripting` Syntax
[SPARK-58419][SQL] Support ANSI SQL UNNEST in the FROM clause
[MINOR][DOCS] Fix minor typos at nulls_option in Window Functions
[SPARK-55870][SQL] Add docs for Geo types
[SPARK-57622][DOC] Add navigation subsections to the Data Source V2 documentation page
[SPARK-58620][DOC][EXAMPLE] Fix incorrect comments and stale usage docs in the custom receiver examples
[SPARK-45720][BUILD][DSTREAM][KINESIS] Upgrade KCL to 2.7.2 and remove AWS SDK for Java 1.x dependency
[SPARK-52350][SS] Fix link for SS programming guide in 4.0
[MINOR][DOCS] Fix broken link for Python Package Management