Disaggregated HDP Spark and Hive with MinIO

1. Cloud-native Architecture

2. Prerequisites

3. Configure Hadoop, Spark, Hive to use MinIO

3.1 Configure Hadoop

3.2 Configure Spark2

3.3 Configure Hive

4. Run Sample Applications

4.1 Spark Pi

4.2 WordCount

4.2.1 Upload the input file to HDFS:

4.2.2 Run the Spark shell: