MR3 is a new execution engine for Hadoop and Kubernetes. Similar in spirit to MapReduce and Tez, it is a new execution engine with simpler design, better performance, and more features. MR3 serves as a framework for running jobs on Hadoop and Kubernetes. MR3 also supports standalone mode which does not require a resource manager such as Hadoop or Kubernetes.
The main application of MR3 is Hive on MR3. With MR3 as the execution engine, the user can run Apache Hive not only on Hadoop but also directly on Kubernetes. By exploiting standalone mode supported by MR3, the user can run Apache Hive virtually in any type of cluster regardless of the availability of Hadoop or Kubernetes and the version of Java installed in the system.
MR3 is implemented in Scala.
For the full documentation on MR3, please visit:
https://mr3docs.datamonad.com/
This is the git repository for the MR3 release.
For instructions, visit:
https://mr3docs.datamonad.com/docs/quick/install/
Please see LICENSE-MR3.txt for the license of the binary files.
Scripts for running Hive on MR3 in local mode
/hadoop - Executable scripts (with --local option)
For instructions, visit:
https://mr3docs.datamonad.com/docs/quick/local/
Scripts for running Hive on MR3 on Hadoop
/hadoop - Executable scripts (with --tpcds option)
For instructions, visit:
https://mr3docs.datamonad.com/docs/quick/hadoop/
Scripts for running Hive on MR3 in standalone mode
/standalone - Executable scripts
For instructions, visit:
https://mr3docs.datamonad.com/docs/quick/standalone/
Shell scripts for running Hive on MR3 on Kubernetes
/kubernetes - Executable scripts with YAML files
For instructions, visit:
https://mr3docs.datamonad.com/docs/quick/k8s/
Helm charts for running Hive on MR3 on Kubernetes
/helm - Helm charts
For instructions, visit:
https://mr3docs.datamonad.com/docs/quick/k8s/
Additional steps for running Hive on MR3 on Amazon EKS
/eks
For instructions, visit: