HPE Ezmeral Data Fabric 6.1.x is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About MapR 6.1
This site contains the main documentation for Version 6.1 of the MapR Converged Data Platform, including installation, configuration, administration, and reference information.
6.1 Installation
This section contains information about installing and upgrading MapR software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a MapR cluster.
- Planning the Cluster
  Describes information and factors used in planning your cluster.
- Installing MapR and MapR Ecosystem Components
  Describes how to install MapR software and ecosystem components with or without the MapR Installer.
  - MapR Repositories and Packages
    Describes the repositories for MapR software and the ecosystem components.
  - Preparing Each Node
    Defines minimum requirements for each node in your cluster.
  - Installing with the MapR Installer
    The MapR Installer automates the process of installing MapR software and offers you a variety of options to complete the installation.
  - Installing without the MapR Installer
    Describes how to install MapR software and ecosystem components manually.
    - Step 1: Install the Package Key
      Before you install MapR packages, you must install the package key.
    - Step 2: Prepare Packages and Repositories
      To install services correctly, each node must have access to the package files.
    - Step 3: Install Cluster Service Packages
      The installation process varies based on the location of your packages and the configuration of your cluster.
    - Step 4: Verify Installation Success
      To confirm success, check each node.
    - Step 5: Set Environment Variables
      Before starting ZooKeeper or Warden, you must complete this step.
    - Step 6: Configure Nodes
      Connect nodes to the cluster, configure security, and arrange node storage.
    - Step 7: Bring up the Cluster
      Before you can install monitoring or ecosystem components, you must enable the cluster by starting ZooKeeper and Warden and verifying the cluster installation status.
    - Step 8: Install Metrics Monitoring
      To enable metering and the display of certain metrics by the Control System, you must install collectd and OpenTSDB components. Metrics monitoring is part of MapR monitoring, which also includes log monitoring. MapR Monitoring components are available as part of the Ezmeral Ecosystem Pack (EEP) that you selected for the cluster.
    - Step 9: Install Log Monitoring
      Installing the MapR monitoring logging components is optional. The logging components enable the collection, storage, and visualization of MapR core logs, system logs, and ecosystem component logs. MapR Monitoring components are available as part of the Ezmeral Ecosystem Pack (EEP) that you selected for the cluster.
    - Step 10: Install Ecosystem Components Manually
      You can install one or more ecosystem components from any Ezmeral Ecosystem Pack (EEP) that is supported by the MapR cluster version. An EEP consists of a group of ecosystem components that work together.
      - Installing AsyncHBase Libraries
        This topic includes instructions for using package managers to download and install AsyncHBase from the EEP repository.
      - Installing Drill
        This topic provides instructions for using package managers to download and install Drill.
      - Installing Flume
        This topic includes instructions for using package managers to download and install Flume from the EEP repository.
      - Installing HBase
        This topic includes instructions for using package managers to download and install HBase from the EEP repository.
      - Installing HBase Client and Tools
        MapR 6.0.x does not support HBase as an ecosystem component. Beginning with EEP 6.3.0, MapR 6.1 reintroduced HBase as an ecosystem component. With EEP 6.3.0 and later you can install the HBase Client and tools even if you decide not to install HBase as an ecosystem component. This topic describes the HBase Client and other tools that are available for use with the MapR Database.
      - Installing Hive
        This topic includes instructions for using package managers to download and install Hive from the EEP repository.
      - Installing HttpFS
        This topic includes instructions for using package managers to download and install HttpFS from the EEP repository.
      - Installing Hue
        This topic includes instructions for using package managers to download and install Hue from the EEP repository.
      - Installing Impala
        This section describes how to use package managers to download and install Impala from the MEP repository.
      - Installing Kafka Schema Registry (Developer Preview)
        This topic includes instructions for using package managers to download and install the Kafka Schema Registry from a MapR repository.
      - Installing KSQL
        This topic describes how to use package managers to download and install KSQL from the EEP repository.
      - Installing Kafka Streams
        Kafka Streams is a Java library and is part of the mapr-kafka package. Kafka Streams does not require special installation steps; however, you must install the mapr-core and mapr-kafka packages to use Kafka Streams.
      - Installing MapR Event Store For Apache Kafka Clients
        This topic includes instructions for using package managers to download and install MapR Event Store For Apache Kafka Clients from the EEP repository.
      - Installing MapR Event Store For Apache Kafka Tools
        This topic includes instructions for using package managers to download and install MapR Event Store For Apache Kafka Tools from the EEP repository.
      - Installing MapR Data Access Gateway
        This topic includes instructions for using package managers to download and install the MapR Data Access Gateway from the EEP repository.
      - Installing Livy
        This topic includes instructions for using package managers to download and install Livy from the EEP repository.
      - Installing S3 Gateway
        The S3 Gateway is an object storage server that can be used with the Amazon S3 cloud storage service.
      - Installing Myriad
        Describes Myriad requirements and installation.
      - Installing Oozie
        This topic includes instructions for using package managers to download and install Oozie from the EEP repository.
      - Installing Pig
        This topic includes instructions for using package managers to download and install Pig from the EEP repository.
      - Installing Sentry
        This topic includes instructions for using package managers to download and install Sentry from the EEP repository.
      - Installing Spark Standalone
        This topic describes how to use package managers to download and install Spark Standalone from the EEP repository.
      - Installing Spark on YARN
        This topic describes how to use package managers to download and install Spark on YARN from the EEP repository.
      - Installing Spark on Mesos
        This section includes instructions to download and install Apache Spark on Apache Mesos.
      - Installing Sqoop1
        This topic includes instructions for using package managers to download and install Sqoop1 from the EEP repository.
      - Installing Sqoop2
        This topic includes instructions for using package managers to download and install Sqoop2 from the EEP repository.
      - Installing Zeppelin
        This topic includes instructions for using package managers to download and install Zeppelin 0.9 and later from the EEP repository.
    - Step 11: Run configure.sh
      Run configure.sh with the -R option to complete the configuration of ecosystem components that were added manually.
  - Configuring the Cluster
    Describes post-installation configuration tasks for MapR clusters.
- Installing the File Migration Service on the Edge Cluster
  Describes how to install the File Migration service on CentOS nodes.
- Installing the MapR XD Distributed File and Object Store
  Describes how to install MapR XD software with or without the MapR Installer.
- Installing MapR Data Fabric for Kubernetes
  This section describes how to plan for and install the MapR Container Storage Interface (CSI) Storage Plugin and the MapR Data Fabric for Kubernetes FlexVolume Driver.
- Installing MapR in the Cloud
  Provides an overview of MapR cloud installer capabilities.
- Installing Metering
  This section describes how to install Metering by using the MapR Installer or manual steps.
- Upgrading MapR Core or EEP Components
  Depending on your current configuration, you may choose to upgrade the release version (core), ecosystem components, clients, or monitoring components.
- Setting Up Clients and Services
  Describes how to set up and use interfaces to an cluster from a client computer.
- Setting Up the Control System
  Describes how to configure and access the Control System.
- Migrating to MapR
  Provides instructions for migrating business-critical data and applications from an Apache Hadoop cluster to a MapR cluster.
- Applying a Patch
  You can apply a patch by using the MapR Installer, by using the command line (a manual process), or by using an Installer Stanza.
6.1 MapR Data Platform
MapR Data Platform is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.1 Administration
This section describes how to manage the nodes and services that make up a cluster.
6.1 Development
This section contains information related to application development for Ezmeral ecosystem components and MapR Data Platform products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: MapR Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other MapR version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Installing MapR Event Store For Apache Kafka Tools

This topic includes instructions for using package managers to download and install MapR Event Store For Apache Kafka Tools from the EEP repository.

NOTE For instructions on setting up the EEP repository, see Step 10: Install Ecosystem Components Manually

To install manually, first run the following commands as root or using sudo.

On RedHat/Centos:
```
yum install <package_name>
```
On Ubuntu:
```
apt-get install <package_name>
```
On SLES:
```
zypper install <package_name>
```

After you install the Kafka tools, configure the Kafka components by running configure.sh -R on each node where you installed the Kafka tools:

/opt/mapr/server/configure.sh -R

Table 1. MapR Event Store For Apache Kafka Tools
Package	Description
mapr-kafka	The core Kafka package. Required for MapR Event Store For Apache Kafka and other Kafka components for MapR Event Store For Apache Kafka.
mapr-ksql	The KSQL for MapR Event Store For Apache Kafka package.
mapr-schema-registry	The Schema Registry for MapR Event Store For Apache Kafka package.
mapr-kafka-rest	The Kafka REST Proxy for MapR Event Store For Apache Kafka package.
mapr-kafka-connect-jdbc	The JDBC connect package for Kafka Connect for MapR Event Store For Apache Kafka.
mapr-kafka-connect-hdfs	The HDFS connect package for Kafka Connect for MapR Event Store For Apache Kafka.

Kafka REST Proxy for MapR Event Store For Apache Kafka

The following packages are required for Kafka REST Proxy for MapR Event Store For Apache Kafka:

mapr-kafka
mapr-kafka-rest
mapr-client

NOTE Before manually installing, verify that the /opt/mapr/conf/daemon.conf file exists and contains the mapr user and group.

NOTE After installation, the Warden process automatically detects the configuration and starts the Kafka REST Proxy for MapR Event Store For Apache Kafka service on port 8082. This service is viewable on the Control System.

NOTE The Kafka REST Proxy for MapR Event Store For Apache Kafka service can be run on multiple cluster nodes simultaneously.

Kafka Connect for MapR Event Store For Apache Kafka

The following packages are required for Kafka Connect for MapR Event Store For Apache Kafka:

mapr-kafka
mapr-kafka-connect-jdbc
mapr-kafka-connect-hdfs

NOTE The Kafka Connect for MapR Event Store For Apache Kafka service can be run on multiple cluster nodes simultaneously.