HPE Ezmeral Data Fabric 6.2 is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About Release 6.2
This site contains documentation for HPE Ezmeral Data Fabric release 6.2 including installation, configuration, administration, and reference content, as well as content for the associated bundled ecosystem components and drivers.
6.2 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
- Planning the Cluster
  Describes information and factors used in planning your cluster.
- Installing Core and Ecosystem Components
  Describes how to install HPE Ezmeral Data Fabric software and ecosystem components with or without the Installer.
- Installing the File Migration Service on the Edge Cluster
  Describes how to install the File Migration service on CentOS nodes.
- Installing the HPE Ezmeral Data Fabric File Store
  Describes how to install File Store software with or without the Installer.
- Installing Kubernetes Interfaces for Data Fabric
  This section describes how to plan for and install the Container Storage Interface (CSI) Storage Plugin and the Kubernetes Interfaces for Data Fabric FlexVolume Driver.
- Upgrading Core or EEP Components
  Depending on your current configuration, you may choose to upgrade the release version (core), ecosystem components, clients, or monitoring components.
  - Upgrade Workflows (Release 6.1.x to 6.2)
    This section describes three common methods for upgrading from one core release to another. The workflows in this section introduce you to the high-level steps for each method and provide links to pages showing more detail.
  - Upgrading Core
    Describes the process of upgrading core.
  - Upgrading Ezmeral Ecosystem Packs
    Describes how to upgrade Ezmeral Ecosystem Packs (EEPs), either as part of a core upgrade or to take advantage of a new EEP for the current version of core.
    - Planning Ezmeral Ecosystem Pack (EEP) Upgrades
      The set of ecosystem components that you run in the cluster must all belong to the same EEP.
    - Preparing to Upgrade the Ezmeral Ecosystem Pack
      Complete these pre-upgrade steps for each ecosystem component in the EEP that you want to upgrade.
      - Pre-Upgrade Steps for Drill
        Complete the following steps before you upgrade Drill with or without the Installer.
      - Pre-Upgrade Steps for Flume
        Complete the following steps before you upgrade Flume with or without the Installer.
      - Pre-Upgrade Steps for Hadoop and YARN
        Complete the following steps before you upgrade Hadoop and YARN with or without the Installer.
      - Pre-Upgrade Steps for HBase
        Complete the following steps before you upgrade HBase with or without the Installer.
      - Pre-Upgrade Steps for HBase Client
        Complete the following steps before you upgrade HBase Client with or without the Installer.
      - Pre-Upgrade Steps for Hive
        Complete the following steps before you upgrade Hive with or without the Installer.
      - Pre-Upgrade Steps for HttpFS
        Complete the following steps before you upgrade HttpFS with or without the Installer.
      - Pre-Upgrade Steps for Hue
        Complete the following steps before you upgrade Hue with or without the Installer.
      - Pre-Upgrade Steps for Impala
        Complete the following steps before you upgrade Impala with or without the Installer.
      - Pre-Upgrade Steps for Data Access Gateway
        Complete the following steps before you upgrade the Data Access Gateway with or without the Installer.
      - Pre-Upgrade Steps for Livy
      - Pre-Upgrade Steps for Monitoring
        Complete the following steps before you upgrade Monitoring Components with or without the Installer.
      - Pre-Upgrade Steps for HPE Ezmeral Data Fabric Streams Tools
        Complete the following steps before you manually upgrade HPE Ezmeral Data Fabric Streams Tools.
      - Pre-Upgrade Steps for S3 Gateway
        Complete the following steps before you upgrade S3 Gateway.
      - Pre-Upgrade Steps for Oozie
        Complete the following steps before you upgrade Oozie with or without the Installer.
      - Pre-Upgrade Steps for Pig
        Complete the following steps before you upgrade Pig with or without the Installer.
      - Pre-Upgrade Steps for Sentry
        Complete the following steps before you upgrade Sentry with or without the Installer.
      - Pre-Upgrade Steps for Spark
        Complete the following steps before you upgrade Spark with or without the Installer.
      - Pre-Upgrade Steps for Sqoop1
        Review the following information before you upgrade Sqoop1 with or without the Installer.
      - Pre-Upgrade Steps for Tez
        Complete the following steps before you upgrade Tez with or without the Installer.
    - Upgrading the Ezmeral Ecosystem Pack With the Installer
      If the cluster that you want to upgrade was installed using the Installer, you can use the Installer to upgrade the Ezmeral Ecosystem Pack (EEP).
    - Upgrading the Ezmeral Ecosystem Pack Without the Installer
      After you upgrade core without using the Installer, you need to upgrade ecosystem components with manual steps. First, verify that your repository is configured to use an Ezmeral Ecosystem Pack (EEP) that is supported by your cluster version. Then, upgrade each component manually.
    - Finishing the Ezmeral Ecosystem Pack Upgrade
      Complete the post-upgrade steps for each ecosystem component that was upgraded.
  - Preparing the Cluster for a Maintenance Update
    This section identifies how to prepare for applying either a minor update or a patch.
  - Performing a Maintenance Update
    Perform a maintenance update when you want to upgrade to a new patch version of core or apply a patch.
- Setting Up Clients and Services
  Describes how to set up and use interfaces to an HPE Ezmeral Data Fabric cluster from a client computer.
- Setting Up the Control System
  Describes how to configure and access the Control System.
- Migrating to the HPE Ezmeral Data Fabric
  Provides instructions for migrating business-critical data and applications from an Apache Hadoop cluster to an HPE Ezmeral Data Fabric cluster.
- Applying a Patch
  You can apply a patch by using the Installer, by using the command line (a manual process), or by using an Installer Stanza.
6.2 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.2 Administration
This section describes how to manage the nodes and services that make up a cluster.
6.2 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Pre-Upgrade Steps for Hadoop and YARN

Complete the following steps before you upgrade Hadoop and YARN with or without the Installer.

About this task

Before release 6.2.0 and EEP 7.0.0, Hadoop and YARN services were part of the Data Fabric repository for core packages. Upgrading Hadoop was not possible because releases 5.2.x, 6.0.x, and 6.1.x all used the same Hadoop version (version 2.7.0). Beginning with release 6.2.0 and EEP 7.0.0, Hadoop and YARN services were removed from Data Fabric core and delivered as ecosystem components in the EEP(MEP) repository. For more information, see Installing Hadoop and YARN.

Delivering Hadoop and YARN services in an EEP makes it possible to upgrade the packages independently of the HPE Ezmeral Data Fabric. Hadoop Protocol Versions shows the currently supported Hadoop versions. The following table describes the supported Hadoop upgrades:

If your current Hadoop version is . . . .	To upgrade, you must
2.7.4.0 or later	Upgrade to an EEP that provides a newer Hadoop version. IMPORTANT Rolling upgrades from Hadoop 2.x to Hadoop 3.x are not supported. Only offline upgrades to Hadoop 3.x are supported.
2.7.0	Upgrade to core 6.2.x and install Hadoop components from a EEP that is supported on core 6.2.x. See Upgrade Workflows (Release 6.1.x to 6.2).

To prepare to upgrade Hadoop 2.7.4.0 or later:

Stop the following services if they are installed:

maprcli node services -name resourcemanager -action stop -nodes <IP-address>
maprcli node services -name nodemanager -action stop -nodes <IP-address>
maprcli node services -name historyserver -action stop -nodes <IP-address>
maprcli node services -name timelineserver -action stop -nodes <IP-address>

You do not need to back up configuration files manually. Hadoop configuration files are automatically backed up to this directory: /opt/mapr/hadoop/hadoop-<timestampversion>