HPE Ezmeral Data Fabric 6.2 is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About Release 6.2
This site contains documentation for HPE Ezmeral Data Fabric release 6.2 including installation, configuration, administration, and reference content, as well as content for the associated bundled ecosystem components and drivers.
6.2 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
6.2 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.2 Administration
This section describes how to manage the nodes and services that make up a cluster.
- Administering Users and Clusters
  Lists topics that help manage a data-fabric cluster.
- Administering Nodes
  Provides a synopsis of managing nodes in a cluster.
- Administering Volumes
  This section provide information about how to organize and manage data using volumes, a unique feature of HPE Ezmeral Data Fabric clusters.
- Administering Files and Directories
- Administering Tables
  Administration of the HPE Ezmeral Data Fabric Database is done primarily via the command line (maprcli) or with the Managed Control System (MCS). Regardless of whether the HPE Ezmeral Data Fabric Database table is used for binary files or JSON documents, the same types of commands are used with slightly different parameter options. HPE Ezmeral Data Fabric Database administration is associated with tables, columns and column families, and table regions.
- Administering Streams
  - Managing Streams
    This topic provides information about managing streams in HPE Ezmeral Data Fabric Streams.
  - Managing Topics
    Topics are logical collections of messages. The following sections describe how to create and manage topics.
  - Managing Stream Replication
    This section contains topics about setting up stream replication and administering existing replicas.
    - Preparing Clusters for Stream Replication
      Configuring clusters for participation in the replication of HPE Ezmeral Data Fabric Streams streams involves configuring two or more gateways on destination clusters and, if the clusters are secure, setting up secure communications between the clusters.
    - Adding Stream Replicas
      You can create stream replicas using the Control System and the CLI. When you add a replica using the Control System, you can also set up and start replication between a source and replica stream.
    - Setting Up Stream Replication Using the CLI
      Describes how to run the maprcli stream replica autosetup command to set up primary-secondary or multi-master replication from an existing source stream.
    - Viewing the List of Stream Replicas
      Explains how to view the list of replicas for a stream using the Control System and the CLI.
    - Editing a Stream Replica
      Explains how to edit a stream replica using the Control System and the CLI to modify the way in which messages are replicated from the source stream to the replica.
    - Removing Stream Replicas
      Explains how to unregister one or more replicas using the Control System and the CLI.
    - Pausing Stream Replication
      Explains how to pause replication from a source stream to a replica stream using the Control System and the CLI.
    - Resuming Stream Replication
      Explains how to resume replication from one stream to another stream using either the Control System or the CLI.
    - Managing Upstream Sources for Stream Replicas
  - Preparing Clusters for Log Compaction
    Describes how to prepare your environment so you can use log compaction.
  - Mirroring Topics with Apache Kafka MirrorMaker
    Use the Apache Kafka MirrorMaker utility either to mirror topics that are in Apache Kafka clusters to streams that are in HPE Ezmeral Data Fabric clusters or to Mirror topics that are in HPE Ezmeral Data Fabric clusters to Apache Kafka clusters.
  - Mirroring Topics with HPE Ezmeral Data Fabric MirrorMaker 2
    MirrorMaker 2.0 is a multi-cluster, cross-data-center replication engine based on the Kafka Connect framework. MirrorMaker 2 is available starting in EEP 8.0.0.
- Administering Data Fabric Gateways
  A HPE Ezmeral Data Fabric gateway mediates one-way communication between a source HPE Ezmeral Data Fabric cluster and a destination cluster. You can replicate HPE Ezmeral Data Fabric Database tables (binary and JSON) and HPE Ezmeral Data Fabric Streams streams. HPE Ezmeral Data Fabric gateways also apply updates from JSON tables to their secondary indexes and propagate Change Data Capture (CDC) logs.
- Administering Services
- Monitoring the Cluster
  This section describes how to monitor the health and performance of a MapR cluster.
- Configuring Security
  Describes how to configure security and manage secure clusters.
- Managing Secure Clusters
  Provides procedures that will enable you to use MapR clusters securely.
- Administering the Data Access Gateway
  The HPE Ezmeral Data Fabric Data Access Gateway is a service that acts as a proxy and gateway for translating requests between lightweight client applications and the HPE Ezmeral Data Fabric cluster. This section describes considerations when upgrading the service, how to modify configuration settings, and how to administer and manage the service.
- Planning for High Availability
- Administrator's Reference
  This section contains in-depth reference information for the administrator.
- Troubleshooting Cluster Administration
  Lists the common errors and their solutions.
- Best Practices for Backing Up HPE Ezmeral Data Fabric Information
  Lists the best practices and performance considerations to follow when backing up HPE Ezmeral Data Fabric information.
6.2 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Preparing Clusters for Stream Replication

Configuring clusters for participation in the replication of HPE Ezmeral Data Fabric Streams streams involves configuring two or more gateways on destination clusters and, if the clusters are secure, setting up secure communications between the clusters.

Prerequisites

Plan which replication topology you want to use: basic primary-secondary, multi-master, or a combination of these. For more information about replication topologies, see Stream Replication.
Ensure that you have administrative authority on the clusters that you plan to use.
Replicating streams requires the installation of gateways. For more information about installation requirements, see Service Layout Guidelines for Replication

Procedure

To configure clusters for replication between streams:

In the mapr-clusters.conf file on every node in your source cluster, add an entry that lists the CLDB nodes that are in the destination cluster.
NOTE
This step is required so that the source cluster can communicate directly with the destination cluster's CLDB nodes. See mapr-clusters.conf for the format to use for the entries.
Configure gateways on the destination clusters.
See Configuring Gateways for Table and Stream Replication.
For secure clusters: Optionally, configure source clusters so that you can locally run maprcli commands that are executed on the destination cluster.
See Configuring Secure Clusters for Running Commands Remotely.
For secure clusters: Add one cross-cluster ticket to each source cluster for each cluster that it replicates to.
See Configuring Secure Clusters for Cross-Cluster Mirroring and Replication.
Ensure that the user ID of the person who starts the replication process has the readAce permission on the volume where the source streams are located and the writeAce permission on the volumes where the replica streams are located. For information about how to set permissions on volumes, see Setting Whole Volume ACEs.