HPE Ezmeral Data Fabric 6.1.x is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About MapR 6.1
This site contains the main documentation for Version 6.1 of the MapR Converged Data Platform, including installation, configuration, administration, and reference information.
6.1 Installation
This section contains information about installing and upgrading MapR software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a MapR cluster.
6.1 MapR Data Platform
MapR Data Platform is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.1 Administration
This section describes how to manage the nodes and services that make up a cluster.
- Administering Users and Clusters
  Lists topics that help manage a MapR cluster.
- Administering Nodes
  Provides a synopsis of managing nodes in a cluster.
- Administering Volumes
  This section provide information about how to organize and manage data using volumes, a unique feature of MapR clusters.
- Administering Files and Directories
- Administering Tables
  Administration of the MapR Database is done primarily via the command line (maprcli) or with the Managed Control System (MCS). Regardless of whether the MapR Database table is used for binary files or JSON documents, the same types of commands are used with slightly different parameter options. MapR Database administration is associated with tables, columns and column families, and table regions.
- Administering Streams
  - Managing Streams
    This topic provides information about managing streams in MapR Event Store For Apache Kafka.
  - Managing Topics
    Topics are logical collections of messages. The following sections describe how to create and manage topics.
  - Managing Stream Replication
    This section contains topics about setting up stream replication and administering existing replicas.
    - Preparing Clusters for Stream Replication
      Configuring clusters for participation in the replication of MapR Event Store For Apache Kafka streams involves configuring two or more gateways on destination clusters and, if the clusters are secure, setting up secure communications between the clusters.
    - Adding Stream Replicas
      You can create stream replicas using the Control System and the CLI. When you add a replica using the Control System, you can also set up and start replication between a source and replica stream.
    - Setting Up Stream Replication Using the CLI
      Describes how to run the maprcli stream replica autosetup command to set up primary-secondary or multi-master replication from an existing source stream.
    - Viewing the List of Stream Replicas
      Explains how to view the list of replicas for a stream using the Control System and the CLI.
    - Editing a Stream Replica
      Explains how to edit a stream replica using the Control System and the CLI to modify the way in which messages are replicated from the source stream to the replica.
    - Removing Stream Replicas
      Explains how to unregister one or more replicas using the Control System and the CLI.
    - Pausing Stream Replication
      Explains how to pause replication from a source stream to a replica stream using the Control System and the CLI.
    - Resuming Stream Replication
      Explains how to resume replication from one stream to another stream using either the Control System or the CLI.
    - Managing Upstream Sources for Stream Replicas
      - Set up Stream as Upstream Source
        Describes how to set up the current stream as the upstream source for a replica if the replica was not set up to automatically resync with the current stream.
      - Adding Upstream Source for a Stream
        Explains how to add an upstream source for a stream using either the Control Panel or the CLI.
      - Listing all Upstream Sources for a Stream
        Describes how to list all the upstream sources for a stream using the Control System and the CLI.
      - Removing Upstream Sources for a Stream
        Explains how to un-register a stream as an upstream source for a stream using either the Control System or the CLI.
  - Preparing Clusters for Log Compaction
    Describes how to prepare your environment so you can use log compaction.
  - Mirroring Topics with Apache Kafka MirrorMaker
    Use the Apache Kafka MirrorMaker utility either to mirror topics that are in Apache Kafka clusters to streams that are in MapR Data Platform clusters or to Mirror topics that are in MapR Data Platform clusters to Apache Kafka clusters.
- Administering MapR Gateways
  A MapR gateway mediates one-way communication between a source MapR cluster and a destination cluster. You can replicate MapR Database tables (binary and JSON) and MapR Event Store For Apache Kafka streams. MapR gateways also apply updates from JSON tables to their secondary indexes and propagate Change Data Capture (CDC) logs.
- Administering Services
- Monitoring the Cluster
  This section describes how to monitor the health and performance of a MapR cluster.
- Configuring Security
  Describes how to configure security and manage secure clusters.
- Managing Secure Clusters
  Provides procedures that will enable you to use MapR clusters securely.
- Administering the MapR Data Access Gateway
  The MapR Data Access Gateway is a service that acts as a proxy and gateway for translating requests between lightweight client applications and the MapR cluster. This section describes considerations when upgrading the service, how to modify configuration settings, and how to administer and manage the service.
- Planning for High Availability
- Administrator's Reference
  This section contains in-depth reference information for the administrator.
- Troubleshooting Cluster Administration
  Lists the common errors and their solutions.
- Best Practices for Backing Up MapR Information
  Lists the best practices and performance considerations to follow when backing up MapR information.
6.1 Development
This section contains information related to application development for Ezmeral ecosystem components and MapR Data Platform products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: MapR Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other MapR version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Adding Upstream Source for a Stream

Explains how to add an upstream source for a stream using either the Control Panel or the CLI.

About this task

You can register a stream as an upstream source for a stream using the Control System and the CLI. When you register a stream as an upstream source, the registered upstream source stream will send updates to the stream.

Adding Upstream Source for a Stream Using the Control System

About this task

To register a stream as an upstream source:

Procedure

Log in to the Control System and go the stream information page.
Click Add Upstream Source in the Upstream Sources pane.
The Add Upstream Sources window displays.
Specify the path and name of the source stream in the Upstream Source field.
Click Add Upstream Source to register the source stream as an upstream source for this stream.

Adding Upstream Source for a Stream Using the CLI or REST API

About this task

The command to add an upstream source is:

maprcli stream upstream add -path <stream path> -upstream <upstream stream path>

For complete reference information, see stream upstream add.