HPE Ezmeral Data Fabric 6.1.x is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About MapR 6.1
This site contains the main documentation for Version 6.1 of the MapR Converged Data Platform, including installation, configuration, administration, and reference information.
6.1 Installation
This section contains information about installing and upgrading MapR software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a MapR cluster.
6.1 MapR Data Platform
MapR Data Platform is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.1 Administration
This section describes how to manage the nodes and services that make up a cluster.
- Administering Users and Clusters
  Lists topics that help manage a MapR cluster.
- Administering Nodes
  Provides a synopsis of managing nodes in a cluster.
- Administering Volumes
  This section provide information about how to organize and manage data using volumes, a unique feature of MapR clusters.
- Administering Files and Directories
- Administering Tables
  Administration of the MapR Database is done primarily via the command line (maprcli) or with the Managed Control System (MCS). Regardless of whether the MapR Database table is used for binary files or JSON documents, the same types of commands are used with slightly different parameter options. MapR Database administration is associated with tables, columns and column families, and table regions.
- Administering Streams
- Administering MapR Gateways
  A MapR gateway mediates one-way communication between a source MapR cluster and a destination cluster. You can replicate MapR Database tables (binary and JSON) and MapR Event Store For Apache Kafka streams. MapR gateways also apply updates from JSON tables to their secondary indexes and propagate Change Data Capture (CDC) logs.
- Administering Services
- Monitoring the Cluster
  This section describes how to monitor the health and performance of a MapR cluster.
  - Monitoring Using the Control System and the CLI
    Describes the Overview page in the Control System, which displays information about the cluster.
    - Setting the Refresh Rate on the Control System
      Explains how to configure how frequently you want to refresh the graphs, and data in the Control System.
    - Customizing the List of Metric Charts and Columns on the Control System
      Explains how to customize the list of metric charts and columns on the Control System.
    - Monitoring the Cluster
      Explains how to view the cluster health, disk, memory, CPU utilization metrics, and alarms on the cluster using either the Control System or the CLI.
    - Monitoring Nodes
      Explains how to monitor nodes using either the Control System or the CLI.
    - Monitoring YARN
    - Monitoring Volumes
      Explains how to monitor volume parameters using the Control System.
    - Monitoring Tables
      Explains how to monitor table alarms and view table metrics in the Control System.
    - Monitoring Streams
      Explains how to monitor streams using either the Control System or the CLI.
    - Monitoring Alarms
      Provides an overview of how to monitor alarms using the Control Panel and the CLI.
    - Monitoring Errors
      Explains how to monitor errors using the Control System.
    - Metering
      The Control System includes a metering feature that can be used to collect cluster storage and compute usage details for consumption-based billing, for actual monthly storage and computations.
  - Using MapR Data Platform Monitoring (Spyglass Initiative)
    MapR Data Platform Monitoring (part of the Spyglass initiative) provides the ability to collect, store, and view metrics and logs for nodes, services, and jobs/applications.
- Configuring Security
  Describes how to configure security and manage secure clusters.
- Managing Secure Clusters
  Provides procedures that will enable you to use MapR clusters securely.
- Administering the MapR Data Access Gateway
  The MapR Data Access Gateway is a service that acts as a proxy and gateway for translating requests between lightweight client applications and the MapR cluster. This section describes considerations when upgrading the service, how to modify configuration settings, and how to administer and manage the service.
- Planning for High Availability
- Administrator's Reference
  This section contains in-depth reference information for the administrator.
- Troubleshooting Cluster Administration
  Lists the common errors and their solutions.
- Best Practices for Backing Up MapR Information
  Lists the best practices and performance considerations to follow when backing up MapR information.
6.1 Development
This section contains information related to application development for Ezmeral ecosystem components and MapR Data Platform products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: MapR Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other MapR version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Monitoring YARN

Procedure

Log in to the MapR Control System and:

Click Overview to view the following in the YARN pane:
- Number of node managers, running applications, and queued jobs.
- Memory and CPU utilization metrics.
Go to the service information page for YARN. The YARN information page displays the following panes:
Summary
Displays:
- Total number of nodes and number of active and unhealthy nodes.
- Allocated, pending, and reserved number of Resource Manager containers.
Top Queues by CPU Utilization

Displays the queues that utilize the most CPU (in percentage).

Top Queues by Memory Consumption

Displays the queues that consume the most memory (in percentage).

Applications

Displays the number of submitted, completed, running, pending, and failed applications during a selected date and time range. You can select a preset or specify a custom time range.

You can zoom in (by clicking and dragging the cursor in the pane) for a more granular view.

Resource Manager (CPU)

The number of cores allocated and used by Resource Manager during a selected date and time range. You can select a preset or specify a custom time range.

You can zoom in (by clicking and dragging the cursor in the pane) for a more granular view.

Resource Manager (Memory)

The amount (in MB) of memory allocated and used by Resource Manager during a selected date and time range. You can select a preset or specify a custom time range.

You can zoom in (by clicking and dragging the cursor in the pane) for a more granular view.

NOTE The metrics collection infrastructure must be installed during installation to visualize the metrics in the various panes. If the metrics collection infrastructure is not installed, perform an Incremental Install to install the metrics collection infrastructure.