HPE Ezmeral Data Fabric 6.1.x is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About MapR 6.1
This site contains the main documentation for Version 6.1 of the MapR Converged Data Platform, including installation, configuration, administration, and reference information.
6.1 Installation
This section contains information about installing and upgrading MapR software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a MapR cluster.
6.1 MapR Data Platform
MapR Data Platform is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.1 Administration
This section describes how to manage the nodes and services that make up a cluster.
- Administering Users and Clusters
  Lists topics that help manage a MapR cluster.
- Administering Nodes
  Provides a synopsis of managing nodes in a cluster.
- Administering Volumes
  This section provide information about how to organize and manage data using volumes, a unique feature of MapR clusters.
- Administering Files and Directories
  - Using Global File System Checking
    Describes how to use the gfsck command to check and repair file system errors.
  - Setting MapR File System Permissions
  - Managing File and Directory ACEs
    Describes the implications of setting access control expressions on files and directories.
  - Managing Chunk Size
    Describes the considerations for managing the chunk size for map tasks.
  - Managing Compression
    Lists the advantages of using compression.
  - Managing Hard Links
    Explains what hard links are, and their limitations.
  - Managing Extended Attributes
    Describes what extended attributes are, and the POSIX permissions that you need to manage them.
    - Enabling Extended Attributes
    - Setting, Retrieving, and Removing Extended Attributes
      - Hadoop Commands for Extended Attributes
        Lists the Hadoop commands to set, retrieve, and remove extended attributes on files, directories and FUSE mounted paths.
      - Linux Commands for Extended Attributes
      - Java APIs for Extended Attributes
        Java APIs to manage extended attributes
  - Managing Core Files
    Describes how to set the location for core files.
  - Migrating Files from the Edge Cluster to AWS S3
    Describes how new or changed files are automatically uploaded to AWS S3 by the File Migration service.
  - Managing Tiered Files from the Command-line
- Administering Tables
  Administration of the MapR Database is done primarily via the command line (maprcli) or with the Managed Control System (MCS). Regardless of whether the MapR Database table is used for binary files or JSON documents, the same types of commands are used with slightly different parameter options. MapR Database administration is associated with tables, columns and column families, and table regions.
- Administering Streams
- Administering MapR Gateways
  A MapR gateway mediates one-way communication between a source MapR cluster and a destination cluster. You can replicate MapR Database tables (binary and JSON) and MapR Event Store For Apache Kafka streams. MapR gateways also apply updates from JSON tables to their secondary indexes and propagate Change Data Capture (CDC) logs.
- Administering Services
- Monitoring the Cluster
  This section describes how to monitor the health and performance of a MapR cluster.
- Configuring Security
  Describes how to configure security and manage secure clusters.
- Managing Secure Clusters
  Provides procedures that will enable you to use MapR clusters securely.
- Administering the MapR Data Access Gateway
  The MapR Data Access Gateway is a service that acts as a proxy and gateway for translating requests between lightweight client applications and the MapR cluster. This section describes considerations when upgrading the service, how to modify configuration settings, and how to administer and manage the service.
- Planning for High Availability
- Administrator's Reference
  This section contains in-depth reference information for the administrator.
- Troubleshooting Cluster Administration
  Lists the common errors and their solutions.
- Best Practices for Backing Up MapR Information
  Lists the best practices and performance considerations to follow when backing up MapR information.
6.1 Development
This section contains information related to application development for Ezmeral ecosystem components and MapR Data Platform products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: MapR Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other MapR version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Hadoop Commands for Extended Attributes

Lists the Hadoop commands to set, retrieve, and remove extended attributes on files, directories and FUSE mounted paths.

You can set, retrieve, and remove extended attributes on files, directories, and FUSE mounted file path using the hadoop fs command. When setting an extended attribute:

The name must be prefixed with a namespace.

The extended attribute value must be encoded as one of the following:

text	The given string must be enclosed in double quotes to be treated as text.
hex	The given string must begin with 0x or 0X to be treated as hexadecimal number.
base64	The given string must begin with 0s or 0S to be treated as base64 encoding.

NOTE You must have the right permissions to set, retrieve, and/or remove extended attributes.

Set Extended Attributes

To set an extended attribute name and value for a file or directory, run the following command:

hadoop fs -setfattr -n name [-v value] <path>

For example:

hadoop fs -setfattr -n system.name -v system-hadoopfs /volforsnap/smallfile.txt
hadoop fs -setfattr -n user.name -v user-hadoopfs /volforsnap/smallfile.txt
hadoop fs -setfattr -n security.name -v security-hadoopfs /volforsnap/smallfile.txt
hadoop fs -setfattr -n trusted.name -v trusted-hadoopfs /volforsnap/smallfile.txt

Retrieve Extended Attributes

To retrieve the extended attributes associated with a file or directory, run the following command:

hadoop fs -getfattr [-R] -n name | -d [-e en] <path>

For example:

hadoop fs -getfattr  -d /volforsnap/smallfile.txt
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/mapr/lib/slf4j-log4j12-1.7.12.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
# file: /volforsnap/smallfile.txt
system.name="system-hadoopfs"
trusted.name="trusted-hadoopfs"
security.name="security-hadoopfs"
user.name="user-hadoopfs"

Remove Extended Attributes

To remove an extended attribute by name, run the following command:

hadoop fs -setfattr -x name <path>

For example:

hadoop fs -setfattr -x user.key1 /xattrs/m7user1/dir1