HPE Ezmeral Data Fabric 6.1.x is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About MapR 6.1
This site contains the main documentation for Version 6.1 of the MapR Converged Data Platform, including installation, configuration, administration, and reference information.
6.1 Installation
This section contains information about installing and upgrading MapR software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a MapR cluster.
6.1 MapR Data Platform
MapR Data Platform is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.1 Administration
This section describes how to manage the nodes and services that make up a cluster.
6.1 Development
This section contains information related to application development for Ezmeral ecosystem components and MapR Data Platform products, including the file system, Database (Key-Value and JSON), and Event Streams.
- Application Development Process
  Before you start developing applications on the MapR Data Platform platform, consider how you will get the data into the platform, the storage format of the data, the type of processing or modeling that is required, and how the data will be accessed.
- MapR XD and Apps
  The following sections provide information about accessing the MapR XD with C and Java applications.
  - Copying Data from Apache Hadoop to a MapR Cluster
    Describes the procedure to copy data from an Apache Hadoop to a MapR cluster.
    - Copy Data Using the hdfs:// Protocol
      Describes the procedure to copy data from a HDFS cluster to a MapR cluster using the hdfs:// protocol.
    - Copying Data Using the webhdfs:// Protocol
      Describes how to copy data from a HDFS cluster to a MapR cluster using the webhdfs:// protocol.
    - Copying Data Using NFS
      Describes how to copy files from one MapR cluster to another using NFS.
  - Accessing the File System with C Applications
  - Accessing MapR XD Distributed File and Object Store in Java Applications
- MapR Database and Apps
  This section contains information about developing client applications for JSON and key-value tables.
- MapR Event Store For Apache Kafka and Apps
  MapR Event Store For Apache Kafka brings integrated publish and subscribe messaging to MapR Data Platform.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- MapR Data Science Refinery
  The MapR Data Science Refinery product is an easy-to-deploy and scalable data science toolkit with native access to all platform assets and superior out-of-the-box security.
- MapR Data Fabric for Kubernetes
  This section describes how to leverage the capabilities of the MapR Data Fabric for Kubernetes.
- Ecosystem Components
  The following sections provide information about each open-source project that is supported by the MapR Data Platform.
- Maven and MapR
  This section discusses topics associated with Maven and MapR.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  MapR Data Platform supports public APIs for MapR File System, MapR Database, and MapR Event Store For Apache Kafka. These APIs are available for application-development purposes.
Other Docs
This section contains release-independent information, including: MapR Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other MapR version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Copying Data Using the webhdfs:// Protocol

Describes how to copy data from a HDFS cluster to a MapR cluster using the webhdfs:// protocol.

Before you can copy data from an HDFS cluster to a MapR cluster using the webhdfs:// protocol, you must configure the MapR cluster to access the HDFS cluster. To do this, complete the steps listed in Configuring a MapR Cluster to Access an HDFS Cluster for the security scenario that best describes your HDFS and MapR clusters, and then complete the steps listed under Verifying Access to an HDFS Cluster.

The HDFS cluster must have WebHDFS enabled. Verify that the following parameter exists in the hdfs-site.xml file and that the value is set to true.

<property>
<name>dfs.webhdfs.enabled</name>
<value>true</value>
</property>

You also need the following information:

<NameNode> - the IP address or hostname of the NameNode in the HDFS cluster
<NameNode HTTP Port> - the HTTP port on the NameNode in the HDFS cluster
<HDFS path> - the path to the HDFS directory from which you plan to copy data
<MapR filesystem path> - the path in the MapR cluster to which you plan to copy HDFS data

To copy data from the HDFS to the MapR filesystem using the webhdfs:// protocol, complete the following step:

Run the following command from a node in the MapR cluster:

hadoop distcp webhdfs://<NameNode>:<NameNode HTTP Port>/<HDFS path> maprfs:///<MapR filesystem path>

Example

hadoop distcp webhdfs://nn2:50070/user/sara maprfs:///user/sara

NOTE The triple slashes in maprfs:///... are required.