HPE Ezmeral Data Fabric 6.1.x is In Maintenance and transitions to "End of Maintenance" in June 2024. Please see the latest documentation.

About MapR 6.1
This site contains the main documentation for Version 6.1 of the MapR Converged Data Platform, including installation, configuration, administration, and reference information.
6.1 Installation
This section contains information about installing and upgrading MapR software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a MapR cluster.
6.1 MapR Data Platform
MapR Data Platform is the industry-leading data platform for AI and analytics that solves enterprise business needs.
6.1 Administration
This section describes how to manage the nodes and services that make up a cluster.
6.1 Development
This section contains information related to application development for Ezmeral ecosystem components and MapR Data Platform products, including the file system, Database (Key-Value and JSON), and Event Streams.
- Application Development Process
  Before you start developing applications on the MapR Data Platform platform, consider how you will get the data into the platform, the storage format of the data, the type of processing or modeling that is required, and how the data will be accessed.
- MapR XD and Apps
  The following sections provide information about accessing the MapR XD with C and Java applications.
- MapR Database and Apps
  This section contains information about developing client applications for JSON and key-value tables.
- MapR Event Store For Apache Kafka and Apps
  MapR Event Store For Apache Kafka brings integrated publish and subscribe messaging to MapR Data Platform.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- MapR Data Science Refinery
  The MapR Data Science Refinery product is an easy-to-deploy and scalable data science toolkit with native access to all platform assets and superior out-of-the-box security.
- MapR Data Fabric for Kubernetes
  This section describes how to leverage the capabilities of the MapR Data Fabric for Kubernetes.
- Ecosystem Components
  The following sections provide information about each open-source project that is supported by the MapR Data Platform.
  - Ezmeral Ecosystem Packs
  - AsyncHBase
  - Cascading
  - Apache Drill
  - Flume
  - HBase
  - HBase Client and MapR Database Binary Tables
  - HCatalog
  - Hive
  - HttpFS
  - Hue
    - Hue Feature Support
    - Configure Hue
    - Integrate Hue
    - Use Hue
      This section provides information about using Hue, but it does not duplicate the Hue documentation.
    - Sqoop2
      - Sqoop2 Connector Support
        Connector support differs for each version of Sqoop2.
      - Configuring Sqoop2
        Configure Kerberos Authentication for Sqoop2
        You can configure Sqoop2 to use Kerberos authentication. When Sqoop2 uses Kerberos authentication, the cluster and other components that work with Sqoop2, such as Hue, must also use Kerberos authentication.
        Configure MapR-SASL for Sqoop2
        This section describes how to configure Sqoop2 to use MapR-SASL. Starting with the EEP 4.0 release, for secure clusters, MapR-SASL is automatically configured for Sqoop2 and you can skip the steps outlined in this section.
        Configure SSL for Sqoop2
        As of Sqoop 1.99.7, you can configure SSL to enable encrypted communications between the Sqoop2 server and its clients. Starting with the EEP 4.0 release, for secure clusters, SSL is automatically configured for Sqoop2 and you can skip the steps outlined in this section.
        Configure Repository Encryption for Sqoop2
        As of Sqoop 1.99.7, you can configure the Sqoop2 repository to encrypt password data.
      - Using Sqoop2
      - Sqoop 1.99.7 API Changes
        The following APIs have been deprecated in Sqoop 1.99.7.
  - Impala
  - Livy
    Apache Livy is primarily used to provide integration between Hue and Spark.
  - MapR Event Store For Apache Kafka Clients and Tools
    Describes the supported MapR Event Store For Apache Kafka tools and clients.
  - S3 Gateway
    The S3 gateway is a service that provides an S3-compatible interface to expose data in MapR Data Platform as objects. The S3 gateway manages all inbound S3 API requests to put data into and get data out of cloud storage.
  - Myriad
  - Oozie
  - Pig
  - Sentry
  - Apache Spark
  - Sqoop
  - YARN
  - Zeppelin
- Maven and MapR
  This section discusses topics associated with Maven and MapR.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  MapR Data Platform supports public APIs for MapR File System, MapR Database, and MapR Event Store For Apache Kafka. These APIs are available for application-development purposes.
Other Docs
This section contains release-independent information, including: MapR Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other MapR version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Configure SSL for Sqoop2

As of Sqoop 1.99.7, you can configure SSL to enable encrypted communications between the Sqoop2 server and its clients. Starting with the EEP 4.0 release, for secure clusters, SSL is automatically configured for Sqoop2 and you can skip the steps outlined in this section.

About this task

IMPORTANT This component is deprecated. Hewlett Packard Enterprise recommends using an alternate product. For more information, see Discontinued Ecosystem Components.

Procedure

Stop the Sqoop2 server:

maprcli node services -name sqoop2 -action stop -nodes <space delimited list of nodes>

In the sqoop.properties file (/opt/mapr/sqoop/sqoop-<version>/conf/sqoop.properties), uncomment the SSL related properties. For example:
```
#Enable Sqoop SSL
org.apache.sqoop.security.tls.enabled=true
#Change SSL protocol 
org.apache.sqoop.security.tls.protocol=TLSv1.2
#Path to MapR ssk keystore
org.apache.sqoop.security.tls.keystore=/opt/mapr/conf/ssl_keystore
#Keystore password
org.apache.sqoop.security.tls.keystore_password=<passwd>
```
NOTE You can use the default ssl_keystore and password. The password for the default ssl_keystore is <ssl-keystore-password>.
Remove the Sqoop2 repository.
```
rm -rf /opt/mapr/sqoop/repository
```

Start the Sqoop2 server.

maprcli node services -name sqoop2 -action start -nodes <space delimited list of nodes>

Start the Sqoop2 client:
```
sudo -u mapr /opt/mapr/sqoop/sqoop-<version>/bin/sqoop.sh client 
```
NOTE If you are using MapR-SASL, run the following command instead: sudo -u mapr /opt/mapr/sqoop/sqoop-<version>/bin/sqoop.sh client --custom.

Configure the Sqoop2 client to communicate the Sqoop2 server using SSL.

set server --host <sqoop_server_hosname> --port <sqoop_port> --webapp <sqoop_webapp> --tls

For example:


sqoop:000> set server --host localhost --port 12000 --webapp sqoop --tls

Configure the Sqoop2 client truststore and truststore password.

set truststore --truststore /opt/mapr/conf/ssl_truststore --truststore-password <passwd>

What to do next

Each time you start the Sqoop2 client, you must reset the server and truststore configuration.