Home
6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
Ecosystem Components
The following sections provide information about each open source project that MapR supports.
Hue
Sqoop2
Configuring Sqoop2
Configure MapR-SASL for Sqoop2
This section describes how to configure Sqoop2 to use MapR-SASL. Starting with the MEP 4.0 release, for secure clusters, MapR-SASL is automatically configured for Sqoop2 and you can skip the steps outlined in this section.

MapR 6.0 Documentation

6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
- Application Development Process
  Before you start developing applications on MapR’s Converged Data Platform, consider how you will get the data onto the platform, the format it will be stored in, the type of processing or modeling that is required, and how the data will be accessed.
- MapR-FS and Apps
  The following sections provide information about accessing MapR-FS with C and Java applications.
- MapR-DB and Apps
  This section contains information about developing client applications for JSON and binary tables.
- MapR-ES and Apps
  MapR-ES brings integrated publish and subscribe messaging to the MapR Converged Data Platform.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- MapR Data Science Refinery
  The MapR Data Science Refinery is an easy-to-deploy and scalable data science toolkit with native access to all platform assets and superior out-of-the-box security.
- MapR Data Fabric for Kubernetes FlexVolume Driver
  This section describes how to use and troubleshoot the MapR Data Fabric for Kubernetes FlexVolume Driver.
- Ecosystem Components
  The following sections provide information about each open source project that MapR supports.
  - MapR Ecosystem Packs
    A MapR Ecosystem Pack (MEP) provides a set of ecosystem components that work together on one or more MapR cluster versions. Only one version of each ecosystem component is available in each MEP. For example, only one version of Hive and one version of Spark is supported in a MEP.
  - AsyncHBase
  - Cascading
  - Drill
  - Flume
  - HBase Client and MapR-DB Binary Tables
  - HCatalog
  - Hive
  - HttpFS
  - Hue
    - Hue Feature Support
    - Configure Hue
    - Integrate Hue
    - Use Hue
      This section provides information about using Hue with MapR, but it does not duplicate the Hue documentation.
    - Hue and Livy
      The MapR distribution uses Apache Livy primarily to provide integration between Hue and Spark.
    - Sqoop2
      - Sqoop2 Connector Support
        Connector support differs for each Sqoop2 version that MapR supports.
      - Configuring Sqoop2
        Configure Kerberos Authentication for Sqoop2
        You can configure Sqoop2 to use Kerberos authentication. When Sqoop2 uses Kerberos authentication, the cluster and other components that work with Sqoop2, such as Hue, must also use Kerberos authentication.
        Configure MapR-SASL for Sqoop2
        This section describes how to configure Sqoop2 to use MapR-SASL. Starting with the MEP 4.0 release, for secure clusters, MapR-SASL is automatically configured for Sqoop2 and you can skip the steps outlined in this section.
        Configure SSL for Sqoop2
        As of Sqoop 1.99.7, you can configure SSL to enable encrypted communications between the Sqoop2 server and its clients. Starting with the MEP 4.0 release, for secure clusters, SSL is automatically configured for Sqoop2 and you can skip the steps outlined in this section.
        Configure Repository Encryption for Sqoop2
        As of Sqoop 1.99.7, you can configure the Sqoop2 repository to encrypt password data.
      - Using Sqoop2
      - Sqoop 1.99.7 API Changes
        The following APIs have been deprecated in Sqoop 1.99.7.
  - Impala
  - MapR-ES Clients and Tools
  - Myriad
  - OpenStack Manila
  - Oozie
  - Pig
  - Sentry
  - Spark
  - Sqoop
  - Third Party Solutions
- Maven and MapR
  This section discusses topics associated with Maven and MapR.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  MapR supports public APIs for MapR-FS, MapR-DB, and MapR-ES. These APIs are available for application development purposes.

Configure MapR-SASL for Sqoop2

This section describes how to configure Sqoop2 to use MapR-SASL. Starting with the MEP 4.0 release, for secure clusters, MapR-SASL is automatically configured for Sqoop2 and you can skip the steps outlined in this section.

About this task

When you configure MapR-SASL for Sqoop2, other components that communicate with Sqoop, such as Hue, must also be configured to use MapR-SASL. Complete the following steps on each node that runs the Sqoop2 server:

Procedure

Remove the # before the following properties in the Authentication configuration section of the sqoop.properties file.
In Sqoop 1.99.6, the sqoop.properties file is in the following directory: /opt/mapr/sqoop/sqoop-<version>/server/conf/. In Sqoop 1.99.7, the sqoop.properties file is in the following directory: /opt/mapr/sqoop/sqoop-<version>/conf/.
```
#org.apache.sqoop.security.authentication.type=CUSTOM
#org.apache.sqoop.security.authentication.custom_handler=org.apache.hadoop.security.authentication.server.MultiMechsAuthenticationHandler
```

Restart Sqoop2 server.

maprcli node services -name sqoop2 -action restart -nodes <space delimited list of nodes>

What to do next

NOTE: To start Sqoop2 client with MapR-SASL, run the following command:

sudo -u mapr /opt/mapr/sqoop/sqoop-<version>/bin/sqoop.sh client --custom