Home
6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
Ecosystem Components
The following sections provide information about each open source project that MapR supports.
MapR-ES Clients and Tools

MapR 6.0 Documentation

6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
- Application Development Process
  Before you start developing applications on MapR’s Converged Data Platform, consider how you will get the data onto the platform, the format it will be stored in, the type of processing or modeling that is required, and how the data will be accessed.
- MapR-FS and Apps
  The following sections provide information about accessing MapR-FS with C and Java applications.
- MapR-DB and Apps
  This section contains information about developing client applications for JSON and binary tables.
- MapR-ES and Apps
  MapR-ES brings integrated publish and subscribe messaging to the MapR Converged Data Platform.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- MapR Data Science Refinery
  The MapR Data Science Refinery is an easy-to-deploy and scalable data science toolkit with native access to all platform assets and superior out-of-the-box security.
- MapR Data Fabric for Kubernetes FlexVolume Driver
  This section describes how to use and troubleshoot the MapR Data Fabric for Kubernetes FlexVolume Driver.
- Ecosystem Components
  The following sections provide information about each open source project that MapR supports.
  - MapR Ecosystem Packs
    A MapR Ecosystem Pack (MEP) provides a set of ecosystem components that work together on one or more MapR cluster versions. Only one version of each ecosystem component is available in each MEP. For example, only one version of Hive and one version of Spark is supported in a MEP.
  - AsyncHBase
  - Cascading
  - Drill
  - Flume
  - HBase Client and MapR-DB Binary Tables
  - HCatalog
  - Hive
  - HttpFS
  - Hue
  - Impala
  - MapR-ES Clients and Tools
    - Kafka REST Proxy 4.0.0
      The Kafka REST Proxy provides a RESTful interface to MapR-ES clusters to consume and produce messages and to perform administrative operations.
    - Kafka Connect 4.0.0
      Kafka Connect is a utility for streaming data between MapR-ES and other storage systems.
    - Kafka REST Proxy 2.0.1 for MapR-ES
      The Kafka REST Proxy 2.0.1 for MapR-ES provides a RESTful interface to MapR-ES clusters to consume and produce messages and to perform administrative operations. This release of Kafka REST Proxy 2.0.1 is associated with MEP 2.x, 3.x, and 4.x.
    - Kafka Connect 2.0.1 for MapR-ES
      Kafka Connect for MapR-ES is a utility for streaming data between MapR-ES and Apache Kafka and other storage systems. This release of Kafka Connect is associated with MEP 2.x, 3.x, and 4.x.
  - Myriad
  - OpenStack Manila
  - Oozie
  - Pig
  - Sentry
  - Spark
  - Sqoop
  - Third Party Solutions
- Maven and MapR
  This section discusses topics associated with Maven and MapR.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  MapR supports public APIs for MapR-FS, MapR-DB, and MapR-ES. These APIs are available for application development purposes.

MapR-ES Clients and Tools

The following clients and tools are available for MapR-ES:

MapR-ES Tools
MapR-ES Clients

MapR-ES Tools

The following Kafka tools are supported:

Table 1. Supported Kafka Tools
MapR-ES Tool	MEP Release	MapR version	Kafka version
Kafka REST 4.0.0	5.0 MEP release	6.0	1.0
Kafka Connect 4.0.0	5.0 MEP release	6.0	1.0
Kafka REST/Connect 2.0.1	2.x, 3.x, and 4.x MEP release	6.0	0.9

Kafka tools:

Kafka REST Proxy 4.0.0: This tool is used as a RESTful interface to MapR-ES.
Kafka Connect 4.0.0: This tool is used to stream data between MapR-ES and other storage systems.
Kafka REST Proxy 2.0.1 for MapR-ES is based on Kafka 0.9. This tool is used as a RESTful interface to MapR-ES. This tool is available as of MEP 2.x, 3.x, and 4.x.
Kafka Connect 2.0.1 for MapR-ES is based on Kafka 0.9. This tool is used to stream data between MapR-ES, Apache Kafka, and other storage systems. This tool is available as of MEP 2.x, 3.x, and 4.x.

MapR-ES Clients

MapR-ES Client applications can be developed for MapR-ES (as of MapR 5.2.1 with MEP 3.0). The MapR-ES clients are based on distributions of librdkafka that works with MapR-ES.

MapR-ES C Client - Used to develop MapR-ES applications in C. See MapR-ES C Applications
MapR-ES Java Client - Used to develop MapR-ES applications in Java. See MapR-ES Java Applications
MapR-ES Python Client - Used to develop MapR-ES applications in Python. This client is available as of MapR 5.2.1 with MEP 3.0. See MapR-ES Python Applications

The following Apache Kafka librdkafka versions are supported:

Table 2. Supported Apache Kafka librdkafka versions
MapR release	MEP Release	Kafka librdkafka version
As of MapR 6.0.1	As of 5.0	0.11.3
As of MapR 5.2.1 through 6.0.0	As of 3.0	0.9

(Topic last modified: 2019-01-14)