Home
6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
Ecosystem Components
The following sections provide information about each open source project that MapR supports.
MapR-ES Clients and Tools
Kafka REST Proxy 2.0.1 for MapR-ES
The Kafka REST Proxy 2.0.1 for MapR-ES provides a RESTful interface to MapR-ES clusters to consume and produce messages and to perform administrative operations. This release of Kafka REST Proxy 2.0.1 is associated with MEP 2.x, 3.x, and 4.x.
Kafka REST Proxy 2.0.1 Configuration
This section provides information for configuring the Kafka REST Proxy for MapR-ES.

MapR 6.0 Documentation

6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
- Application Development Process
  Before you start developing applications on MapR’s Converged Data Platform, consider how you will get the data onto the platform, the format it will be stored in, the type of processing or modeling that is required, and how the data will be accessed.
- MapR-FS and Apps
  The following sections provide information about accessing MapR-FS with C and Java applications.
- MapR-DB and Apps
  This section contains information about developing client applications for JSON and binary tables.
- MapR-ES and Apps
  MapR-ES brings integrated publish and subscribe messaging to the MapR Converged Data Platform.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- MapR Data Science Refinery
  The MapR Data Science Refinery is an easy-to-deploy and scalable data science toolkit with native access to all platform assets and superior out-of-the-box security.
- MapR Data Fabric for Kubernetes FlexVolume Driver
  This section describes how to use and troubleshoot the MapR Data Fabric for Kubernetes FlexVolume Driver.
- Ecosystem Components
  The following sections provide information about each open source project that MapR supports.
  - MapR Ecosystem Packs
    A MapR Ecosystem Pack (MEP) provides a set of ecosystem components that work together on one or more MapR cluster versions. Only one version of each ecosystem component is available in each MEP. For example, only one version of Hive and one version of Spark is supported in a MEP.
  - AsyncHBase
  - Cascading
  - Drill
  - Flume
  - HBase Client and MapR-DB Binary Tables
  - HCatalog
  - Hive
  - HttpFS
  - Hue
  - Impala
  - MapR-ES Clients and Tools
    - Kafka REST Proxy 4.0.0
      The Kafka REST Proxy provides a RESTful interface to MapR-ES clusters to consume and produce messages and to perform administrative operations.
    - Kafka Connect 4.0.0
      Kafka Connect is a utility for streaming data between MapR-ES and other storage systems.
    - Kafka REST Proxy 2.0.1 for MapR-ES
      The Kafka REST Proxy 2.0.1 for MapR-ES provides a RESTful interface to MapR-ES clusters to consume and produce messages and to perform administrative operations. This release of Kafka REST Proxy 2.0.1 is associated with MEP 2.x, 3.x, and 4.x.
      - Kafka REST Proxy 2.0.1 Configuration
        This section provides information for configuring the Kafka REST Proxy for MapR-ES.
        Kafka REST 2.0.1: Configuration Parameters
        This section provides the Kafka REST Proxy for MapR-ES parameters.
        Kafka REST 2.0.1: Security Parameters
        The following security parameters provide an encryption layer between REST clients and the MapR REST Gateway.
        Kafka REST 2.0.1: Configure SSL Security
        Describes how to configure Kafka REST security on a MapR cluster.
        Kafka REST 2.0.1: User Impersonation
        Describes how to disable, enable, and use Impersonation with Kafka REST
      - Kafka REST 2.0.1: Manage Services
        The Kafka REST Proxy for MapR-ES service can be started, restarted, and stopped via the maprcli nodes services command or using the REST API equivalent.
      - Kafka REST Proxy 2.0.1
        This section provides a HTTP method and URI summary of the Kafka REST Proxy for MapR-ES.
    - Kafka Connect 2.0.1 for MapR-ES
      Kafka Connect for MapR-ES is a utility for streaming data between MapR-ES and Apache Kafka and other storage systems. This release of Kafka Connect is associated with MEP 2.x, 3.x, and 4.x.
  - Myriad
  - OpenStack Manila
  - Oozie
  - Pig
  - Sentry
  - Spark
  - Sqoop
  - Third Party Solutions
- Maven and MapR
  This section discusses topics associated with Maven and MapR.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  MapR supports public APIs for MapR-FS, MapR-DB, and MapR-ES. These APIs are available for application development purposes.

Kafka REST Proxy 2.0.1 Configuration

This section provides information for configuring the Kafka REST Proxy for MapR-ES.

These configuration parameters can be set in the kafka-rest.properties file. The Kafka REST Proxy for MapR Streams service is displayed in MCS and is run on port 8082 by default.

To configure the Kafka REST Proxy for MapR-ES, edit the following file:

/opt/mapr/kafka-rest/kafka-rest-<version>/config/kafka-rest.properties

To view the Kafka REST Proxy for MapR-ES log files, see the following location:

/opt/mapr/kafka-rest/kafka-rest-<version>/logs/kafka-rest.log

NOTE: After installation, Warden automatically detects the configuration and starts the service. To configure the Kafka REST Proxy for MapR-ES, stop the service, configure the parameters, and restart the service. To stop and restart services, see maprcli node services. For example:

maprcli node services -name kafka-rest -action stop

https://<host>:8443/rest/node/services?name=kafka-rest&action=stop&nodes=<node_names>

where node_names is the node on which to perform the action; either a list of nodes, or a filter that matches a set of nodes .