Home
6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
Ecosystem Components
The following sections provide information about each open source project that MapR supports.
Drill
Working with Drill
Connecting Drill to Data Sources
Drill serves as a query layer that connects to data sources through storage plugins. A storage plugin is a software module for connecting Drill to data sources. A storage plugin typically optimizes execution of Drill queries, provides the location of the data, and configures the workspace and file formats for reading data.
Drill Storage and Format Plugin Support Matrix

MapR 6.0 Documentation

6.0 Development
This section contains information related to application development for ecosystem components and MapR products including MapR-DB (binary and JSON), MapR-FS, and MapR Streams.
- Application Development Process
  Before you start developing applications on MapR’s Converged Data Platform, consider how you will get the data onto the platform, the format it will be stored in, the type of processing or modeling that is required, and how the data will be accessed.
- MapR-FS and Apps
  The following sections provide information about accessing MapR-FS with C and Java applications.
- MapR-DB and Apps
  This section contains information about developing client applications for JSON and binary tables.
- MapR-ES and Apps
  MapR-ES brings integrated publish and subscribe messaging to the MapR Converged Data Platform.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- MapR Data Science Refinery
  The MapR Data Science Refinery is an easy-to-deploy and scalable data science toolkit with native access to all platform assets and superior out-of-the-box security.
- MapR Data Fabric for Kubernetes FlexVolume Driver
  This section describes how to use and troubleshoot the MapR Data Fabric for Kubernetes FlexVolume Driver.
- Ecosystem Components
  The following sections provide information about each open source project that MapR supports.
  - MapR Ecosystem Packs
    A MapR Ecosystem Pack (MEP) provides a set of ecosystem components that work together on one or more MapR cluster versions. Only one version of each ecosystem component is available in each MEP. For example, only one version of Hive and one version of Spark is supported in a MEP.
  - AsyncHBase
  - Cascading
  - Drill
    - Drill Tutorial
    - Drill-on-YARN
    - Configuring Drill
    - Working with Drill
      - Start the Web Console
      - Building the Connection URL
      - Connecting Drill to Data Sources
        Drill serves as a query layer that connects to data sources through storage plugins. A storage plugin is a software module for connecting Drill to data sources. A storage plugin typically optimizes execution of Drill queries, provides the location of the data, and configures the workspace and file formats for reading data.
        Drill Storage and Format Plugin Support Matrix
        MapR-DB Format Plugin for Drill
        Drill supports access to MapR-DB JSON and binary tables through the maprdb format plugin.
        Configuring the Hive Storage Plugin
        Configuring the Kafka Storage Plugin
        The Kafka storage plugin is not officially supported for Drill on MapR Streams; however, if you choose to configure Kafka as a data source in Drill, you must update the <drill_home>/jars/3rdParty directory such that it contains the required JAR files and then restart Drill before you configure the kafka storage plugin in the Drill Web UI.
      - Hive to Drill Type Mapping
    - Securing Drill
      An administrator can install Drill with the default security configuration provided by MapR or manually configure custom security for Drill.
    - Drill Drivers
      MapR provides Drill ODBC and JDBC drivers that you can download. Drivers are updated periodically to include support for new functionality in Drill.
    - Drill Configuration Files
      The Drill installation includes configuration files with start-up options that you can modify prior to starting Drill.
    - Monitoring Drill Metrics
    - Optimizing Queries with Indexes
      MapR-DB provides a highly scalable key-value database platform on which you can run SQL queries using Drill. As of the 6.0 release of the MapR Converged Data Platform, MapR-DB natively supports indexes on secondary fields in JSON tables.
  - Flume
  - HBase Client and MapR-DB Binary Tables
  - HCatalog
  - Hive
  - HttpFS
  - Hue
  - Impala
  - MapR-ES Clients and Tools
  - Myriad
  - OpenStack Manila
  - Oozie
  - Pig
  - Sentry
  - Spark
  - Sqoop
  - Third Party Solutions
- Maven and MapR
  This section discusses topics associated with Maven and MapR.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  MapR supports public APIs for MapR-FS, MapR-DB, and MapR-ES. These APIs are available for application development purposes.

Drill Storage and Format Plugin Support Matrix

MapR supports Apache Drill running on the MapR distribution of Hadoop as the underlying storage platform in single or a multi-node deployments. See Component Versions for Released MEPs for versioning information.

MapR supports Apache Drill deployed without Hadoop in a standalone configuration on a single node, however MapR does not support multi-node standalone cluster deployments of Apache Drill. Note that Apache Drill itself does not require Hadoop.

MapR does not support Drill running on other distributions of Hadoop as the underlying storage platform, such as Cloudera and Hortonworks.

The following table lists the supported and unsupported data sources and formats in Drill on MapR:

Data Source	Storage Plugin Type	Formats	Supported by MapR
MapR-FS	dfs	Text (CSV, TSV, PSV)	Yes
		Parquet	Yes
		JSON	Yes
		Avro	No
MapR-DB	dfs	Binary	Yes
		JSON	Yes
HBase	hbase	Binary	No (as of Drill 1.11 and MapR 6.0)
Hive	hive	Text (CSV, TSV, PSV)	Yes
		Parquet	Yes
		JSON	Yes
		Avro	Yes
		Other Hive built-in SerDes	Yes (Not recommended due to the memory overhead and performance implications.)
S3	s3	Supports the same formats as the dfs storage plugin.	Yes
MongoDB	mongodb	N/A	No
RDBMS	jdbc	N/A	No
Kudu	kudu	N/A	No
Kafka	kafka	JSON	No NOTE: The kafka storage plugin on MapR Streams is in the Alpha testing phase and not officially supported. See Configuring the Kafka Storage Plugin for more information.
OpenTSDB	openTSDB	N/A	NOTE: The openTSDB storage plugin is not officially supported. See OpenTSDB Storage Plugin for more information.

NOTE: As of MapR 6.0 and Drill 1.11, HBase is no longer supported, therefore the communication path between Drill and HBase is also not supported. If you have an hbase storage plugin configured in Drill, you should disable it.

(Topic last modified: 2019-02-22)