Getting Started with Apache Kafka Wire Protocol Service
Describes the steps required to install, configure, and use Apache Kafka Wire Protocol Service.
The following sections describe the prerequisites and steps required to use Apache Kafka Wire Protocol Service.
Prerequisites
- HPE Ezmeral Data Fabric 7.1.0
- DAG 5.0 (available in EEP 9.0.0)
- Apache Kafka clients 2.6.x
1 - Install Data Access Gateway
Apache Kafka Wire Protocol Service is
included with the Data Access Gateway (DAG) package
(mapr-data-access-gateway
) and is installed when you install DAG.
You can install DAG on multiple Data Fabric data nodes alongside the
mfs
(file server) service through the Data Fabric Installer or manually
using package managers. For more information about installing DAG, see Installing Data Access Gateway
and Data Access Gateway Support Matrix.
- High Availability
- Apache Kafka Wire Protocol Service runs on all Data Fabric nodes that run DAG.
- Port
- The default DAG port for Apache Kafka Wire Protocol Service is 9092; however, you can change the port as described in Configuring Apache Kafka Wire Protocol Service.
2 - Configure Apache Kafka Wire Protocol Service
Set cluster and node-specific settings, as described in Configuring Apache Kafka Wire Protocol Service.
3 - Create Mapping Rules
Create mapping rules to map topics to streams, as described in Mapping Topics to Streams.
4 - Secure Streams
Set ACEs on streams, as described in Securing Apache Kafka Wire Protocol Service.
5 - Use Apache Kafka Client Libraries to Connect to HPE Ezmeral Data Fabric Streams
For a list of available clients, see https://cwiki.apache.org/confluence/display/KAFKA/Clients.