Migrating Apache Kafka Java Applications to MapR-ES
There are only two steps that you need to follow to migrate applications written with the Apache Kafka Java API to MapR-ES.
About this task
- Apache Kafka 1.1 to MapR-ES 6.1 or higher
- Apache Kafka 1.0 to MapR-ES 6.0.1 or higher
- Apache Kafka 0.9.0 to MapR-ES 6.0.0 or earlier
Procedure
-
Change the names of topics to include the path and name of the MapR Stream stream in
which the topic is located.
Here is the syntax to use:
For example, you might have a stream in a MapR cluster that is named/<path and name of stream>:<name of topic>
stream_A
, and the stream might be in a volume namedIoT
and in a directory namedautomobile_sensors
. You want to redirect a producer application to a topic in that stream. The syntax of the path to the topic might look like this:/mapr/IoT/automobile_sensors/stream_A:<name of topic>
- If a producer application uses the Kafka interface Partitioner to compute which partitions to publish messages to, revise the application so that it uses the Kafka StreamsPartitioner interface instead.