Utilities for MapR Event Store For Apache Kafka
MapR Event Store For Apache Kafka provides the utilities for operating on streams and topics.
NOTE MapR Event Store For Apache Kafka cannot use MapR Database Shell to perform operations on streams or topics.
mapr copystream
- This utility copies data from one MapR Stream to another MapR Stream. You can use it, for example, if you want to set up replication manually from one stream to another.
mapr diffstreams
- This utility compares the message IDs, metadata, and data in two MapR Streams. Then, generates two directories that contain sequence files that you can use to merge the rows from the two MapR Streams.
mapr diffstreamswithcrc
- This utility uses a cyclic redundancy check to detect differences between sets of messages in the specified MapR Event Store For Apache Kafka. Then, for each set of non-identical messages, it performs a detailed comparison. Finally, it generates one or more directories of sequence files.
mapr exportstream
andmapr importstream
- Use these utilities together to export data from MapR Event Store For Apache Kafka
into binary sequence files, and then import the data from the binary sequence files into other
MapR Event Store For Apache Kafka. You can
also use the
mapr importstream
utility to import changes that are specified in sequence files output by themapr diffstreams
utility. mapr perfconsumer
- This utility runs a consumer reading messages from topics in a MapR Stream. Use this utility to run consumers when you want to estimate the performance of consumers for your MapR Event Store For Apache Kafka applications, given your network configuration.
mapr perfproducer
- This utility runs a producer, generating messages and publishing them to a MapR Stream. Use this utility to run producers when you want to estimate the performance of producers for your MapR Event Store For Apache Kafka applications, given your network configuration.
mapr streamanalyzer
- This light-weight utility, which is a sample application for the
Streams
Java class for analytics on MapR Event Store For Apache Kafka, lets you count the messages in a stream or a subset of the topics in a stream. The utility also lets you print either whole retrieved messages or a subset of the fields in each message.