Apache Kafka is a distributed streaming platform. It allows you to create publishers, which create data streams, and consumers, which subscribe to and ingest the data streams produced by publishers.
You can use HeavyDB KafkaImporter C++ program to consume a topic created by running Kafka shell scripts from the command line. Follow the procedure below to use a Kafka producer to send data, and a Kafka consumer to store the data, in HeavyDB.
This example assumes you have already installed and configured Apache Kafka. See the Kafka website.
Creating a Topic
Create a sample topic for your Kafka producer.
Run the kafka-topics.sh script with the following arguments: