Validate Kafka
Use the following procedure to verify the Kafka installation and configuration.
Before you begin:
Verify that ZooKeeper is running before starting Kafka and validating the installation.
Set KAFKA_HOME to /usr/hdf/current/kafka-broker.
Start the Kafka service using user kafka:
su kafka -c "KAFKA_HOME/bin/kafka start"
Create a Kafka topic with the name "test" that has a replication factor of 1 and 1 partition.
bin/kafka-topics.sh --zookeeper localhost:2181 --create --topic test --replication-factor 1 --partitions 1
After running this command, you should see the following output:
Created topic "test"
Note The value of
--replication-factor
must be less then or equal to the number of Kafka brokers in the cluster. Otherwise an error occurs. Usually the replication-factor equals the number of Kafka brokers in the cluster.Start a command line Kafka console producer that you can use to send messages. You can type your message once the process is started.
<KAFKA_HOME>/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
You should see your test message, for example:
This is a message.
Note To return to the command prompt after sending the test message, type Ctrl + C.
Start a command line kafka consumer that you can use to read the messages sent by the producer.
<KAFKA_HOME>/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning