Kafka Single Node

Goal: During development on Kafka streamings, we like to set up single node Kafka broker

Git clone the repo

$ git clone git@github.com:abulbasar/docker-examples.git

$ cd docker-example/kafka-single-node

Build the local docker image and run it using docker-compose. Do not close this terminal. If you want to run the container in background, append -d argument in the docker-compose up command.

$ docker-compose build && docker-compose up

Verify that the container is running

$ docker ps

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

461557deac68 kafka-single-node_broker "bash /start-service…" 8 minutes ago Up 19 seconds 0.0.0.0:2181->2181/tcp, 0.0.0.0:9092->9092/tcp kafka-single-node_broker_1

Launch a new terminal with console consumer. With topic auto creation turned on by default, the topic named sample will be created by default.

$ $ docker exec -it kafka-single-node_broker_1 kafka-console-producer.sh --broker-list kafka:9092 --topic sample

Launch another terminal with producer

$ $ docker exec -it kafka-single-node_broker_1 kafka-console-consumer.sh --bootstrap-server kafka:9092 --topic sample --from-beginning

Note: bootstrap server is the name of the hostname set in the docker-compose.yml file.

Type in a few message in the producer and see those message appear in the console consumer end.