Installing Kafka with Zookeeper

Tools Command Line tools
1

Hi,
Learning Kafka and need a little help with installing Zookeeper and Kafka on my Mac (V12.01)

I’ve installed Zookeeper from Brew
I’ve installed kafka from Brew.

Was trying to call the following command:

kafka-topics --create --topic rameTest --bootstrap-server 127.0.0.1:2181

and I get the following error:

ERROR org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: createTopics
 (kafka.admin.TopicCommand$)

Is there any configuration setting I need to do to kafka to link Zookeeper?

Thank you for the help

2

Hi @dramer

welcome to the forum :slight_smile:

some questions to better understand your starting point

  • did you check whether kafka and zookeeper are running?
  • did you check the logfiles of kafka and zookeeper?

best,
michael

3

Thank you so much for the help.

Once Zookeeper is installed it tells you how to start it…

To start zookeeper now and restart at login:

brew services start zookeeper

Or, if you don’t want/need a background service you can just run:

zkServer start

Davids-MacBook-Pro:~ davidramer$ zkServer start

ZooKeeper JMX enabled by default

Using config: /usr/local/etc/zookeeper/zoo.cfg

Starting zookeeper ... STARTED


 ps -rf | grep zookeeper
  501 64128 61231   0  3:18PM ttys000    0:00.00 grep zookeeper

then installed Kafka and restated it

Davids-MacBook-Pro:~ davidramer$ brew services restart kafka

==> **Tapping homebrew/services**

Cloning into '/usr/local/Homebrew/Library/Taps/homebrew/homebrew-services'...

remote: Enumerating objects: 1930, done.

remote: Counting objects: 100% (437/437), done.

remote: Compressing objects: 100% (173/173), done.

remote: Total 1930 (delta 308), reused 318 (delta 258), pack-reused 1493

Receiving objects: 100% (1930/1930), 533.96 KiB | 0 bytes/s, done.

Resolving deltas: 100% (863/863), done.

Tapped 1 command (45 files, 683.3KB).

==> Successfully started kafka (label: homebrew.mxcl.kafka)

4

Not sure where the log file is to review? can you point me to it?

5

thanks for the information

I guess there should be directory
like /usr/local/etc/kafka there should be a log4j conf (not sure if it’s there in homebrew installations but in vanilla kafka installation there is one :wink: )

btw just discovered that you’ve used the zookeeper default port to connect to the cluster

would you please try the following:
kafka-topics --create --topic rameTest --bootstrap-server 127.0.0.1:9092

hth,
michael

6

FIXED… Thank you so much…

Davids-MacBook-Pro:bin davidramer$ kafka-topics --create --topic rameTest --bootstrap-server 127.0.0.1:9092

Created topic rameTest.