Seperate worker config

Kafka Connect
1

I currently have 2 workers set up that round robin on two linux servers. I currently have 3 ES-connectors set up running properly.

I would like to set up a third worker that runs separately from these two workers but connects to the same kafka instance for testing purposes. In the worker config for this server I will be changing the the group.id.

My question is should I create different topics for the below or can you use the same topics. Does this effect anything?
offset.storage.topic
config.storage.topic
status.storage.topic

2

If you’re creating a new cluster (group.id) then you must use a new set of topics for it.

See also Common mistakes made when configuring multiple Kafka Connect workers

3

Great. Thank you for that document. That clears it up.

4

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.