Setting group.instance.id for Kafka Connect

Kafka Connect
1

I am trying to set the group.instance.id parameter for Kafka Connect connectors so I can utilize Static Membership for the workers.

I believe this parameter has to be unique at the consumer level.

I know for parameters like group.id, we can just set it in the worker.properties file:

group.id=connect-$connectorname # or something

However, where can we set the group.instance.id ? If it is set in the worker.properties file, can it be made unique at the consumer level?

Or do we need to manually set it in the function where the consumer workers and their IDs are created?

I was thinking it would be good to have it be set to the consumer worker id (something like instance-id123, instance-id321, ... but not sure where to add the logic to do that.

2

Any updates on this?

3

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.