Hi. I’ve just installed Confluent and everything was fine. Now I want to do a bit of an advanced thing, in particular, I want to add more “workers” in distributed mode.
I followed this guide and run this command
“bin/connect-distributed worker.properties”, then I added a connector through REST API, and everything was fine.
Now how to add a new worker and run Kafka Connect with 2 workers instead?
In the docs, it said that " Note that if you run many distributed workers on one host machine for development and testing, the
listeners configuration property must be unique for each worker. This is the port the REST interface listens on for HTTP requests"
When I checked the worker.properties file, I can’t find any “listeners” related options. The only thing I found is
"# These are provided to inform the user about the presence of the REST host and port configs
Hostname & Port for the REST API to listen on. If this is set, it will bind to the interface used to listen to requests.
The Hostname & Port that will be given out to other workers to connect to i.e. URLs that are routable from other servers.
So what should I change to add a new worker? I should copy and paste to make 2 worker.properties files, right? The command now should be bin/connect-distributed worker1.properties, worker2.properties, right?