Hi all, I find that my connector is run randomly on any nodes in the cluster, how can I make every node in the cluster start one instance of that connector ?
how can I make every node in the cluster start one instance of that connector
Kafka Connect isn’t designed to work like that. If each node ran an instance of the same connector you’d get duplicate data processing.
Can you explain more about the connector(s) you’re running, and why you want to tie execution to given nodes (or run multiple instances of the same) ?
We have a file connector where it will load the file from the node and send the content to Kafka, and we would like to make this feature available to every node.