I am looking for some general guidance/advice as to what the best practices might be as far as defining the different aspects of Kafka Connect (i.e. - # of connect clusters, cluster isolation characteristics, connector per cluster, etc…)
I have been exploring a simple scenario, in our use case, where we want to leverage a debezium source connector to monitor a few tables in a mysql source database then leverage a http sink connector to push that data out to some other external source systems. For this particular scenario, I am planning on defining two connect workers in a single connect cluster running a source connector and sink connector.
I have observed a few examples online where the configuration depicted a separate cluster for each connector type.
Are there any guidelines/best practices around configuration of the cluster and the connectors? When would it make sense to split out the different connectors into their own cluster?