Hello experts
I’m trying to replicate between two Confluent cloud Standard clusters using MirrorMaker 2 (I am aware of cluster linking, we need MMK in our instance).
The error I am receiving is:
Could not create topic confluent_cloud_source.topic_name. … org.apache.kafka.common.errors.PolicyViolationException: Topic replication factor must be 3
The replication factor is 3 by default, and I can’t change it even if I wanted.
Connection to the clusters is fine, I can see the heartbeat and checkpoint topics being created.
Here is my config:
Clusters
clusters = confluent_cloud_source, confluent_cloud_target
Confluent Cloud Source Cluster Configuration
confluent_cloud_source.bootstrap.servers = ppp-55555.eastus.azure.confluent.cloud:9092
confluent_cloud_source.security.protocol = SASL_SSL
confluent_cloud_source.sasl.mechanism = PLAIN
confluent_cloud_source.sasl.jaas.config = org.apache.kafka.common.security.plain.PlainLoginModule required
username=“asdasdasd”
password=“asdasdasdasd”;
confluent_cloud_source.replication.factor = 3
confluent_cloud_source.ssl.endpoint.identification.algorithm = https
confluent_cloud_source.client.dns.lookup = use_all_dns_ipsConfluent Cloud Target Cluster Configuration
confluent_cloud_target.bootstrap.servers = ppp-55555.switzerlandnorth.azure.confluent.cloud:9092
confluent_cloud_target.security.protocol = SASL_SSL
confluent_cloud_target.sasl.mechanism = PLAIN
confluent_cloud_target.sasl.jaas.config = org.apache.kafka.common.security.plain.PlainLoginModule required
username=“asdasdasd”
password=“asdasdasdasd”;
confluent_cloud_target.replication.factor = 3
confluent_cloud_target.ssl.endpoint.identification.algorithm = https
confluent_cloud_target.client.dns.lookup = use_all_dns_ipsMirrorMaker 2 Configuration for replication from source to target
confluent_cloud_source->confluent_cloud_target.enabled = true
confluent_cloud_source->confluent_cloud_target.topics = .*
confluent_cloud_source->confluent_cloud_target.topics.exclude = topic-to-exclude-.*Heartbeat Connector (to monitor active replication)
confluent_cloud_source->confluent_cloud_target.emit.heartbeats.enabled = true
confluent_cloud_source->confluent_cloud_target.heartbeats.topic = heartbeatsCheckpoint Connector (to track offsets)
confluent_cloud_source->confluent_cloud_target.emit.checkpoints.enabled = true
confluent_cloud_source->confluent_cloud_target.checkpoints.topic = checkpointsReplication Policy
replication.policy.class = org.apache.kafka.connect.mirror.DefaultReplicationPolicy
Any clues will be highly appreciated, thanks!