I have 2 Kafka setup, A and B. A is a cluster with 3 instances running on the same machine, while B is a stand alone in another machine. I tried to use Mirror Maker to replicate from A to B. The config file is as follows:
clusters = A, B A.bootstrap.servers = host1:9091, host1:9092, host1:9093 B.bootstrap.servers = host2:9092 A->B.enabled = true B->A.enabled = false replication.factor = 1 checkpoints.topic.replication.factor=1 heartbeats.topic replication.factor=1 offset-syncs.topic.replication.factor=1 offset.storage.replication.factor=1 status.storage.replication.factor=1 config.storage.replication.factor=1
I execute mirror maker as follows:
But when I run the mirror maker on the ‘B’ side I can see that it keeps creating ‘heartbeats’ topics. So at some point I will end up having so many ‘A.heartbeats’ topic like below. And it will just keep growing until I kill the mirror maker.
A.A.A.A.heartbeats A.A.A.heartbeats A.A.heartbeats A.heartbeats
Anyone know what’s the problem and how to fix this?
Kafka Version: 2.13-2.8