am in the process of setting up an active-passive Kafka cluster and am using MirrorMaker 2 (MM2) for replicating topics between the source and destination clusters. My setup includes:
- Source Cluster: Kafka brokers running with SSL in Kraft mode.
- Destination Cluster: Kafka brokers running with SSL in Kraft mode.
- MirrorMaker 2: Running on a separate VM.
I am trying to replicate an existing topic from the source cluster to the destination cluster. However, I am encountering an issue where MirrorMaker 2 is not respecting the group ID and offset configurations. Instead, it seems to be resetting the offsets to the latest even though I have explicitly set auto.offset.reset to earliest in my configuration.
Here is the configuration I am setting
consumer.group.id=mirrormaker2_consumer
consumer.offset.reset = earliest