I've a massive amount of lag when i try to consume MM2 replicated topics

Kafka Connect
1

Hey guys, i’ve 2 cluster one is production the other is disaster recovery, i replicate the topics from Prod to DR with same name but when i start to consume DR topics, the consumer doesn’t start from the end but instead, starts from the beginning. How can i make the consumers start from the end.

2

Hi @jumpsrange

welcome to the forum :slight_smile:

You need to enable this feature:

https://cwiki.apache.org/confluence/display/KAFKA/KIP-545%3A+support+automated+consumer+offset+sync+across+clusters+in+MM+2.0

hth,
michael

3

Thanks for the help, I did add that property to my config file but still didn’t fix the issue.