# Replicator creating topics but not migrating topic messages **URL:** \ **Category:** Cluster Replication\ **Created:** [3 November 2023 03:49 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992 "2023-11-03T03:49:28Z")\ **Posts on this page:** 16\ **Page:** 1
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [3 November 2023 03:49 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/1 "2023-11-03T03:49:28Z")
What are the things to check when the replicator is not migrating the topic messages from the source to destination? - replicator pod logs dont have any errors - replicator is creating the topic in the destination cluster from the source cluster - Able to produce messages from a kafka producer running on the same namespace as replicator - Checked `__consumer_offsets` topic and I see that the messages are consumed from the source cluster. replicator is also finding the topic. log has it. `[INFO] 2023-10-30 11:17:21,939 [topic-monitor-thread-replicator] io.confluent.connect.replicator.NewTopicMonitorThread listMatchingTopics - Found matching topics: [replicator-test-source, __consumer_timestamps]` Followed [Replicator Readme](https://github.com/confluentinc/confluent-kubernetes-examples/blob/45331dfab5d08e8513b5532016a9c9b7b7e1553e/hybrid/replicator/README.md) to set up replicator in k8s The kafka server log also doesnt have error… `[2023-10-30 08:42:09,331] INFO [Admin Manager on Broker 201]: Updating topic replicator-test-source-1 with new configuration : message.timestamp.type -> CreateTime,segment.bytes -> 100000000,flush.messages -> 10000,unclean.leader.election.enable -> true,min.insync.replicas -> 2 (kafka.server.AdminManager) [2023-10-30 08:42:09,343] INFO Processing notification(s) to /config/changes (kafka.common.ZkNodeChangeNotificationListener) [2023-10-30 08:42:09,346] INFO Processing override for entityPath: topics/replicator-test-source-1 with config: Map(message.timestamp.type -> CreateTime, segment.bytes -> 100000000, flush.messages -> 10000, unclean.leader.election.enable -> true, min.insync.replicas -> 2) (kafka.server.DynamicConfigManager)` ---
**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\ **Post date:** [3 November 2023 08:16 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/2 "2023-11-03T08:16:31Z")
hey @dasasathyan your configuring replicator from an onprem cluster to confluent cloud right? has the topic been created on the dest cluster? best, michael ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [3 November 2023 08:24 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/3 "2023-11-03T08:24:58Z")
hey @mmuehlbeyer We are migrating from 2 different clusters running onprem not confluent cloud. Yes. The topic is created in the destination cluster. ---
**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\ **Post date:** [3 November 2023 08:28 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/4 "2023-11-03T08:28:12Z")
any errors in the dest cluster so far? ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [3 November 2023 08:29 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/5 "2023-11-03T08:29:19Z")
Nope… Its completely clean ---
**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\ **Post date:** [3 November 2023 08:40 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/6 "2023-11-03T08:40:26Z")
ok could you share your replicator config? is the topic compacted? what about the connect rest api, any errors there? ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [3 November 2023 08:54 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/7 "2023-11-03T08:54:18Z")
> **Replicator Config** > > ```auto > apiVersion: platform.confluent.io/v1beta1 > kind: Connector > metadata: > name: replicator > namespace: destination > spec: > name: replicator > class: "io.confluent.connect.replicator.ReplicatorSourceConnector" > taskMax: 4 > configs: > topic.whitelist: "replicator-test-source-1" > confluent.topic.replication.factor: "3" > dest.kafka.bootstrap.servers: "" > dest.kafka.security.protocol: "SSL" > dest.kafka.ssl.truststore.location: "/mnt/sslcerts/ssl-certs/truststore.jks" > dest.kafka.truststore.password: "" > dest.kafka.sasl.mechanism: "PLAIN" > dest.kafka.sasl.jaas.config: "org.apache.kafka.common.security.plain.PlainLoginModule required username=\"admin\" password=\"\";" > dest.kafka.reconnect.backoff.ms: "600000" > dest.kafka.request.timeout.ms: "600000" > provenance.headetelr.enable: "true" > key.converter: "io.confluent.connect.replicator.util.ByteArrayConverter" > src.consumer.group.id: "replicator-test-source-1-group" > src.kafka.timestamps.topic.replication.factor: "3" > src.kafka.sasl.mechanism: "PLAIN" > src.kafka.ssl.truststore.location: "/mnt/sslcerts/ssl-certs/broker.jks" > src.kafka.truststore.password: "" > src.kafka.bootstrap.servers: "" > src.kafka.security.protocol: "SSL" > value.converter: "io.confluent.connect.replicator.util.ByteArrayConverter" > ssl.endpoint.identification.algorithm: "" > src.kafka.ssl.endpoint.identification.algorithm: "" > dest.kafka.ssl.endpoint.identification.algorithm: "" > connectRest: > tls: > secretRef: ssl-certs > > ``` This is just a test topic, so havent compacted it. Connect Rest APIs just have a couple of health checks with 200s. ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [6 November 2023 05:10 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/8 "2023-11-06T05:10:46Z")
@mmuehlbeyer Are the source and destination clusters required to be Confluent Kafka, or does it matter if they are Apache Kafka? Does this distinction make any impact? My clusters are on Apache Kafka ---
**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\ **Post date:** [8 November 2023 07:25 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/9 "2023-11-08T07:25:41Z")
hi @dasasathyan basically it should work with Apache Kafka as well. Best, Michael ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [8 November 2023 07:29 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/10 "2023-11-08T07:29:05Z")
Thanks Michael. Did you by any chance find anything wrongly configured with the replicator? ---
**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\ **Post date:** [8 November 2023 07:43 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/11 "2023-11-08T07:43:10Z")
no obvious errors at all. did you produce some messages to the topic as well? best, michael ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [8 November 2023 07:52 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/12 "2023-11-08T07:52:32Z")
Yup. I did… I produced with kafka-producer-perf-test as per [https://github.com/confluentinc/confluent-kubernetes-examples/blob/45331dfab5d08e8513b5532016a9c9b7b7e1553e/hybrid/replicator/secure-producer-app-data.yaml](https://github.com/confluentinc/confluent-kubernetes-examples/blob/45331dfab5d08e8513b5532016a9c9b7b7e1553e/hybrid/replicator/secure-producer-app-data.yaml) I produced it from the same namespace as replicator and the messages are being produced… ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [10 November 2023 07:31 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/13 "2023-11-10T07:31:58Z")
@mmuehlbeyer any suggestions here? Also, Is there any paid support that I can get from Confluent for this particular issue alone? ---
**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\ **Post date:** [4 December 2023 07:29 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/14 "2023-12-04T07:29:02Z")
you might reset the offset for the consumer or set it to a specific one ---
**Author:** ![dasasathyan](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dasasathyan/32/3319_2.png) [@dasasathyan](https://forum.confluent.io/u/dasasathyan)\ **Post date:** [6 December 2023 05:33 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/15 "2023-12-06T05:33:02Z")
Hi @mmuehlbeyer I have tried it with a new consumer group altogether so that the messages are consumed from 0th offset again. Still no luck. ---
**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\ **Post date:** [18 December 2023 08:05 UTC](https://forum.confluent.io/t/replicator-creating-topics-but-not-migrating-topic-messages/8992/16 "2023-12-18T08:05:13Z")
hey @dasasathyan another try maybe with demo here: > > > //github.com/confluentinc/examples/tree/latest/multi-datacenter