Data Migration From Self Managed Kafka Cluster to Confluent Kafka Cluster

Confluent Cloud
1

I am trying to migrate data from a kafka cluster running within a kubernetes cluster operating using Strimzi to confluent cloud. What would be the best way to go about this?

2

hey @apollo8

welcome :slight_smile:

what about mirror maker?

for reference:

best,
michael

3

Hi Michael,

So I am currently trying to implement mirrormaker2. I am getting the following error:

“Connection to node -1 terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient) [kafka-admin-client-thread | adminclient-1]”

when trying to connect to my Confluent Cloud cluster. Any suggestions? I’m thinking I might need to configure encryption for my Confluent Cloud cluster? If so, how should I go about that?

4

Hi,

connection with command line tools from
the host your running mirrormaker2 is possible?
telnet to confluent cloud endpoint works?

best,
michael

5

another thing to try is

https://docs.confluent.io/platform/current/tutorials/examples/ccloud/docs/replicator-to-cloud-configuration-types.html#replicator-to-cloud-configurations

needs a license afaik

best,
michael