Kafka connect s3 Source

Kafka Connect
1

Hello

I have a sink connector pushing data from Kafka to s3 using the TimeBasedPartitioner with YYYY/MM/dd as path.format

I want to backup my events from this s3 bucket by pushing them to backup topics with kafka connect source.

The problem is that my source connector is unable to retrieve all s3 partitions (most of the time, it stops on the first partition)

I don’t have a licence, can it be the cause or any idea?

2

Hi @khouloud . Welcome to the Confluent community forum !!
Is this the connector that you are using : Amazon S3 Source Connector | Confluent Hub ?

3

Hi Thank you @vnadkarni
yes, exactly

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.