Amazon S3 Sink Connector - offset

Kafka Connect
1
  • Does Amazon S3 Sink Connector support including Kafka offset and partition in event while saving in s3 file
  • Is there any way to modify the s3 sink connector to include Kafka offset and partition value with each record to output file
2

Hi there! in the documentation on this connector, it says

the key name encodes the topic, the Kafka partition, and the start offset of this data chunk.

So it would seem this info is included in the key name of the event by default.

Note this though: the offset recorded is the start offset of the chunk of data being sent to S3.

3

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.