Control filename in s3 sink connector

Kafka Connect
1

Hi,
I’m wondering if I can set the file name for something different than:<prefix>/<topic>/year=YYYY/month=MM/day=dd/<topic>+<kafkaPartition>+<startOffset>.<format>
Actually I want to create a file name and in case it is already exists override the old one.
Thanks,
Amir

2

@amir I’m not sure that your specific use case is covered, but I wanted to point you to the S3 documentation around mapping records to S3 objects here.

https://docs.confluent.io/kafka-connect-s3-sink/current/index.html#mapping-records-to-s3-objects

3

Thanks Rick :+1:
Looks like it is not covered…

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.