I want data in my Kafka topic to be delivered to the S3 Bucket every 15 minutes, no matter how much data was generated
I have to specify a flush.size to to some super-high number that’s far more than the number of messages I’m likely to see in any given 15 minutes interval
I set rotate.interval.ms=900000
Should i be setting rotate.schedule.interval.ms=900000 if i want it to be delivered every 15 mins, regardless of the timestamp in the data?