Hi Friends, am new to this community had a question regarding S3 Sink connector, i am trying to use a S3 sink connector to write to a S3 bucket with objects locks enabled (to esnure data is never changed for a particular period of time), but it seems s3 sink connector does not support this configuration. it fails with this error , what I understand S3 requires a ContentMD5 to be sent - io.confluent.connect.s3.format.parquet.ParquetRecordWriterProvider$1.commit(ParquetRecordWriterProvider.java:121)
at io.confluent.connect.s3.format.S3RetriableRecordWriter.commit(S3RetriableRecordWriter.java:55)
… 17 more
Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: Content-MD5 OR x-amz-checksum- HTTP header is required for Put Part requests with Object Lock parameters (Service: Amazon S3; Status Code: 400; Error Code: InvalidRequest; Request ID: ARRFAREC81KY5259; S3 Extended Request ID: Any pointers on resolving this or a workaround ?
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.