Kafka Connect S3 - Nothing Getting Written to Bucket

Kafka Connect Self-Managed Connectors
1

Hello! I’m trying to get the S3 Connector working with our MSK cluster using Avro. I’ve got it running, no errors in the connector logs, but nothing is getting written to the S3 bucket. I’ve got the IAM policy specified in the docs, and our MSK cluster does not have auth enabled. Any other ideas?

Here is my configuration:

connector.class=io.confluent.connect.s3.S3SinkConnector,
topics=<topic_name>,
s3.region=<bucket-region>,
s3.bucket.name=<bucket-name>,
flush.size=2,
storage.class=io.confluent.connect.s3.storage.S3Storage,
format.class=io.confluent.connect.s3.format.avro.AvroFormat,
task.class=io.confluent.connect.s3.S3SinkTask
name=s3-sink
schemas.enable=false
schema.compatibility=NONE
2

Was poking around the Kafka Connect API, the plugin is showing up as loaded:

{"class":"io.confluent.connect.s3.S3SinkConnector","type":"sink","version":"10.2.0"}

However I’m just getting an empty list [] when hitting /connectors.

3

Is there by chance a way to get better logging on why the sink is failing to consume messages?