# Getting below exception in kafka s3 sink connector

**URL:** <https://forum.confluent.io/t/getting-below-exception-in-kafka-s3-sink-connector/11185>\
**Category:** Kafka Connect\
**Created:** [5 August 2024 11:56 UTC](https://forum.confluent.io/t/getting-below-exception-in-kafka-s3-sink-connector/11185 "2024-08-05T11:56:37Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![atish.kulkarni11](https://avatars.discourse-cdn.com/v4/letter/a/b38774/32.png) [@atish.kulkarni11](https://forum.confluent.io/u/atish.kulkarni11)\
**Post date:** [5 August 2024 11:56 UTC](https://forum.confluent.io/t/getting-below-exception-in-kafka-s3-sink-connector/11185/1 "2024-08-05T11:56:37Z")

</div>

Getting the below exception using s3 sink connector, due to the nature of our data we can not specify the schema of JSON.  
hence changed value.converter.schemas.enable=false but still getting below exception

\ ***exception**  
org.apache.kafka.connect.errors.ConnectException: Exiting WorkerSinkTask due to unrecoverable exception.  
at org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:611)  
at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:333)  
at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:234)  
at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:203)  
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:189)  
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:244)  
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)  
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)  
at java.base/java.lang.Thread.run(Thread.java:840)  
Caused by: java.lang.NullPointerException: Cannot invoke “org.apache.kafka.connect.data.Schema.type()” because “schema” is null  
at io.confluent.connect.s3.format.parquet.ParquetRecordWriterProvider.schemaHasArrayOfOptionalItems(ParquetRecordWriterProvider.java:142)  
at io.confluent.connect.s3.format.parquet.ParquetRecordWriterProvider$1.write(ParquetRecordWriterProvider.java:90)  
at io.confluent.connect.s3.format.S3RetriableRecordWriter.write(S3RetriableRecordWriter.java:51)  
at io.confluent.connect.s3.format.KeyValueHeaderRecordWriterProvider$1.write(KeyValueHeaderRecordWriterProvider.java:114)  
at io.confluent.connect.s3.TopicPartitionWriter.writeRecord(TopicPartitionWriter.java:594)  
at io.confluent.connect.s3.TopicPartitionWriter.checkRotationOrAppend(TopicPartitionWriter.java:329)  
at io.confluent.connect.s3.TopicPartitionWriter.executeState(TopicPartitionWriter.java:269)  
at io.confluent.connect.s3.TopicPartitionWriter.write(TopicPartitionWriter.java:220)  
at io.confluent.connect.s3.S3SinkTask.put(S3SinkTask.java:247)  
at org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:581)  
… 10 more

**config\_json**  
Please assume the AWS-related values are configured correctly.  
{  
“name”: “s3-sink-connector”,  
“config”: {  
“connector.class”: “io.confluent.connect.s3.S3SinkConnector”,  
“tasks.max”: “1”,  
“topics”: “topicname”,  
“s3.region”: “regin\_name”,  
“s3.bucket.name”: “bucket\_name”,  
“format.class”: “io.confluent.connect.s3.format.parquet.ParquetFormat”,  
“schema.compatibility”: “BACKWARD”,  
“parquet.codec”: “snappy”,  
“flush.size”: “1000”,  
“aws.access.key.id”: “sample\_key”,  
“aws.secret.access.key”: “sample\_secret”,  
“storage.class”: “io.confluent.connect.s3.storage.S3Storage”,  
“key.converter”:“org.apache.kafka.connect.json.JsonConverter”,  
“key.converter.schemas.enable”:“false”,  
“value.converter”: “org.apache.kafka.connect.json.JsonConverter”,  
“value.converter.schemas.enable”: “false”  
}  
}

any help is appreciated thanks in advance,

---

<div class="post-metadata">

**Author:** ![dtroiano](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/dtroiano/32/1961_2.png) [@dtroiano](https://forum.confluent.io/u/dtroiano)\
**Post date:** [6 August 2024 17:17 UTC](https://forum.confluent.io/t/getting-below-exception-in-kafka-s3-sink-connector/11185/2 "2024-08-06T17:17:49Z")

</div>

This converter / format combination [isn’t supported](https://docs.confluent.io/kafka-connectors/s3-sink/current/overview.html#s3-object-formats):

> You must use the `AvroConverter`, `ProtobufConverter`, or `JsonSchemaConverter` with `ParquetFormat` for this connector. Attempting to use the `JsonConverter` (with or without schemas) results in a NullPointerException and a StackOverflowException.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/confluentcommunity/original/1X/c49438c90c9df282e9996fdf6971be890c71b65a.svg) [@system](https://forum.confluent.io/u/system)\
**Post date:** [14 August 2024 05:27 UTC](https://forum.confluent.io/t/getting-below-exception-in-kafka-s3-sink-connector/11185/3 "2024-08-14T05:27:25Z")

</div>

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.