# Kafka Topic data File extension issue in AWS S3 Bucket

**URL:** <https://forum.confluent.io/t/kafka-topic-data-file-extension-issue-in-aws-s3-bucket/3132>\
**Category:** Kafka Streams\
**Created:** [19 October 2021 04:26 UTC](https://forum.confluent.io/t/kafka-topic-data-file-extension-issue-in-aws-s3-bucket/3132 "2021-10-19T04:26:18Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![ramakrishna](https://avatars.discourse-cdn.com/v4/letter/r/4491bb/32.png) [@ramakrishna](https://forum.confluent.io/u/ramakrishna)\
**Post date:** [19 October 2021 04:26 UTC](https://forum.confluent.io/t/kafka-topic-data-file-extension-issue-in-aws-s3-bucket/3132/1 "2021-10-19T04:26:18Z")

</div>

Hello

I am trying to insert JSON data present in kafka topic into AWS S3 bucket.

As per configuration data is getting streamed into S3 bucket but i am facing issue file extension.

In S3 bucket data is inserted in .bin extension but expecting extension is .json

What chnaged need to be done to make extension of data getting inserted into s3 in json extension

 ![S3-Bucket](https://us1.discourse-cdn.com/flex019/uploads/confluentcommunity/original/2X/b/bb074c3dff0ee9306d279875dc7e4be767cc95ff.jpeg)

.

---

<div class="post-metadata">

**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\
**Post date:** [19 October 2021 06:21 UTC](https://forum.confluent.io/t/kafka-topic-data-file-extension-issue-in-aws-s3-bucket/3132/2 "2021-10-19T06:21:47Z")

</div>

Hi

could give some details about how you write the data to your S3 bucket?

According to the file name I assume you are using Kafka connect, correct?

---

<div class="post-metadata">

**Author:** ![ramakrishna](https://avatars.discourse-cdn.com/v4/letter/r/4491bb/32.png) [@ramakrishna](https://forum.confluent.io/u/ramakrishna)\
**Post date:** [19 October 2021 06:45 UTC](https://forum.confluent.io/t/kafka-topic-data-file-extension-issue-in-aws-s3-bucket/3132/3 "2021-10-19T06:45:42Z")

</div>

Hi

I am loading JSON data into Kafka topic has object type using below command

./bin/kafka-console-producer --broker-list localhost:9092 --topic connect-test --property value.schema=‘{“type”:“object”,“name”:“myrecord”,“fields”:[{“name”:“f1”,“type”:“string”}]}’

input values :  
{“f1”: “value1”}  
{“f1”: “value2”}  
{“f1”: “value3”}

S3-sink config :  
name=s3-sink  
connector.class=io.confluent.connect.s3.S3SinkConnector  
tasks.max=1  
topics=connect-test  
connector.class=io.confluent.connect.s3.S3SinkConnector  
s3.credentials.provider.class=com.amazonaws.auth.DefaultAWSCredentialsProviderChain  
s3.region=us-east-2  
s3.bucket.name=snowflakelab2  
s3.part.size=5242880  
flush.size=3  
#s3.credentials.provider.class=AwsAssumeRoleCredentialsProvider  
s3.credentials.provider.access\_key\_id =  
s3.credentials.provider.secret\_access\_key =  
sts.role.arn =  
sts.role.session.name = mysnowflakerole  
format.class=io.confluent.connect.s3.format.bytearray.ByteArrayFormat  
value.converter=org.apache.kafka.connect.converters.ByteArrayConverter  
storage.class=io.confluent.connect.s3.storage.S3Storage  
#format.class=io.confluent.connect.s3.format.avro.AvroFormat  
#value.converter.schema.registry.url = [http://localhost:8081](http://localhost:8081)  
#format.class=io.confluent.connect.s3.format.json.JsonFormat  
partitioner.class=io.confluent.connect.storage.partitioner.DefaultPartitioner  
#partitioner.class=io.confluent.connect.storage.partitioner.TimeBasedPartitioner  
schema.generator.class = io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator  
schema.compatibility=NONE  
#partition.field.name=  
#partition.duration.ms=  
#path.format=  
#locale=  
#timezone=

---

<div class="post-metadata">

**Author:** ![mmuehlbeyer](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/mmuehlbeyer/32/1088_2.png) [@mmuehlbeyer](https://forum.confluent.io/u/mmuehlbeyer)\
**Post date:** [19 October 2021 07:52 UTC](https://forum.confluent.io/t/kafka-topic-data-file-extension-issue-in-aws-s3-bucket/3132/4 "2021-10-19T07:52:08Z")

</div>

I see, I would recommend to try the following

`format.class=io.confluent.connect.s3.format.json.JsonFormat`

and remove

> [@ramakrishna](#):
>
> value.converter=org.apache.kafka.connect.converters.ByteArrayConverter

hth,  
michael

---

<div class="post-metadata">

**Author:** ![ramakrishna](https://avatars.discourse-cdn.com/v4/letter/r/4491bb/32.png) [@ramakrishna](https://forum.confluent.io/u/ramakrishna)\
**Post date:** [19 October 2021 08:04 UTC](https://forum.confluent.io/t/kafka-topic-data-file-extension-issue-in-aws-s3-bucket/3132/5 "2021-10-19T08:04:27Z")

</div>

ok will give it a try let you know if I face any issue.

Thanks  
Rama