# Kafka Connect request timeout

**URL:** <https://forum.confluent.io/t/kafka-connect-request-timeout/1311>\
**Category:** Kafka Connect\
**Created:** [25 March 2021 15:21 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311 "2021-03-25T15:21:52Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![shortcode](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@shortcode](https://forum.confluent.io/u/shortcode)\
**Post date:** [25 March 2021 15:21 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/1 "2021-03-25T15:21:53Z")

</div>

I’ve standalone connect and it will consume from external Kafka. connection between servers tested over 9092 port and works.

this line works fine. and returns : 404 connector not exist  
`curl -X GET connectUrl:8084/connectors/connectorName/status | jq `

`curl -d @"/etc/kafka/s3-aa-mapping-sink.json" -H "Content-Type: application/json" -X POST connectUrl:8084/connectors`

`returns 500 {"error_code":500,"message":"Request timed out"}`

connect log:

```auto
[2021-03-25 15:20:13,971] WARN [Producer clientId=producer-3] Got error produce response with correlation id 13934 on topic-partition connect-award-article-mapping-configs-0, retrying (2147469731 attempts left). Error: NOT_ENOUGH_REPLICAS (org.apache.kafka.clients.producer.internals.Sender:595)
[2021-03-25 15:20:14,107] WARN [Producer clientId=producer-3] Got error produce response with correlation id 13935 on topic-partition connect-award-article-mapping-configs-0, retrying (2147469730 attempts left). Error: NOT_ENOUGH_REPLICAS (org.apache.kafka.clients.producer.internals.Sender:595)
[2021-03-25 15:20:14,243] WARN [Producer clientId=producer-3] Got error produce response with correlation id 13936 on topic-partition connect-award-article-mapping-configs-0, retrying (2147469729 attempts left). Error: NOT_ENOUGH_REPLICAS (org.apache.kafka.clients.producer.internals.Sender:595)

```

---

<div class="post-metadata">

**Author:** ![rmoff](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/rmoff/32/3_2.png) [@rmoff](https://forum.confluent.io/u/rmoff)\
**Post date:** [25 March 2021 15:52 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/2 "2021-03-25T15:52:41Z")

</div>

Can you share your connector config please?

---

<div class="post-metadata">

**Author:** ![shortcode](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@shortcode](https://forum.confluent.io/u/shortcode)\
**Post date:** [25 March 2021 16:09 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/3 "2021-03-25T16:09:28Z")

</div>

```
{

  "name": "award-article-mapping",

  "config": {

    "connector.class": "S3SinkConnector",

    "topics": "award-article.link",

    "s3.bucket.name": " ********* t",

    "format.class": "io.confluent.connect.s3.format.parquet.ParquetFormat",

    "parquet.codec": "snappy",

    "storage.class": "io.confluent.connect.s3.storage.S3Storage",

    "flush.size": "2147483647",

    "s3.region": "us-east-2",

    "tasks.max": "3",

    "partition.duration.ms": "3600000",

    "s3.credentials.provider.sts.role.arn": " ********",

    "s3.credentials.provider.class": "io.confluent.connect.s3.auth.AwsAssumeRoleCredentialsProvider",

    "s3.credentials.provider.sts.role.session.name": "kafka-connect-s3-sink",

    "s3.credentials.provider.sts.role.external.id": "kafka-connect-s3-sink",

    "partitioner.class": "io.confluent.connect.storage.partitioner.TimeBasedPartitioner",

    "locale": "en-US",

    "timezone": "UTC",

    "rotate.schedule.interval.ms": "3600000",

    "rotate.interval.ms": "3600000",

    "path.format": "YYYY-MM-dd",

    "timestamp.extractor": "Record"

  }

}

```

---

<div class="post-metadata">

**Author:** ![rmoff](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/rmoff/32/3_2.png) [@rmoff](https://forum.confluent.io/u/rmoff)\
**Post date:** [25 March 2021 16:48 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/4 "2021-03-25T16:48:20Z")

</div>

From your error:

> [@shortcode](#):
>
> connect-award-article-mapping-configs-0, retrying (2147469731 attempts left). Error: NOT\_ENOUGH\_REPLICAS

Are you definitely using standalone mode? This looks like a distributed worker config topic

---

<div class="post-metadata">

**Author:** ![shortcode](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@shortcode](https://forum.confluent.io/u/shortcode)\
**Post date:** [25 March 2021 17:03 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/5 "2021-03-25T17:03:26Z")

</div>

Ahh, yeah it’s distributed. What should I do? I’ve used existing terraform and it was setup whole set Kafka, schema registry, connect, zookeeper.

I just changed bootstrap servers from local to external brokers (3).

In production it’s better to be distributed right?

---

<div class="post-metadata">

**Author:** ![rmoff](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/rmoff/32/3_2.png) [@rmoff](https://forum.confluent.io/u/rmoff)\
**Post date:** [25 March 2021 17:25 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/6 "2021-03-25T17:25:35Z")

</div>

Distributed mode is generally recommended unless you need execution locality (e.g. processing log files / receiving inbound connections on a given host for syslog data etc).

See: [Should you run Kafka Connect in Distributed or Standalone mode? - DEV Community 👩‍💻👨‍💻](https://dev.to/rmoff/should-you-run-kafka-connect-in-distributed-or-standalone-mode-15gn)

Regarding the error, my guess is the internal topic has been created with three replicas but you don’t have that many brokers available. Depending on your situation you may want to run with fewer replicas (e.g. on a sandbox machine and just one broker) or bring up more brokers (if there should be three).

See [Worker Configuration Properties | Confluent Documentation](https://docs.confluent.io/platform/current/connect/references/allconfigs.html#distributed-worker-configuration)

---

<div class="post-metadata">

**Author:** ![shortcode](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@shortcode](https://forum.confluent.io/u/shortcode)\
**Post date:** [25 March 2021 18:06 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/7 "2021-03-25T18:06:44Z")

</div>

So this error caused timed out?

---

<div class="post-metadata">

**Author:** ![rmoff](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/rmoff/32/3_2.png) [@rmoff](https://forum.confluent.io/u/rmoff)\
**Post date:** [26 March 2021 09:16 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/8 "2021-03-26T09:16:35Z")

</div>

Yes, if your workers are not correctly configured there’ll not be able to save new connector details to the config topic, and i would expect this kind of error.

---

<div class="post-metadata">

**Author:** ![shortcode](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@shortcode](https://forum.confluent.io/u/shortcode)\
**Post date:** [26 March 2021 11:53 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/9 "2021-03-26T11:53:52Z")

</div>

Updating worker settings helped. Now connectors running but s3 bucket empty. There is no error message on connect logs. Where should I look?

---

<div class="post-metadata">

**Author:** ![rmoff](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/rmoff/32/3_2.png) [@rmoff](https://forum.confluent.io/u/rmoff)\
**Post date:** [26 March 2021 12:04 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/10 "2021-03-26T12:04:45Z")

</div>

If there’s no errors and no data in S3 then it suggests one of:

- Kafka Connect is reading from a different topic
- No [new] data in the source topic
- Data is being written to an S3 bucket other than the one you’re looking in

---

<div class="post-metadata">

**Author:** ![shortcode](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@shortcode](https://forum.confluent.io/u/shortcode)\
**Post date:** [26 March 2021 14:09 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/11 "2021-03-26T14:09:24Z")

</div>

Yeah. there was no messages 🙂  
thanks Robin.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/confluentcommunity/original/1X/c49438c90c9df282e9996fdf6971be890c71b65a.svg) [@system](https://forum.confluent.io/u/system)\
**Post date:** [2 April 2021 14:09 UTC](https://forum.confluent.io/t/kafka-connect-request-timeout/1311/12 "2021-04-02T14:09:58Z")

</div>

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.
