Chaos Testing - Rest Proxy returns success but messages not written to Kafka

Clients REST Proxy
1

Hi All,

We are doing some chaos testing where we are feeding data to Kafka brokers through rest proxy and then suddenly stopping the brokers etc and checking the failover time.

Some behaviour that I am observing is sometimes during the test we have missing messages. The rest proxy is giving us 200 but the messages are not produced in the topic.

We are using acks=all.

How can we change the behaviour of rest proxy where if it fails producing to topic it returns a non 200 status code so that the non Java producer can retry.

2

Hi Sukalpo, if there are errors (e.g. produce errors), you will still get a HTTP 200 response but the response body will include an error code and message - see the “Response JSON Array of Objects” section at this link: Confluent REST Proxy API Reference | Confluent Documentation

2 Likes
3

Hi @kaijunxu, Thanks for the response. Makes sense. I will revert here after we retest and we change our script to parse the response.

4

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.