Need end receiving data to be in key-value pair format so that the data will get distributed between all 3 kafka partitions evenly

Kafka Connect
1

End receiving data only contains the Value (not key-value pair) due to which all the records get published to only one partition out of 3 for the endpoint topic.

Need enhancement so that end receiving data to be in key-value pair format so that the data will get distributed between all 3 kafka partitions evenly.

We need Key and Value to be separated As of now we are receiving it as combined output

Could someone please suggest as how we can achieve this?.

Data Output
Data Output1152×648 5.9 KB

2

Kafka stores bytes; it does not care how data is formatted.

If you cannot change your producer code, then use Kafka Streams , ksqlDB, or other consumer/producer pair to modify your records to format you expect.

3

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.