Duplicate value is getting stored issue

Stream Processing
1

I was analyzing my streamer pod heap dump.I noticed that duplicate values are getting stored.

image
image865×459 16.4 KB

I am wondering why it has stored highlighted data in both string and utf8 format.

Duplicate data store is adding upto memory issue.

Wanted to understand what could be the reason behind?

2

You should ask this question to Avro developers since this isn’t a Kafka issue.

But, per my understanding of your output , any String type has underlying bytes array that represents it. It’s not duplicated