Is it possible to remove some of the data in kafka topics?

Hi all,
kafka newbie here.
I have a use case where in We might have to delete some of the data in the kafka topics, something that might be in the middle , not necessarily from the beginning. Is there a way to do it?
THanks!
AKK

If the topic has a a compacted topic (Apache Kafka, Apache Kafka) you can tombstone messages (but that doesn’t mean old values for that key will be immediately removed (they are just available to be removed).

Check out https://www.confluent.io/blog/handling-gdpr-log-forget/.

If eludes to the idea of encrypting the data that needs to able to be forgotten and then throw away the keys and you have, provided your keys are not compromised, made the data not-readable.

1 Like