Kafka Design Documents

I have been rummaging through Kafka’s Confluence knowledge base to find systematically arranged design documents of Kafka - about how each of the components is designed, what reviews did the design go through, and similar stuff. Can anyone point me to such a thing if it does exist?


I guess the best thing that comes close is taking a look at the KIP’s. It’s not really structured through. Anything specific you are looking for? There are also a couple of great videos on youtube about the Kafka internals.

1 Like

You can also take a look at:

Notably the Kafka Summit videos & talks cover a lot of Kafka internals.

Thank you, appreciate the respone. I am looking to contribute to Kafka and I was wondering if there are certain areas whose design have been documented, so that they become an easy target for me to pursue for contribution.