Know Your Topics – A Deep Dive on Topic IDs with KIP-516
Date : April 25, 2022
Time : 3:00 PM - 3:45 PM BST
Speakers:
- Justine Olshan, Backend Software Engineer, Confluent
Abstract:
When Apache Kafka® was first created, topics were identified solely by topic name—but this isn’t always sufficient. Find out in this talk why the Kafka community decided to add topic IDs to Kafka as a part of KIP-516. Learn which new features related to topic IDs have been rolled out, and learn about some of the benefits that are still on the way.
We’ll be covering new features in Kafka versions 2.8, 3.0, and 3.1 and how to upgrade to using topic IDs. We’ll see how topic IDs are used in KRaft mode and tiered storage, and take a tour through some of the internals and the thought processes around these changes—as well as some of the future plans for topic IDs.