Is there an internal topic I could consume from to detect when a new topic has been added?
Hi @Taffyb … If I understand correctly, there is not currently a topic like this. I believe the topic creation is currently managed by the direct interaction of Kafka and Zookeeper. In the future, when Zookeeper is replaced by a self-managed quorum, then I believe this kind of thing will be possible on the
@metadata topic. I’m not 100% certain on this and if I can find some details that indicate otherwise I will post it here.
Some details on KIP-500 here: https://www.confluent.io/blog/kafka-2-8-0-features-and-improvements-with-early-access-to-kip-500/
@rick, Thanks. The introduction of topic IDs also looks like a very positive move.