šŸŽ§ Distributed Systems Engineering with Apache Kafka ft. Guozhang Wang

Thereā€™s a new Streaming Audio episode - check it out!

Tim Berglund picks the brain of a distributed systems engineer, Guozhang Wang, tech lead in the Streaming department of Confluent. Guozhang explains what compelled him to join the Stream Processing team at Confluent coming from the Apache KafkaĀ®Ā  core infrastructure. He reveals what makes the best distributed systems infrastructure engineers tick and how to prepare to take on this kind of roleā€”solving failure scenarios, a satisfying challenge.Ā 

One challenge in distributed systems is achieving agreements from multiple nodes that are connected in a Kafkacluster, but the connection in practice is asynchronous.

Guozhang also shares the newest updates in the Kafka community, including the coming ZooKeeper-free architecture where metadata will be maintained by Kafka logs.

Prior to joining Confluent, Guozhang worked for LinkedIn, where he used Kafka for a few years before he started asking himself, ā€œHow fast can I get value from the data that Iā€™ve collected?ā€ This question eventually led him to begin building Kafka Streams and ksqlDB. Ever since, heā€™s been working to advance stream processing, and in this episode, provides an exciting preview of whatā€™s to come.Ā 

EPISODE LINKS


:headphones: Listen to the episode