Watch the recording and ask @pneff93 questions about this event in this thread!
-
When: 30 March 2022 at 16:00 (UTC) -
Speaker(s): Patrick Neff -
Talk(s): Think of Using ksqlDB Before Using Kafka Streams
Resources
[Slides]
A streaming data pipeline typically consists of data transformation, wrangling, and (time-based window) aggregation. On top of that, we must also guarantee data integrity. One might think of Kafka Streams to solve all these challenges, and it is definitely a good choice. However, in many cases, ksqlDB queries are simpler, faster to implement, and work fine.
In this session, a live demo for an IoT data pipeline is presented and executed with both frameworks - Kafka Streams and ksqlDB. We look at Kafka Streams topology patterns, focus on ksqlDB aggregation and scalar functions - such as lambda functions - talk about great feature releases as well as explain how to work with Confluent Schema Registry in Kafka Streams and ksqlDB.
Finally, takeaways are provided about ksqlDB’s advantages, drawbacks, limitations, and edge cases from personal experience.
Find more Meetups Meetup Hub
Join the Community