Practical Data Pipeline Demo

@jamesgollan gave a presentation last week to the Data Engineering Melbourne meetup. In his presentation, James gave a practical and easy to follow demonstration of a streaming pipeline. His example of a customer 360 application involved multiple sources of data, including MySQL, and CSV files. Next, there was a series of processing steps using ksqlDB. Finally, the end results are sent out to MongoDB and Snowflake using Kafka Connect.

James provides a very clear walkthrough of the application design and implementation using his unique hand-drawn presentation style.

Check out the video on youtube, and also keep an eye on the Meetup Hub for more presentations by James Gollan.

1 Like