# Recording ready to view: SPEAKER Q&A THREAD: 4 November 2023 - Apache Kafka® Scaling & End to End Exactly Once with Flink and Kafka

**URL:** <https://forum.confluent.io/t/recording-ready-to-view-speaker-q-a-thread-4-november-2023-apache-kafka-scaling-end-to-end-exactly-once-with-flink-and-kafka/9159>\
**Category:** Events\
**Created:** [23 November 2023 07:21 UTC](https://forum.confluent.io/t/recording-ready-to-view-speaker-q-a-thread-4-november-2023-apache-kafka-scaling-end-to-end-exactly-once-with-flink-and-kafka/9159 "2023-11-23T07:21:19Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![alice.richardson](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.confluent.io/alice.richardson/32/137_2.png) [@alice.richardson](https://forum.confluent.io/u/alice.richardson)\
**Post date:** [23 November 2023 07:21 UTC](https://forum.confluent.io/t/recording-ready-to-view-speaker-q-a-thread-4-november-2023-apache-kafka-scaling-end-to-end-exactly-once-with-flink-and-kafka/9159/1 "2023-11-23T07:21:19Z")

</div>

**Watch the recording and ask questions about this event in this thread!**

- 🗓 **When** : 4 November 2023 at 05:00 (UTC)

- 🗣 **Speaker(s)**: Thyaga Raja, Mudassir Razvi, Irtebat Shaukat

- 📔 **Talk(s)**:

https://play.vidyard.com/yvA4MLSunUtPGQizP1P443.html?

**Kafka Scaling**

In this session we will cover two topics:

- Kafka Horizontal scaling with Kafka Rebalance
- Kafka Storage downsizing

**End to End Exactly Once with Flink and Kafka**

In this session we will be going over:

1. Introduction

- Brief overview of stream processing.

1. The importance of data correctness and the challenges of ensuring it.
2. Understanding Delivery Semantics

- At-most-once, at-least-once, and exactly-once: What do they mean?
- Why is exactly-once processing hard in distributed systems?

1. Apache Kafka’s Role

- Brief overview of Kafka’s durability guarantees
- Idempotent producer and Transactions in Kafka

1. Apache Flink’s Guarantees :

- Flink’s checkpointing mechanism and distributed snapshots
- TwoPhaseCommitSinkFunction

1. Putting It All Together: End-to-end Exactly-Once with Flink & Kafka ( Under the hood )
2. Q&A Session

📼 Find more Meetups [Meetup Hub](https://cnfl.io/meetup-hub)  
🌍 Join the [Community](https://cnfl.io/community)