How can we make sure EoS in read-process scenario. read means we are reading from Kafka topic and doing some processing and then we are trying to commit the offset. Lets suppose, we processed the messages but could not able to commit and before commit the process crashed. after restart, again tryin…

EoS functionality is controlled on the write side much like a database transaction: you write records in a transaction then commit the transaction at an appropriate safepoint. Reading data is slightly different to a database as Kafka is asynchronous meaning you use strongly ordered processing of eve…

Can we apply EoS in read-process scenario as well?

Ops

system Closed 19 August 2022 05:17 3

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
How to Handle Kafka message offsets while using with Entity Framework Core Exception Confluent Cloud	0	2882	18 May 2022
Manually commit offset to prevent restart loop Kafka Streams	0	2930	6 September 2022
Why am I getting InvalidProducerEpochException when no producer is used? Kafka Streams	11	14357	5 November 2021
Exactly once processing and Stateful Processors Stream Processing	22	2758	19 March 2024
Streams app with EOS gets stuck restoring after upgrade to 2.8 Kafka Streams	3	5637	27 August 2021

Can we apply EoS in read-process scenario as well?

Related topics