Would anyone know if there is anyway to guarantee ordering of messages across partition? We need to implement “atleast one” with message ordering but everything I read points to ordering guarantee within partition but not across… Also all the articles are relatively old so I don’t know if there ar…

Hi @iampatelrp , welcome to the forum! Can you expand on why you need strict ordering across partitions? What’s the process/requirement that this is supporting ? Usually strict ordering is needed to support particular business logic which can be enforced by setting the key on messages correctly so …

It is indeed required for business logic. Could you please elaborate further on setting keys on message?

Robin meant that if you use keys on your records, you will be able to control in which partitions your records will end up. Though I’m afraid, this is only partially true. Kafka distributes records across partitions based on the criteria specified via an entity called partitioner. Every producer ha…

[image] iampatelrp: It is indeed required for business logic. Right - can you elaborate on that? Give an example on what your processing is that relies on the strict ordering of all messages?

Thank you for the detailed explanation. I am still reading through the blog post but it is beginning to make sense now. @rmoff Keys on the message is same. For example, Customer 123 spent 34$ at amazon, a minute later spent 40$ at walmart and a second later has a credit of 50$ from Target. Then w…

Ordering of events

Architecture and Design

rmoff 8 December 2021 18:53 7

So long as your message key is the customer ID, and within the constraints of what @riferrei describes, then yes you do have a guarantee of ordering.

Topic		Replies	Views
What should I use as the key for my Kafka message? Architecture and Design	2	51090	9 February 2021
Kafka Strict Ordering via SINGLE PARTITION and MULTIPLE PARTITION Strategies Lounge	6	5156	4 January 2022
Kafka ordering (Single partition Vs Multiple partitions) Lounge	3	4468	21 December 2021
Adding new partition to a keyed topic Architecture and Design	1	3255	4 September 2022
Guaranteed Ordering Kafka Streams	0	1944	9 June 2023

Ordering of events

Related topics