I have a requirement to cont the number of packet for a time period based on certain key and published on a topic once the time period is elapsed. for example i am getting packet in below pattern frequently Rank Time 1 1/10/2021 11:30:00 2 1/11/2021 11:31:00 1 1/10/2021 11:32:00 2 1/11/2021 11:33:…

Thanks for your reply. I am using the suppress but still final data is not holding back for specified window time. Below is my code snipped KStream<String, Message> stream = kStreamsBuilder.stream("IN", Consumed.with(Serdes.String(), CustomSerdes.Message())); KStream<Windowed<String>, Long> windo…

You should use untilWindowCloses() instead of untilTimeLimit().

Thanks mjsax, I have tried with suppress(Suppressed.untilWindowCloses(Suppressed.BufferConfig.unbounded())) but now data is not getting flushed out .

It will get flushed out when stream-time advances beyond window-close time (that is windowd-end plus grace-period). By default, grace-period is set to 24h though. You might want to reduce it via TimeWindows.of(Duration.ofMinutes(60).grace(...)). Also note: it’s not based on wall-clock time; stream-…

Thanks mjsax, After adding grace time it is flushing out correctly.

TimeWindow flushing data instantly

Stream Processing Kafka Streams

mjsax 17 January 2022 18:42 2

You might want to use suppress() operator if you only want to get the final result.

1 Like

Topic		Replies	Views
Kafka Session Windowing Suppress Kafka Streams	3	718	10 May 2024
Tumbling window and suppress Kafka Streams	8	169	8 May 2025
Kafka streams Session Window help Kafka Streams	1	3153	7 December 2022
Window expiration Kafka Streams	3	5451	29 March 2022
More than one "active" tumbling window Kafka Streams	4	45	30 September 2024

TimeWindow flushing data instantly

Related topics