n99
7 February 2022 21:23
1
Hi
Reading about log compaction on a topic, I was wondering if there is any way to get hold of any of the positions/offsets of the following?
end of the head
start of the tail
compaction cleaner point.
Basically the point at which the compacted and non-compacted parts of the log meet?
Cheers
n99
n99
20 February 2022 15:13
2
Hi
I’m guessing this is not possible?
Cheers
n99
mjsax
22 February 2022 16:18
3
You can alway get topic partitions end and beginning offsets (eg, via AdminClient
or some command line tools; also KafkaConsumer
has this information).
I don’t think that the “compaction cutoff offset” is exposed. But why would you need it?
n99
22 February 2022 16:33
4
Hi Thanks for the reply.
I’ve cross posted here
apache-kafka
and here
https://groups.google.com/g/debezium/c/V5yGD46hfGk
to try and get to the bottom of my use case…
At the moment I’m learning about Connect/Streams and ksqlDb to see if I’m missing a trick here with how kafka works…