HI my connector run in a distributed cluster, as single instance ( task.max=1 ) , say if the server running source task down, it is failover to the other server, and I would like the source task running at the new server pick up from where the first server down. There is a sequence number to indicate that, not sure how should I implement that?
Can I stamp the sequence number to the message published and I can get the latest message to get back the sequence number? Or I can just store the sequence number to kafka and retrieve it back? It look like there the offset is not related as there are multiple partition.