We have several scenarios where data is being produced to kafka (source data) and it goes through several operations before landing on a final topic which is loaded into a SQL database with a JDBC connector. I have implemented an audit solution to support reconciliation that messages sent have made it to their destination. I am trying to find a way to produce an audit message after each message is sinked or perhaps just route the original message to a new topic after it is successfully sinked so I can confirm the source data made it to the target db. I’m wondering if there is a post-sink hook in the connect architecture I can use to do this.
@rmoff Any thoughts on this?