I have a JDBC connector on an oracle base, however, sometimes the connector stops receiving data from the DB. Sometimes the task indicates an error, sometimes not.
The only way I found to solve this problem was to restart the task at timed intervals. Considering that, is there any way to do this directly in Kafka, more specifically in the source connector yaml?
There’s not. A cron job, or consuming the Connect status topic and listening for failed tasks, is the most direct way to get notified/restart.
You can use JMX monitoring to also get count of failed tasks over time and plot them in Grafana, for example, and use Prometheus alertmanager for notification triggering
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.