Using Kafka connect to sync DB near real-time

Hello guys! First time here…

I’m implementing a POC to sync a Postgres database with our Redshift Datawarehouse. Our goal is to have the datawarehouse update near real-time (15 minutes SLA). I already made everything using Debezium Postgres Source Connector and JDBC Sink Connector (I didn’t get the Redshift Connector). It’s all working good in development enviroment and I wanna know which configurations, possible errors and any other points that I should be aware to put that in production? What’s the best option to monitor this architecture? Is there some kind of configuration to keep monitoring connector and in case of errors, automatically restart then? I’d like suggestions and tips from anyone that has implemented something like that.

Thank you guys!

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.