Kafka Postgres Sink Connector Schema Schema{io.debezium.time.Date:INT32} does not correspond to a known timestamp type format

Hello! Need help, I have multiple columns with different time types.

transforms=unwrap,FirstConverter,SecondConverter,ThirdConverter,FourthConverter,FifthConverter,SixthConverter,CreatedConverter,UpdatedConverter
transforms.FirstConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.FirstConverter.format=yyyy-MM-dd

transforms.FirstConverter.field=to_transit_leaving_date

transforms.FirstConverter.target.type=Date

transforms.SecondConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.SecondConverter.format=HH:mm:ss

transforms.SecondConverter.field=to_transit_leaving_time

transforms.SecondConverter.target.type=Time

transforms.ThirdConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.ThirdConverter.format=yyyy-MM-dd

transforms.ThirdConverter.field=leaving_date

transforms.ThirdConverter.target.type=Date

transforms.FourthConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.FourthConverter.format=HH:mm:ss

transforms.FourthConverter.field=leaving_time

transforms.FourthConverter.target.type=Time

transforms.FifthConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.FifthConverter.format=yyyy-MM-dd

transforms.FifthConverter.field=arriving_date

transforms.FifthConverter.target.type=Date

transforms.SixthConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.SixthConverter.format=HH:mm:ss

transforms.SixthConverter.field=arriving_time

transforms.SixthConverter.target.type=Time

transforms.CreatedConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.CreatedConverter.format=yyyy-MM-dd HH:mm:ss

transforms.CreatedConverter.field=created_at

transforms.CreatedConverter.target.type=Timestamp

transforms.UpdatedConverter.type=org.apache.kafka.connect.transforms.TimestampConverter$Value

transforms.UpdatedConverter.format=yyyy-MM-dd HH:mm:ss

transforms.UpdatedConverter.field=updated_at

transforms.UpdatedConverter.target.type=Timestamp

time.precision.mode=connect

I get an error on startup

Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]: [2023-06-01 23:39:35,061] ERROR WorkerSinkTask{id=labor_migration-bus_tickets-sink-01-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:186)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]: org.apache.kafka.connect.errors.ConnectException: Tolerance exceeded in error handler
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndHandleError(RetryWithToleranceOperator.java:178)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execute(RetryWithToleranceOperator.java:104)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.TransformationChain.apply(TransformationChain.java:50)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.WorkerSinkTask.convertAndTransformRecord(WorkerSinkTask.java:513)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.WorkerSinkTask.convertMessages(WorkerSinkTask.java:468)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:324)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:228)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:200)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:184)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at java.base/java.lang.Thread.run(Thread.java:829)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]: Caused by: org.apache.kafka.connect.errors.ConnectException: Schema Schema{io.debezium.time.Date:INT32} does not correspond to a known timestamp type format
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.transforms.TimestampConverter.timestampTypeFromSchema(TimestampConverter.java:413)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.transforms.TimestampConverter.applyValueWithSchema(TimestampConverter.java:375)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.transforms.TimestampConverter.applyWithSchema(TimestampConverter.java:362)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.transforms.TimestampConverter.apply(TimestampConverter.java:279)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.TransformationChain.lambda$apply$0(TransformationChain.java:50)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndRetry(RetryWithToleranceOperator.java:128)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         at org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndHandleError(RetryWithToleranceOperator.java:162)
Jun 01 23:39:35 pg-cdc-1 connect-standalone.sh[138069]:         ... 14 more

what is the problem?

Have you tried a time config other than time.precision.mode=connect?

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.