I’m maintaining a streaming data system with Kafka Connect and got struggle when source data is timestampz. The value in message will be come:
"date_txn": "2025-03-05T04:33:45.844195Z"
In schema registry
{
"name": "date_txn",
"type": {
"type": "string",
"connect.version": 1,
"connect.name": "io.debezium.time.ZonedTimestamp"
}
}
My sink connector
{
"connector.class": "io.confluent.connect.jdbc.JdbcSinkConnector",
"transforms.TimestampConverter.target.type": "Timestamp",
"connection.password": "******",
"transforms.TimestampConverter.field": "date_txn",
"tasks.max": "1",
"transforms": "unwrap,TimestampConverter",
"auto.evolve": "true",
"transforms.unwrap.drop.tombstones": "false",
"transforms.unwrap.type": "io.debezium.transforms.ExtractNewRecordState",
"value.converter": "io.confluent.connect.avro.AvroConverter",
"insert.mode": "insert",
"key.converter": "io.confluent.connect.avro.AvroConverter",
"table.name.format": "table",
"dialect.name": "PostgreSqlDatabaseDialect",
"transforms.TimestampConverter.type": "org.apache.kafka.connect.transforms.TimestampConverter$Value",
"topics": "default.table",
"time.precision.mode": "connect",
"transforms.TimestampConverter.format": "yyyy-MM-dd'T'HH:mm:ss.SSSSSS'Z'",
"key.converter.schemas.enable": "true",
"value.converter.schema.registry.url": "http://schema-registry",
"delete.enabled": "true",
"connection.user": "u_connect",
"value.converter.schemas.enable": "true",
"name": "ch-table",
"auto.create": "true",
"connection.url": "jdbc:clickhouse://locahost:9120/default",
"key.converter.schema.registry.url": "http://schema-registry",
"pk.mode": "record_key"
}
date_txn value in my destination table is:
2025-03-05 11:52:59.206 +0700
The hour is correct as I expected (I’m living in GMT +7) but the minutes is kind of weird. I’ve been searched through a lot of document but still have no idea why the time automatically increase by a few more minutes? I switched sink connector to another Postgres instance and received the same result. So I think maybe the SMT TimestampConverter have some bugs or some config that I haven’t known.