Optimized Kafka Docker Setup for High-Performance Debezium CDC Problem

Kafka Connect
1

Hello, I have created a Docker setup, but whenever I connect it with a Debezium connector, the connector goes into a ‘task failed’ state shortly after. Could you please help? The task fails when I try to convert the timestamp data to the datetime type.

Here is my docker-compose file:
services:
kafka:
image: ‘bitnami/kafka:3.9.0’
container_name: kafka
ports:
- “9092:9092”
environment:
- KAFKA_CFG_NODE_ID=0
- KAFKA_CFG_PROCESS_ROLES=controller,broker
- KAFKA_CFG_LISTENERS=PLAINTEXT://:9092,CONTROLLER://:9093
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://kafka:9092
- KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
- KAFKA_CFG_CONTROLLER_QUORUM_VOTERS=0@kafka:9093
- KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
- KAFKA_CFG_INTER_BROKER_LISTENER_NAME=PLAINTEXT

kafka-ui:
container_name: kafka-ui
image: provectuslabs/kafka-ui:latest
ports:
- “8080:8080”
depends_on:
- kafka
- kafka-connect
environment:
KAFKA_CLUSTERS_0_NAME: local
KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS: kafka:9092
KAFKA_CLUSTERS_0_KAFKACONNECT_0_NAME: FIRST
KAFKA_CLUSTERS_0_KAFKACONNECT_0_ADDRESS: http://kafka-connect:8083
DYNAMIC_CONFIG_ENABLED: “true”

kafka-connect:
container_name: kafka-connect
image: debezium/connect:3.0.0.Final
ports:
- “8083:8083”
depends_on:
- kafka
environment:
BOOTSTRAP_SERVERS: kafka:9092
GROUP_ID: 1
CONFIG_STORAGE_TOPIC: dbz_config
OFFSET_STORAGE_TOPIC: dbz_offset
STATUS_STORAGE_TOPIC: dbz_status
KEY_CONVERTER: org.apache.kafka.connect.json.JsonConverter
VALUE_CONVERTER: org.apache.kafka.connect.json.JsonConverter
CONNECT_KEY_CONVERTER_SCHEMAS_ENABLE: “false”
CONNECT_VALUE_CONVERTER_SCHEMAS_ENABLE: “false”
PLUGIN_PATH: /kafka/connect