I am trying to deploy the self-managed connector for ClickHouse “clickhouse-kafka-connect-v1.2.6-confluent.jar”. I have followed the steps but whenever running " bin/connect-standalone $CONFLUENT_HOME/etc/connect-clickhouse.properties", I get the below error after timing out:
[2025-02-22 15:18:26,885] INFO These configurations '[connector.class, tasks.max, plugin.path, ssl, hostname, database, password, offset.storage.file.filename, jdbcConnectionProperties, value.converter, key.converter, topics, consumer.max.poll.records, offset.flush.interval.ms, key.converter.schemas.enable, port, value.converter.schemas.enable, exactlyOnce, consumer.max.partition.fetch.bytes, username, schemas.enable]' were supplied but are not used yet. (org.apache.kafka.clients.admin.AdminClientConfig:380)
[2025-02-22 15:18:26,885] INFO Kafka version: 7.9.0-ccs (org.apache.kafka.common.utils.AppInfoParser:125)
[2025-02-22 15:18:26,886] INFO Kafka commitId: ebe6df624d6bc758c37aba7053cf868c1e532ccd (org.apache.kafka.common.utils.AppInfoParser:126)
[2025-02-22 15:18:26,886] INFO Kafka startTimeMs: 1740237506885 (org.apache.kafka.common.utils.AppInfoParser:127)
[2025-02-22 15:18:36,459] INFO [AdminClient clientId=adminclient-1] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 9567 ms. (org.apache.kafka.clients.NetworkClient:893)
[2025-02-22 15:18:56,889] INFO [AdminClient clientId=adminclient-1] Metadata update failed (org.apache.kafka.clients.admin.internals.AdminMetadataManager:273)
org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call. Call: fetchMetadata
[2025-02-22 15:18:59,101] INFO [AdminClient clientId=adminclient-1] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 22439 ms. (org.apache.kafka.clients.NetworkClient:893)
[2025-02-22 15:19:25,328] INFO [AdminClient clientId=adminclient-1] Disconnecting from node -1 due to socket connection setup timeout. The timeout value is 26079 ms. (org.apache.kafka.clients.NetworkClient:893)
[2025-02-22 15:19:26,890] INFO [AdminClient clientId=adminclient-1] Metadata update failed (org.apache.kafka.clients.admin.internals.AdminMetadataManager:273)
org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call. Call: fetchMetadata
[2025-02-22 15:19:26,892] INFO App info kafka.admin.client for adminclient-1 unregistered (org.apache.kafka.common.utils.AppInfoParser:89)
[2025-02-22 15:19:26,892] INFO [AdminClient clientId=adminclient-1] Metadata update failed (org.apache.kafka.clients.admin.internals.AdminMetadataManager:273)
org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call. Call: fetchMetadata
[2025-02-22 15:19:26,892] INFO [AdminClient clientId=adminclient-1] Timed out 1 remaining operation(s) during close. (org.apache.kafka.clients.admin.KafkaAdminClient:1488)
[2025-02-22 15:19:26,900] INFO Metrics scheduler closed (org.apache.kafka.common.metrics.Metrics:685)
[2025-02-22 15:19:26,901] INFO Closing reporter org.apache.kafka.common.metrics.JmxReporter (org.apache.kafka.common.metrics.Metrics:689)
[2025-02-22 15:19:26,901] INFO Metrics reporters closed (org.apache.kafka.common.metrics.Metrics:695)
[2025-02-22 15:19:26,901] ERROR Stopping due to error (org.apache.kafka.connect.cli.AbstractConnectCli:102)
org.apache.kafka.connect.errors.ConnectException: Failed to connect to and describe Kafka cluster. Check worker's broker connection and security properties.
at org.apache.kafka.connect.runtime.WorkerConfig.lookupKafkaClusterId(WorkerConfig.java:303)
at org.apache.kafka.connect.runtime.WorkerConfig.lookupKafkaClusterId(WorkerConfig.java:283)
at org.apache.kafka.connect.runtime.WorkerConfig.kafkaClusterId(WorkerConfig.java:413)
at org.apache.kafka.connect.cli.AbstractConnectCli.startConnect(AbstractConnectCli.java:124)
at org.apache.kafka.connect.cli.AbstractConnectCli.run(AbstractConnectCli.java:95)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:185)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listNodes
at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
at org.apache.kafka.connect.runtime.WorkerConfig.lookupKafkaClusterId(WorkerConfig.java:297)
... 5 more
Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listNodes
Below is the connector configuration:
bootstrap.servers=localhost:9094
key.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=true
offset.storage.file.filename=/tmp/connect.offsets
# Flush much faster than normal, which is useful for testing/debugging
offset.flush.interval.ms=10000
connector.class=com.clickhouse.kafka.connect.ClickHouseSinkConnector
tasks.max=1
topics=TestTopic
ssl=true
jdbcConnectionProperties=?sslmode=STRICT
security.protocol=SSL
hostname=192.168.3.46
port=8443
database=CONNECTOR_TEST
username=default
password=P@ssw0rd
ssl.truststore.location=/opt/Certificates/CA.crt
ssl.truststore.type=PEM
value.converter.schemas.enable=false
value.converter=org.apache.kafka.connect.json.JsonConverter
exactlyOnce=true
schemas.enable=false
consumer.max.poll.records=5000
consumer.max.partition.fetch.bytes=5242880
plugin.path=/opt/Confluent/confluent-7.9.0/etc/plugins