Install JDBC SQL Connect & Azure SQL Connect shows error in Docker container logs

Kafka Connect
1

Hello all,

I am facing issue while I tried to install JDBC SQL connector and Azure SQL connector in docker-compose file.

I have below config for Connect in my docker-compose

  connect:
    image: confluentinc/cp-kafka-connect:6.2.4
    hostname: connect
    container_name: connect
    depends_on:
      - broker
      - schema-registry
    ports:
      - "8083:8083"
    environment:
      CONNECT_BOOTSTRAP_SERVERS: 'broker:29092'
      CONNECT_REST_ADVERTISED_HOST_NAME: connect
      CONNECT_GROUP_ID: compose-connect-group
      CONNECT_CONFIG_STORAGE_TOPIC: docker-connect-configs
      CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR: 1
      CONNECT_OFFSET_FLUSH_INTERVAL_MS: 10000
      CONNECT_OFFSET_STORAGE_TOPIC: docker-connect-offsets
      CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR: 1
      CONNECT_STATUS_STORAGE_TOPIC: docker-connect-status
      CONNECT_STATUS_STORAGE_REPLICATION_FACTOR: 1
      CONNECT_KEY_CONVERTER: org.apache.kafka.connect.storage.StringConverter
      CONNECT_VALUE_CONVERTER: io.confluent.connect.avro.AvroConverter
      CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL: http://schema-registry:8081
      # CLASSPATH required due to CC-2422
      CLASSPATH: /usr/share/java/monitoring-interceptors/monitoring-interceptors-7.1.1.jar
      CONNECT_PRODUCER_INTERCEPTOR_CLASSES: "io.confluent.monitoring.clients.interceptor.MonitoringProducerInterceptor"
      CONNECT_CONSUMER_INTERCEPTOR_CLASSES: "io.confluent.monitoring.clients.interceptor.MonitoringConsumerInterceptor"
      CONNECT_PLUGIN_PATH: "/usr/share/java,/usr/share/confluent-hub-components,/etc/kafka-connect/jars"
      CONNECT_LOG4J_LOGGERS: org.apache.zookeeper=ERROR,org.I0Itec.zkclient=ERROR,org.reflections=ERROR
    command: "bash -c 'confluent-hub install --no-prompt confluentinc/kafka-connect-jdbc:10.5.0 && \
      confluent-hub install --no-prompt confluentinc/kafka-connect-azure-sql-dw:latest'"

It shows error

Running in a "--no-prompt" mode 

java.net.SocketException: Broken pipe (Write failed) 

 

Error: Unknown error 

Running in a "--no-prompt" mode 

Implicit acceptance of the license below:  

Confluent Community License 

https://www.confluent.io/confluent-community-license 

Downloading component Kafka Connect JDBC 10.5.0, provided by Confluent, Inc. from Confluent Hub and installing into /usr/share/confluent-hub-components 

Implicit confirmation of the question: Do you want to uninstall existing version 10.5.0? 

Adding installation directory to plugin path in the following files: 

  /etc/kafka/connect-distributed.properties 

  /etc/kafka/connect-standalone.properties 

  /etc/schema-registry/connect-avro-distributed.properties 

  /etc/schema-registry/connect-avro-standalone.properties

Can some one guide me, how can I achieve the connector installation in docker compose?

Thanks
Binjan

2

Binjan,

Please try the syntax as shown in the following example:

-Yeva

3

thanks for reply. I will try the solution.

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.