More than two connectors

Kafka Connect
1

Hi, I am trying to create more than two connectors but I got an error saying “No suitable driver found for jdbc:oracle:thin:@”.

The first two connectors are runningpropertly, but I cannot create more than two.

$ curl http://XXXX:8083/connectors/jdbc_sink_oracle_ctc/status

{"name":"jdbc_sink_oracle_ctc","connector":{"state":"RUNNING","worker_id":"10.142.83.109:8083"},"tasks":[{"id":0,"state":"RUNNING","worker_id":"10.142.83.109:8083"}],"type":"sink"}

$ curl http://XXX:8083/connectors/jdbc_sink_oracle_ctc/status

{"name":"jdbc_sink_oracle_ctc","connector":{"state":"RUNNING","worker_id":"10.142.83.109:8083"},"tasks":[{"id":0,"state":"RUNNING","worker_id":"10.142.83.109:8083"}],"type":"sink"}

Can you help me on that?

2

Do you have more than one Kafka Connect worker in your cluster? Have you installed the JDBC driver across all of them?

3

Hi,
I am a beginner with Kafka, so I don’t know exactly how many workers are running.
How can I see that?

But, I have installed 3 brokers and I installed JDBC across all of them.

systemctl status confluent-kafka-connect
● confluent-kafka-connect.service - Apache Kafka Connect - distributed
   Loaded: loaded (/usr/lib/systemd/system/confluent-kafka-connect.service; disabled; vendor preset: disabled)
   Active: active (running) since Wed 2022-03-23 19:40:48 EDT; 3 days ago
     Docs: http://docs.confluent.io/
 Main PID: 22329 (java)
    Tasks: 53
   Memory: 1.6G
   CGroup: /system.slice/confluent-kafka-connect.service
           └─22329 java -Xms256M -Xmx2G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:...

That’s my kafka-connect properties config in one of the brokers

bootstrap.servers=vlaiubr-mngdb02:9092
group.id=connect-cluster

key.converter.schemas.enable=true
value.converter.schemas.enable=true
offset.storage.topic=connect-offsets
offset.storage.replication.factor=1

offset.flush.interval.ms=10000

plugin.path=/usr/share/java,/usr/share/java/kafka-connect-jdbc,/share/confluent-hub-components
4

Have you install both the JDBC connector and the JDBC driver across all of them?

No suitable driver found for jdbc:oracle:thin leads me to think that the JDBC driver is missing.

5

Hi.
The Driver is across all of them.
I restart all kafka services and I could create 3 connectors.

What Do I need to do to create 10 connectors?

Thank you very much

6

If it’s all working and you’ve created 3, you can just go ahead and create as many as you need. Kafka Connect will balance the load across the available workers.