Hi Team,
Firstly I am new to Kafka Connect. I am trying to create a new sink connector. I am able to successfully deploy the connector. However, connector is always running with single task despite of number of tasks given in the configuration file i.e. tasks.max=“5”.
My number of tasks are equivalent to number of partitions in the topic.
Please find my connector configuration below:
{
“name”: “my-first-kafka-sink-connector”,
“config”: {
“connector.class”: “tutorial.buildon.aws.streaming.kafka.MyFirstKafkaSinkConnector”,
“first.required.param”: “Kafka”,
“second.required.param”: “Connect”,
“tasks.max”: “5”,
“topics” : “datasync-sts-upd-topic”
}
}
And connect api (http://localhost:8083/connectors?expand=status) connector status is returning below response
{
“my-first-kafka-sink-connector”: {
“status”: {
“name”: “my-first-kafka-sink-connector”,
“connector”: {
“state”: “RUNNING”,
“worker_id”: “connect:8083”
},
“tasks”: [
{
“id”: 0,
“state”: “RUNNING”,
“worker_id”: “connect:8083”
}
],
“type”: “sink”
}
}
}
Please let me know if you need more details.
Thanks
Chid