Hello all,
I am using Azure SQL Data Warehouse Sink Connector for Confluent Platform.
https://docs.confluent.io/5.5.1/connect/kafka-connect-azure-sql-dw/index.html
I am using Azure SQL emulator for testing
Here is connector config
"name": "sqlserver-sink-azure-connector",
"connector.class": "io.confluent.connect.azuresqldw.AzureSqlDwSinkConnector",
"value.converter": "org.apache.kafka.connect.json.JsonConverter",
"value.converter.schemas.enable": "true",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"key.converter.schemas.enable": "false",
"transforms": "RenameFields",
"transforms.RenameFields.type": "org.apache.kafka.connect.transforms.ReplaceField$Value",
"transforms.RenameFields.renames": "Email:vchEmail,Login:vchLogin,Name:vchName,Password:vchPassword",
"topics": "new_user",
"azure.sql.dw.url": "jdbc:sqlserver://192.168.0.0:1433;",
"azure.sql.dw.user": "sa",
"azure.sql.dw.password": "xxx#",
"azure.sql.dw.database.name": "xxx",
"insert.mode": "insert",
"auto.create": "true",
"auto.evolve": "true",
"tasks.max": "1",
"confluent.topic.bootstrap.servers": "broker:29092"
I have produce below message in topic
{
"schema": {
"type": "struct",
"fields": [{
"type": "string",
"optional": false,
"field": "Email"
},{
"type": "string",
"optional": false,
"field": "Login"
},{
"type": "string",
"optional": false,
"field": "Name"
},{
"type": "string",
"optional": false,
"field": "Password"
}
],
"optional": false,
"name": "foobar"
},
"payload": {
"Email": "login1@example.com",
"Login": "login1",
"Name": "login1",
"Password": "login1#login"
}
}
- What is the issue in connecting Azure SQL database for kafka connect?
- Is there any changes require in config OR topic message produce?
Thanks in advance.
Binjan