Connecting Sql Server to Kafka by debezium connector but fetching data from related consumer make decoding problem

Kafka Connect Managed Connectors
1

Hi,
I have connected one of our SQL Server database tables to Kafka via debezium connector.

But after using python code from package confluent-kafka to consume produced message, I encounter below error:
$ UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 67: invalid start byte
I use msg.value().decode('utf-8') to decode the message and tried various decoded options as I searched.
It doesn’t matter if I use confluent-kafka or kafka-python, I see the same error.

Is there any solution?

2

Unclear what Converter you’ve used in Debezium, but assuming you used Avro, then that’s not going to be utf8 data and you’ll need a different deserializer function.

3

SOLVED - Yes. Problem was about convertor. After configuring convertor in connector config, it was solved.

Thanks