I have used the schema registry of confluent. I have not uploaded any schema of bytes under any subject.
Still, I get a schema under id 2, at the endpoint http://schema-registry-host:8081/schemas/ids/2.
Could anyone explain this?
I made a MQTT source connector i.e MQTT-Kafka using Avro schema to get the Avro data on the Kafka topic.
I supplied the schema registry ID in my spark ETL function to consume AVRO data.
The function picks default schema bytes at id 2.
I gave the id where the test schema was present.
Caused by: org.apache.avro.AvroTypeException: ** Found bytes, expecting test **
at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:240) ~[avro-1.11.0.jar:1.11.0]
at org.apache.avro.generic.GenericDatumReader.readWithoutConversion(GenericDatumReader.java:180) ~[avro-1.11.0.jar:1.11.0]
I want to parse the AVRO data from the MQTT source connector to the KAFKA topic using the AVRO spark function.
Let me know if I am missing anything.
Thanks.