I started a POC with Redshift connector so as to do incremental load from MSK to Redshift.
Setup was easy and quick. So great job on that!
The thing which I am struggling now is with the schema deducing which is not supported by the connector and hence our data in Kafka stream which is in JSON(only payload) format was not deduced by Connector.
I also came across this article and wondering where are we with this.
- Is Confluent team planning to support this feature and if yes when can we expect it?
- Does Json convertor supports deducing records using schema registry? If yes, do we have any documentation mentioning the steps for the same?
I am a beginner, so in case this has been already answered somewhere please let me know the link to follow.