Hi Team,
We are in exploring phase of Confluent Kafka.
What we have implemented is below:-
We have implemented Oracle CDC & Confluent like when there are some DML changes in some tables at our Oracle DB side our confluent Kafka platform generates the events regarding the same.
Below is the config json file-
{
“name”: “NEXTGENUSERCDCConnector”,
“config”:{
“connector.class”: “io.confluent.connect.oracle.cdc.OracleCdcSourceConnector”,
“name”: “NEXTGENUSERCDCConnector”,
“tasks.max”:1,
“key.converter”: “io.confluent.connect.avro.AvroConverter”,
“key.converter.schema.registry.url”: “localhost:8081”,
“value.converter”: “io.confluent.connect.avro.AvroConverter”,
“value.converter.schema.registry.url”: localhost:8081",
“confluent.topic.bootstrap.servers”:“localhost:9092”,
“oracle.server”: “ECH-10-157-145-251”,
“oracle.port”: 1527,
“oracle.sid”:“devcloud”,
“oracle.username”: “NEXTGENUSER”,
“oracle.password”: “boss”,
“start.from”:“snapshot”,
“redo.log.topic.name”: “redo-log-topic-2”,
“table.inclusion.regex”:“devcloud[.]NEXTGENUSER.”,
“table.topic.name.template”:“”,
“table.topic.name.template”: “”,
“connection.pool.max.size”: 20,
“confluent.topic.replication.factor”:1,
“topic.creation.groups”: “redo”,
“topic.creation.redo.include”: “redo-log-topic”,
“topic.creation.redo.replication.factor”: 1,
“topic.creation.redo.partitions”: 1,
“topic.creation.redo.cleanup.policy”: “insert”,
“topic.creation.redo.retention.ms”: 120960,
“topic.creation.default.replication.factor”: 1,
“topic.creation.default.partitions”: 1,
“topic.creation.default.cleanup.policy”: “insert”
}
}
command:-
kafka-avro-console-consumer --topic redo-log-topic-2 --bootstrap-server localhost:9092
Now, what we are trying to achieve here is further the above one-
The events getting published from confluent using the above command kafka avro console consumer, we want to write our own converter instead of ‘AvroConverter’ in between and publish the events directly onto the Axon schema what we have created on Axon control panel. So, Please help us out is this scenario, is this scenario is altogether possible or not what we are trying to achieve here?
Please help us out on this.
Thanks in Advance.