Debezium Oracle kafka connector

[Anil]

Hi,

I am new to Kafka Debezium connector. Please help to guide me on below.

Please, help to check below, my Debezium connector, I am using in property file and executing through command line.

name=oracle-connector
connector.class=io.debezium.connector.oracle.OracleConnector
tasks.max=1
database.hostname=localhost
database.port=1521
database.user=C##SANGULA
database.password=admin
database.dbname=sangula.INFOVISIONLABS.COM
#show parameter db
#db_name XE add database.dbname=XE
database.pdb.name=SANGPDB
#database.out.server.name=kafka
#database.server.name=kafka
table.include.list=C##SANGULA.T
database.pdb.name= SANGPDB
snapshot.mode=always
include.schema.changes= true
database.connection.adapter= LogMiner
database.history.kafka.topic=history
topic.prefix=checkdata-
database.schema=C##SANGULA
database.server.name=test
database.history.kafka.bootstrap.servers=kafka:9092
schema.history.internal.kafka.bootstrap.servers=localhost:9092
schema.history.internal.kafka.topic=schema-changes.inventory
internal.key.converter=org.apache.kafka.connect.storage.StringConverter
internal.value.converter=org.springframework.kafka.support.serializer.JsonSerializer
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false

1). in my logs, I can see, these tables, but I didnt created any table. how these tables are creating automatically.

[SANGPDB.HR.COUNTRIES, SANGPDB.HR.DEPARTMENTS, SANGPDB.HR.EMPLOYEES, SANGPDB.HR.JOBS, SANGPDB.HR.JOB_HISTORY, SANGPDB.HR.LOCATIONS, SANGPDB.HR.REGIONS] (io.debezium.connector.oracle.OracleSnapshotChangeEventSource:151)

2). I have created a table, name as T, and inserting data, but these data not populating immediately.
taking time and I cant see, these data or table created and coming in my topic.

3). Please help to create a producer of debezium kafka with oracle, how can we create.

4). I have taken archived debezium connector libs, can you please help to provide lib path for debezium kafka connector.

Thanks, please help to understand more on this.

[mmuehlbeyer]

@Anil

table.include.list=C##SANGULA.T

mmh the parameter above looks wrong

[Anil]

Thanj you mmuehlbeyer.

Nowmy debezium connector working fine.

name=oracle_cdc
connector.class=io.debezium.connector.oracle.OracleConnector
tasks.max=1
confluent.topic.bootstrap.servers=localhost:9092
database.hostname=localhost
database.port=1521
database.user=C##OKAFKA
database.password=admin
database.dbname=okcheck.INFOVISIONLABS.COM
start.from=snapshot
table.inclusion.regex=okcheck.INFOVISIONLABS.COM\.C##OKAFKA\.VJNR_MES_SO_HEADER
table.exclusion.regex=
table.topic.name.template= ${fullyQualifiedTableName}
connection.pool.max.size= 20
topic.prefix=checkdata9-
confluent.topic.replication.factor=1
redo.log.consumer.bootstrap.servers=localhost:9092
redo.log.corruption.topic=redo-corruption-topic
topic.creation.groups= redo
topic.creation.redo.include= redo-log-topic
topic.creation.redo.replication.factor= 1
topic.creation.redo.partitions= 1
topic.creation.redo.cleanup.policy=delete
topic.creation.redo.retention.ms= 1209600000
topic.creation.default.replication.factor= 1
topic.creation.default.partitions= 1
topic.creation.default.cleanup.policy= delete
schema.history.internal.kafka.bootstrap.servers=localhost:9092
schema.history.internal.kafka.topic=schema-changes.inventory
internal.key.converter=org.apache.kafka.connect.storage.StringConverter
internal.value.converter=org.springframework.kafka.support.serializer.JsonSerializer
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false
database.history.kafka.topic=history
database.history.kafka.bootstrap.servers=kafka:9092

[Anil]

Hi,

using debezium, can we do Validations like, string should start with ‘s’, string should be not more than 25 characters like this, please on this.

Thanks and Regards,
Anil. Sangula