Hi,
we are working on Kafka connect to show demo.
its have 32 fields…and my connector look like as below.
{
name= my-jdbc-connector2
config= {
name=kafkasource1
connector.class=io.confluent.connect.jdbc.JdbcSourceConnector
name=oracle-kafka
connection.url=jdbc:oracle:thin:@localhost:1521/orcl
connection.user=kafka
connection.password=check
task.max=1
topic.prefix= kafkaop1
mode= timestamp+incrementing
query=SELECT APPLICATION_NUMBER,CUSTOMER_ID,PURCHASE_ORDER_NO,MATERIAL_NO,ORDER_TYPE,SUPPLIER,UNIT,SALESDATE,ADDRESS,MOBILENO,EMAIL_ID FROM SALESORDER
timestamp.column.name=SALESDATE
incrementing.column.name=APPLICATION_NUMBER
poll.interval.ms=1000
numeric.mapping=best_fit
errors.tolerance=all
key.converter=org.apache.kafka.connect.storage.StringConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=false
value.converter.schemas.enable=true
dialect.name=OracleDatabaseDialect
}
}
I have started kafka connector, its started fine and previous the same example working fine. but now its not working, not only that, any example not working…I have started multiple times the same connector with different examples.
(io.confluent.connect.jdbc.source.JdbcSourceTaskConfig:370)
[2024-06-12 16:02:10,507] INFO [oracle-kafka|task-0] Validating JDBC URL. (io.confluent.connect.jdbc.dialect.DatabaseDialects:171)
[2024-06-12 16:02:10,509] INFO [oracle-kafka|task-0] Validated JDBC URL. (io.confluent.connect.jdbc.dialect.DatabaseDialects:174)
[2024-06-12 16:02:10,533] INFO [oracle-kafka|task-0] Using JDBC dialect Oracle (io.confluent.connect.jdbc.source.JdbcSourceTask:138)
[2024-06-12 16:02:10,696] INFO [oracle-kafka|task-0] Found offset {{query=query}={timestamp_nanos=0, incrementing=191, timestamp=1713830400000}} for partition {query=query} (io.confluent.connect.jdbc.source.JdbcSourceTask:238)
[2024-06-12 16:02:10,709] INFO [oracle-kafka|task-0] Started JDBC source task (io.confluent.connect.jdbc.source.JdbcSourceTask:311)
[2024-06-12 16:02:10,710] INFO [oracle-kafka|task-0] WorkerSourceTask{id=oracle-kafka-0} ** (io.confluent.connect.jdbc.source.JdbcSourceTaskConfig:370)
[2024-06-12 16:02:10,507] INFO [oracle-kafka|task-0] Validating JDBC URL. (io.confluent.connect.jdbc.dialect.DatabaseDialects:171)
[2024-06-12 16:02:10,509] INFO [oracle-kafka|task-0] Validated JDBC URL. (io.confluent.connect.jdbc.dialect.DatabaseDialects:174)
[2024-06-12 16:02:10,533] INFO [oracle-kafka|task-0] Using JDBC dialect Oracle (io.confluent.connect.jdbc.source.JdbcSourceTask:138)
[2024-06-12 16:02:10,696] INFO [oracle-kafka|task-0] Found offset {{query=query}={timestamp_nanos=0, incrementing=191, timestamp=1713830400000}} for partition {query=query} (io.confluent.connect.jdbc.source.JdbcSourceTask:238)
[2024-06-12 16:02:10,709] INFO [oracle-kafka|task-0] Started JDBC source task (io.confluent.connect.jdbc.source.JdbcSourceTask:311)
[2024-06-12 16:02:10,710] INFO [oracle-kafka|task-0] WorkerSourceTask{id=oracle-kafka-0} Source task finished initialization and start (org.apache.kafka.connect.runtime.AbstractWorkerSourceTask:281)
[2024-06-12 16:02:10,873] INFO [oracle-kafka|task-0] Begin using SQL query: SELECT APPLICATION_NUMBER,CUSTOMER_ID,PURCHASE_ORDER_NO,MATERIAL_NO,ORDER_TYPE,SUPPLIER,UNIT,SALESDATE,ADDRESS,MOBILENO,EMAIL_ID FROM SALESORDER WHERE “SALESDATE” < ? AND ((“SALESDATE” = ? AND “APPLICATION_NUMBER” > ?) OR “SALESDATE” > ?) ORDER BY “SALESDATE”,“APPLICATION_NUMBER” ASC (io.confluent.connect.jdbc.source.TableQuerier:182)** (org.apache.kafka.connect.runtime.AbstractWorkerSourceTask:281)
[2024-06-12 16:02:10,873] INFO [oracle-kafka|task-0] Begin using SQL query: SELECT APPLICATION_NUMBER,CUSTOMER_ID,PURCHASE_ORDER_NO,MATERIAL_NO,ORDER_TYPE,SUPPLIER,UNIT,SALESDATE,ADDRESS,MOBILENO,EMAIL_ID FROM SALESORDER WHERE “SALESDATE” < ? AND ((“SALESDATE” = ? AND “APPLICATION_NUMBER” > ?) OR “SALESDATE” > ?) ORDER BY “SALESDATE”,“APPLICATION_NUMBER” ASC (io.confluent.connect.jdbc.source.TableQuerier:182)
why any connector not able to start, where as, with fields I can able to see success results.
not able to see , below command for any example of connectors.
[2024-06-12 16:25:46,155] INFO [oracle-kafka|task-0|offsets] WorkerSourceTask{id=oracle-kafka-0} Committing offsets for 1 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:233)
Please, let me know any solution, this is very critical to my case study to give demo.
Thanks and Regards,
A