We have an issue similar to Processing large CSV files using SFTP Source Kafka Connector
We are using confluent S3 source connector (cp-kafka-connect docker image version 7.3.3 latest) to restore data from S3 to topics and we see that after restoring 1.7million records, the connector stops processing. however there are more records which are not restored.
We have 10 topics to be restored.
tasks.max is set to 10 as well
There are no errors seen in connect, it just stopped processing more recrods.
Any hints or pointers to solve this issue will be appreciated.