SpoolDirCsvSourceConnector

Kafka Connect
1

Will creating a CSV connector, I’m getting following error:

{"error_code":400,"message":"Connector configuration is invalid and contains the following 2 error(s):\n
Invalid value '/data/unprocessed' must be a directory. for configuration input.path\n
Invalid value '/data/error' must be a directory. for configuration error.path\n
You can also find the above list of errors at the endpoint `/connector-plugins/{connectorType}/config/validate`"}

Here are my config and all directories list in the config are set with 777 right.

curl -i -X PUT -H "Accept:application/json" \

    -H  "Content-Type:application/json" http://localhost:8083/connectors/source-csv-spooldir-00/config \

    -d '{

        "connector.class": "com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector",

        "topic": "rawdata",

        "input.path": "/data/unprocessed",

        "finished.path": "/data/processed",

        "error.path": "/data/error",

        "input.file.pattern": ".*\\.csv",

        "schema.generation.enabled": "false",

        "csv.first.row.as.header": "false"

        }'

Any help ???

2

Does the user that is running Connect have access permissions to the folder?

1 Like
3

I guess yes since I set up recursively 777 right (full right for all users) to /data. I now solve by creating the appropriate path into Kafka-connect containers instead of brokers or local path.

1 Like
4

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.