S3 Source - Nested folder structure / Nested documents

Kafka Connect
1

Hi All.

Curious if someone can advise.

I have a multi level source folder structure, ///hour.
in the hour folder I have json.gz files, each file an array of documents.

I need to ingest/split this (individual docs in the array - level 1) into separate documents.

  1. Can The source connector handle the nester directory structure ?
  2. What would the recommended process be, the split into individual docs?

G

2

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.