Curious if someone can advise.
I have a multi level source folder structure, ///hour.
in the hour folder I have json.gz files, each file an array of documents.
I need to ingest/split this (individual docs in the array - level 1) into separate documents.
- Can The source connector handle the nester directory structure ?
- What would the recommended process be, the split into individual docs?