Field | Required | Default | Multiple | Notes | Example |
---|---|---|---|---|---|
properties | No | - | No | Configuration object | |
seed | Yes | - | No | The path to be crawled. It can be a bucket, folder or file. | "/myBucket/myFolder" |
processSplitFiles | No | false | No | If set to true, files that are split are treated as a single document instead of multiple documents. | true / false |
splitPatterns | No | [] | Yes | List of regular expressions to match folders that contain split files. | [".*splitted.*",".*split.*"] |
{ "seed": "/myBucket/myFolder", "type": "s3", "description": "Amazon S3 Seed Test", "connector": "187ae173-32c2-48fe-b4fe-1b6eea02f166", "connection": "8f3233a9-4c8d-4520-b335-ea1d9433720e", "workflows": [], "tags": [], "properties": { "seed": "/myBucket/myFolder", "processSplitFiles": true, "splitPatterns": [] } }