Panel | ||||
---|---|---|---|---|
| ||||
|
Launch Aspire (if it's not already running).
See:
In the "Connector" tab, specify the connection information to crawl the Amazon S3.
Access Key Secret Key. It will be automatically encrypted by Aspire.
In the Workflow tab, specify the workflow steps for the jobs that come out of the crawl. Drag and drop rules to determine which steps an item should follow after being crawled. This could be where to publish the document or transformations needed on the data before sending it to a search engine. See Workflow for more information.
Now that the content source is set up, the crawl can be initiated.
The status will show RUNNING while the crawl is going, and CRAWLED when it is finished.
If there are errors, you will get a clickable "Error" flag that will take you to a detailed error message page.
If you only want to process content updates from the Amazon S3 (documents which are added, modified, or removed), then click Incremental instead of Full.
The Amazon S3 connector will automatically identify only changes which have occurred since the last crawl.
If this is the first time that the connector has crawled, the action of the "Incremental" button depends on the exact method of change discovery. It may perform the same action as a "Full" crawl crawling everything, or it may not crawl anything. Thereafter, the Incremental button will only crawl updates.
Info |
---|
Statistics are reset for every crawl. |