The Azure File Storage connector performs full and incremental scans over an Azure File Container and will extract security, metadata, and content from each object scanned. Each scanned object will be tagged with one of three possible actions: add, update, or delete, and can be routed to any Aspire pipeline as desired.
The connector, once started, can be stopped, paused or resumed via the Scheduler Component. Typically the start job will contain all information required by the job to perform the scan. When pausing or stopping, the connector will wait until all the jobs it published have completed before updating the statistics and status of the connector.
AppBundle Name | Azure File Storage Connector |
---|---|
Factory Name | com.accenture.aspire:aspire-azure-file-storage-source |
Aspire Version | 4.0 |
Inputs | AspireObject from a content source submitter holding all the information required for a crawl |
Outputs | An AspireObject containing the URL, content, ACLs and Metadata processed for each file |
This section lists all configuration parameters available to install the Azure file Application Bundle and to execute crawls using the connector.
Property | Type | Default | Description |
---|---|---|---|
storageConnectionString | string | DefaultEndpointsProtocol=http;AccountName=myAccount;AccountKey=myKey; | Azure File Storage Credentials |
useRootURL | boolean | True | Indicates if we should load the information from a configuration provided address |
seSeedsFile | boolean | False | Indicates if we should load the information from a user provided text file |
seedsFilePath | string | ${dist.data.dir}/${app.name}/urls.txt | url for the seeds file path. The file must contain a valid azure file container url per line. The credentials will be used in all urls |
url | string | The address of the file Container that we want to crawl, it follows the format: http://hostname/tennant/fileContainer | |
useExtrafileContainers | boolean | False | Indicates if we should use more than one container for the crawl |
siteCollectionsToCrawl | collection | A list/collection of Azure file Container urls that we want to crawl | |
scanRecursively | boolean | True | Indicates if we want to scan subfolders |
Note, if you are using the Azure Storage Emulator, then for the storageConnectionString property, you can use the next connection string “UseDevelopmentStorage=true;” this will connect to the emulator installed locally in your machine.
To install the application bundle, add the configuration, as follows, to the <autoStart> section of the Aspire settings.xml.
Configuration
|