Page tree
Skip to end of metadata
Go to start of metadata

Azure Blob Storage

The Azure Blob Storage connector performs full and incremental scans over an Azure Blob Container and will extract security, metadata, and content from each object scanned. Each scanned object will be tagged with one of three possible actions: add, update, or delete, and can be routed to any Aspire pipeline as desired.

The connector, once started, can be stopped, paused or resumed via the Scheduler Component. Typically the start job will contain all information required by the job to perform the scan. When pausing or stopping, the connector will wait until all the jobs it published have completed before updating the statistics and status of the connector.

Azure Blob Storage Connector

AppBundle Name

Azure Blob Storage Connector

Factory Name

Aspire Version



AspireObject from a content source submitter holding all the information required for a crawl


An AspireObject containing the URL, content, ACLs and Metadata processed for each file


This section lists all configuration parameters available to install the Azure Blob Application Bundle and to execute crawls using the connector.


Azure Blob Storage Credentials



Indicates if we should load the information from a configuration provided address



Indicates if we should load the information from a user provided text file



url for the seeds file path. The file must contain a valid azure blob container url per line. The credentials will be used in all urls


The address of the Blob Container that we want to crawl, it follows the format: http://hostname/tennant/blobContainer


Indicates if we should use more than one container for the crawl



A list/collection of Azure Blob Container urls that we want to crawl



Indicates if we want to scan subfolders

Note, if you are using the Azure Storage Emulator, then for the storageConnectionString property, you can use the next connection string “UseDevelopmentStorage=true;” this will connect to the emulator installed locally in your machine.

Configuration Example

To install the application bundle, add the configuration, as follows, to the <autoStart> section of the Aspire settings.xml.

<application config="">
<property name="storageConnectionString"> DefaultEndpointsProtocol=http;AccountName=myAccount;AccountKey=myKey;</property> 
<property name="useRootURL">true</property> <property name="useSeedsFile">false</property> 
<property name="seedsFilePath"> ${}/${}/urls.txt </property> 
<property name="url"> </property> 
<property name="useExtraBlobContainers">true</property> <property name="siteCollectionsToCrawl"> 
<property name=" siteCollectionUrl"></property> 
<property name="siteCollectionUrl"></property> </property> 
<property name=" scanRecursively ">true</property>

  • No labels