The Azure Data Lake Connector can be configured using the Aspire Admin UI. It requires the following entities to be created:

• Credential
• Connection
• Connector
• Seed

Create Credential 

1. On the Aspire Admin UI go to the credentials page
2. All existing credentials will be listed. Click on the new button
3. Enter the new credential description.
4. Select Azure Data Lake from the Type list.
   1. Authorization Token End Point: OAuth 2 End Point supplied by Azure for your App, format https://login.microsoftonline.com/[mykey]/oauth2/token
   2. Application ID: Client ID for your application
   3. Application Secret: Key supplied by Azure
   4. Fully Qualified Domain Name or FQDN: full path of your Data Lake domain, format [mydomain].azuredatalakestore.net

Create Connection 

1. On the Aspire Admin UI go to the connections page
2. All existing connections will be listed. Click on the new button
3. Enter the new connection description. 
4. Select Azure Data Lake from the Type list.
   1. Collect from Root: Within this option, connector will crawl from root directory of Azure Data Lake FQDN supplied. Meaning "/"
   2. Use Seeds File: This option will allow collect paths from a supplied file location, very useful if paths will be constantly changing and controlled by a 3rd party process. Paths should be listed one per line in a form of /folder/sub-folder

      1. For Windows: D:\folder\folder1\paths.txt

      2. For Linux: /home/user/folder/folder1/paths.txt
         
   3. Specific Paths: This option will allow submit N paths. Admin is able to supply as many paths in a format of /folder/sub-folder
   4. Index Containers: Select if folders are to be indexed
   5. Scan Recursively: Select if sub-folder are to be scanned
   6. Scan Excluded Items: If selected, the scanner will scan sub items of container items that have been excluded by a pattern (because it matches an exclude pattern or because it doesn't match an include pattern)
   7. Include patterns: Specify regex display URL patterns to include
   8. Exclude patterns: Specify regex display URL patterns to exclude

Create Connector Instance

For the creation of the Connector object using the Admin UI check this page.

Create Seed 

1. On the Aspire Admin UI go to the seeds page
2. All existing seed will be listed. Click on the new button
3. Enter the new seed description.
4. Select Azure Data Lake from the Type list.