Page History
Azure Data Lake Source
Connector will CRAWL crawl Folders and Files (configuration dependent). Execution will result on the following fields to be populated:
| Property | Type | Description |
|---|---|---|
Fullname | String | Full path of the directory or file (from root path "/") |
| Name | String | File name (minus the path) of the directory or file |
| Length | Long | Length of a file (does not apply for directories |
| Group | String | ID of the group that owns this file/directory |
User | String | ID of the user that owns this file/directory |
Permission | String | Unix-style permission string for this file or directory |
Last Access Time | Date | Date Time of the last time the file was accessed |
AclBit | Boolean | Flag indicating whether file has ACLs set on it |
Block Size | Long | Block size reported by server |
Expiry Time | Date | Date Time at which the file expires, as UTC time |
ReplicationFactor | Int | Replication Factor reported by server |
isContainer | Boolean | Indicates "true" if is a directory, otherwise File |
Fetch Url | String | Azure Data Lake full Absolute Path including FQDN. adl://[yourdomain].azuredatalakestore.net/full/path/to.file |
Last Modified Date | Date | Date Time of the last time the file was modified |
Acls | ACL Array | List of access for file or folder |
The following code block will show console output example of crawling of a folder called /test located at root of testing Data Lake Storage adl://dlsjose.azuredatalakestore.net
...
Overview
Content Tools