Page tree
Skip to end of metadata
Go to start of metadata

On this page:

WebHDFS configuration

The WebHDFS feature must be enabled in order to use this publisher.

Grant Read Permissions to Crawl Path

Granting READ permissions is a must since the connector won't be able to get any data if the Path to be crawled is restricted.

Kerberized Clusters

For Kerberized Clusters, a delegation token is required in order to crawl any path within the HDFS. To obtain this token you must:

  1. SSH into your cluster.
  2. Run:

    $ kinit <your-user-principal>
    $ curl -i --negotiate -u : "http://<host>:<port>/webhdfs/v1/?op=GETDELEGATIONTOKEN"
  3. Copy the "Token" field and set it into the configuration of the connector.
  • No labels