Connector error: HTTP/40X Status when connecting to WebHDFS

This error generally happens when the connector cannot access a Kerberized HDFS cluster. This may happen when:

• You haven't configured a Delegation token to access the WebHDFS API
• Your Delegation token is no longer available, in which case you should regenerate it and re-configure it.

Visit Prerequisites for more information.

If this happens after a few incremental crawls the incremental data will not be affected, so after this problem is resolved the incremental crawls can be resumed.