Page History

The "Failed Documents" section of the Connector contains the configuration elements specific to Failed Documents Processing. They are described below:

• Retry Handling: if enabled, failed documents will be reprocessed at the end of the crawl and in the following incremental crawls.
  
  • Remove Failed Documents from Snapshot: if enabled, snapshot entries are removed for each failed document. This makes the retries to be performed on all next incremental crawls. This overrides the "Maximum crawls to retry" option.
    
  • Error Retry Patterns: documents will be retried only if they match one the regex patterns specified here. The patterns will be matched against any exception raised by either the individual document or publisher. If matched, the document or documents will be retried using the limits configured by the "Maximum Retries per Crawl" and "Maximum Crawls to Retry" parameters, described below.
    
  • Maximum Retries per Crawl: maximum number of retries per crawl for a failed document.
    
  • Maximum Crawls to Retry: maximum number of incremental crawls in which a failed document will be retried.