General

Why is does an incremental crawl last as long as a full crawl?

The Jira Issues Connector performs incremental crawls based on snapshot files. Snapshot files contain an ordered list of all the issues that were present in the Jira instance at the time the last crawl was performed. The connector must extract the entire list of issues in the instance again while comparing against the last snapshot in order to ascertain which issues have been added, updated or deleted.

For this reason, an incremental crawl will take a similar amount of time to a full crawl as it must extract the same number of issues. However, on the updated, added or deleted issues are sent to the Aspire pipeline for processing.

  • No labels