Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Elasticsearch provider can claim items from queues by larger units and after changing queue items status they are sent back to Elasticsearch as a bulk unit. By this technique we can achieve better performance.  We can configure claim unit size parameters based on the current Aspire installation (e.g. standalone/ distributed mode, etc.). This is how it works:

  • Pre-fetch Prefetch "claimPrefetch" number of queue items of status "available". The default value is 10 000.
  • Take randomly random set of size "claim" number of items from the above pre-fetched set. The default value is 10 000.
  • Change the status of all "claimed" items from "available" to "inProgress" and sent this as a bulk update request to Elasticsearch.
  • Examine the result of the bulk request. All successfully updated items with no version conflicts can be sent one by one as a result of bulk claim to the connector framework.

...