Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Aspire Distributed Processing

Since the 3.2 release, Aspire connectors are able to crawl in distributed mode automatically. Since all the crawl  control data is stored in MongoDB, by just adding more Aspire servers configured to use the same MongoDB, the common connectors are going to crawl distributively.

On this page:

Table of Contents

In order to setup an Aspire Cluster for Distributed Processing, you need to configure each Aspire server to use the same MongoDB instance:

Excerpt Include
MongoDB Settings
MongoDB Settings

If you need to connect to a multi node MongoDB installation, check: Connect to a Multi-node MongoDB Installation

Once you have configured each instance, you need to