The Aspider Web Crawler can be configured using the Aspire Admin UI. It requires the following entities to be created:

  • Credential
  • Connection
  • Connector
  • Seed

Create Credential 


  1. On the Aspire Admin UI, go to the credentials page
  2. All existing credentials will be listed. Click on the new button 
  3. Enter the new credential description.
  4. Select Dropbox from the Type list.
  5. General: In Authentication, you need to insert:
    1. Application Identifier: Name of your app.
    2. Access Token: Token represents a user and app pair, to operate on that team, to the extent allowed by that app's permissions.

Note: On September 30th, 2021, Dropbox will retire the creation of long-lived access tokens — resulting in all new tokens being short-lived and expires in 4 hours. 

Create Connection 


  1. On the Aspire Admin UI, go to the connections page
  2. All existing connections will be listed. Click on the new button 
  3. Enter the new connection description. 
  4. Select Dropbox from the Type list.
  5. Policies
    1. Throttle Policy: Select the throttle policy that applies to this connection object.
    2. Routing Policies: Select the routing policies that this connection will use.

Create Connector Instance


For the creation of the Connector object using the Admin UI, refer to this page.


Create Seed 


  1. On the Aspire Admin UI, go to the seeds page
  2. All existing seeds will be listed. Click on the new button
  3. Enter the new seed description.
  4. Select Dropbox from the Type list.
  5. Dropbox Seed: The subdirectory to crawl. This value will be appended to the base path of the connection.
  6. Connector: The ID of the connector to be used with this seed. The connector type must match the seed type.
  7. Connection: The ID of the connection to be used with this seed. The connection type must match the seed type.
  8. Workflow: The IDs of the workflows that will be executed for the documents crawled.
  9. Tag: The tags of the seed, these can be used to filter the seed.
  10. Policies
    1. Throttle Policy: Select the throttle policy that applies to this connection object.
    2. Routing Policies: Select the routing policies that this connection will use.










  • No labels