The Aspider Web Crawler can be configured using the Aspire Admin UI. It requires the following entities to be created:

  • Credential
  • Connection
  • Connector
  • Seed

Create Credential


  1. On the Aspire Admin UI, go to the credentials page
  2. All existing credentials will be listed. Click on the new button 
  3. Enter the new credential description.
  4. Select Aspider from the Type list.
  5. Fields are divided in sections General, Policy
    • Fill in all required fields (the description of available fields can be found here)

Create Connection


  1. On the Aspire Admin UI, go to the connections page
  2. All existing connections will be listed. Click on the new button 
  3. Enter the new connection description. 
  4. Select Aspider from the Type list.
  5. Fields are divided in sections Scope, Document processing, Crawler, Connection, Security, Credential, Policy
    • Fill in all required fields (the description of available fields can be found here)

Create Connector Instance


For the creation of the Connector object using the Admin UI, check this page.


Create Seed


  1. On the Aspire Admin UI, go to the seeds page
  2. All existing seed will be listed. Click on the new button 
  3. Enter the new seed description.
  4. Select Aspider from the Type list.
  5. Fields are divided in sections General, Connector, Connection, Workflow, Tag, Policies
    1. Fill in all required fields (the description of available fields can be found here)

  • No labels