Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Aspider Web Crawler can be configured using the Aspire Admin UI. It requires the following entities to be created:

  • Credential
  • Connection
  • Connector
  • Seed

Easy Heading Free
navigationTitleOn this Page
wrapNavigationTexttrue
navigationExpandOptionexpand-all-by-default

Create Credential


  1. On the Aspire Admin UI, go to the credentials page page
  2. All existing credentials will be listed. Click on the new button 
  3. Enter the new credential description.
  4. Select Aspider from the Type list.
  5. Fields are divided in sections General, Policy
    • Fill
    ... fill
    • in all required fields (the description of available fields can be found here)

Create Connection


  1. On the Aspire Admin UI, go to the connections page page
  2. All existing connections will be listed. Click on the new button 
  3. Enter the new connection description. 
  4. Select Aspider from the Type list.
  5. Fields are divided in sections Scope, Document processing, Crawler, Connection, Security, Credential, Policy
    • Fill
    ... fill
    • in all required fields (the description of available fields can be found here)

Image AddedImage Removed

Create Connector Instance


For the creation of the Connector object using the Admin UI, check this page.


Create Seed


  1. On the Aspire Admin UI, go to the seeds page page
  2. All existing seed will be listed. Click on the new button 
  3. Enter the new seed description.
  4. Select Aspider from the Type list.
  5. Fields are divided in sections General, Connector, Connection, Workflow, Tag, Policies
    1. Fill
    ... fill
    1. in all required fields (the description of available fields can be found here)