The Aspider Web Crawler can be configured using the Aspire Admin UI. It requires the following entities to be created:
Credential
Connection
Connector
Seed
Create Credential
On the Aspire Admin UI go to the credentials page
All existing credentials will be listed. Click on the new button
Enter the new credential description.
Select Dropbox from the Type list.
General: In Authentication you need to insert.
Application Identifier: Name of your app.
Access Token: Token represents a user and app pair, in order to operate on that team, to the extent allowed by that app's permissions.
Note: On September 30th, 2021, Dropbox will retire the creation of long-lived access tokens — resulting in all new tokens being short-lived and expires in 4 hours.
Create Connection
On the Aspire Admin UI go to the connections page
All existing connections will be listed. Click on the new button
Enter the new connection description.
Select Dropbox from the Type list.
Policies
Throttle Policy: Select the throttle policy that applies to this connection object.
Routing Policies: Select the routing policies that this connection will use.
Create Connector Instance
For the creation of the Connector object using the Admin UI check thispage.
Create Seed
On the Aspire Admin UI go to the seeds page
All existing seed will be listed. Click on the new button