There are two ways of how to configure the Aspider web crawler:
Configure the Aspider web crawler using the Aspire Rest API
Configure the Aspider web crawler using the Aspire Admin API.