New on Aspire 5, Crawls can be regulated in terms how often and where the work gets distributed. This regulation is applied based on so called Policies and they get applied by the Aspire Manager nodes.
There are two kinds of policies:
REST Endpoint reference: Policies REST API