The seeds API provides functionality that allows a administrator to perform actions such as adding and configuring a seed to crawl, or beginning or stopping a crawl
Easy Heading Free | ||||
---|---|---|---|---|
| ||||
Section | |||||||
---|---|---|---|---|---|---|---|
Get all seedsLists all the seeds configured in the Aspire, this endpoint need the at least the OPERATOR role to be executed.
Query String Parameters | |||||||
Name | Type | Required | Description | ||||
from | integer | Optional | Indicates the initial page to be retrieved | ||||
size | integer | Optional | Specifies the size of results page | ||||
sortBy | string | Optional | Field by which results are sorted | ||||
sortMode | string | Optional | Sort mode
| ||||
$expand | string | Optional | List of fields to expand, * will expand everything |
Section | |||||||
---|---|---|---|---|---|---|---|
Get all seeds, filteredLists seeds configured in the Aspire, filtered by a specified criteria, this endpoint need the at least the OPERATOR role to be executed.
Pagination query string parameters Sorting query string parameters Expand query string parameters: connector, workflows, connection, policies |
Response
Code Block | ||||
---|---|---|---|---|
| ||||
{
"count": {
"totalItems": 1
},
"seed": [
{ |
Response
Code Block | ||
---|---|---|
| ||
{ "seed": [ { "id": "191283d9-183e-4820-8932-32b1fa07d2d5", "description": "2500 test", "seed": "c:\\testdata\\2500", "connector": { "id": "accd3396b4adeb8c-60043deb-47c94379-80a6ad52-d6ae283878f5e2a8d219a84a", "descriptiontype": "NetApp Connectorfilesystem", "typedescription": {"pepoSeed", "idconnector": "filesystem16e901a5-75c7-4969-90d2-70ad299916f3", "nameseed": "File SystemDirectory1", }, "createdpriority": 1596707252548"medium", "updatedchecksum": 1596707252548 "11dde01482437ccce0fc570b3041f05ede06d2be6ad8ff18e3a3119f58593a40", }, "workflowcrawl": { "id": "accd3396-4820-8932-80a6-f57191283d98", "descriptionmanager": "My workflowmanager_192.168.0.16:40505//AAABeOQLewo=", "type": "connector", "createdmode": 1596707252548"full", "updated": 1596707252548 }, "phase": "idle", "prioritystate": "mediumcompleted", "tags": [ "UKstart": 1618736207176, "GE", "FRend": 1618736273635 ] }, "checksum "connection": "499207DDF2E673B3B33D74566D7457B598960f72-aab0-4ba1-a90e-b29d4e3c2c92", "crawl": { "managerworkflows": "manager_192.168.188.55:50505//AAABc8Mnl84=",72022651-c2f4-45a9-9e18-2b0ace529cda" "mode": "full",} "phase": "crawlStart", "state": "running", "start": 1596707252548, ] } |
Status: 200
Section | ||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Get a single seedGet information about a single seed configured in Aspire, this endpoint need the at least the OPERATOR role to be executed.
Expand query string parameters: connector, workflows, connection, policies Path Parameters
Response
Status | ||||||||||||||||||||||
Response code | Description | |||||||||||||||||||||
200 | Success | |||||||||||||||||||||
Section | ||||||||||||||||||||||
Status: 200, 404 |
Section | |||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Add seed(s)Add seeds to Aspire, this endpoint need the at least the ADMINISTRATOR role to be executed. Get all seeds, filteredLists seeds configured in the Aspire, filtered by a specified criteria
Query String Body Parameters
Body Parameters | |||||||||||||||||||||||||||||||
Name | Type | Required | Description | ||||||||||||||||||||||||||||
filter | JSON | Required | Filters retrieved seeds. Check the filter definition here |
Required | The url/path indicating the content to crawl | ||
type | string | Required | The type of connector to use for this seed (may be omitted if connector is specified) |
connector | string | Required | The identifier of the connector configuration to use for this seed (may be omitted if type is specified) - see Connectors API |
description | string | Required | An description of the seed |
connection | string | Required | a connection id - see Connections API |
credential | string | Optional | An optional id of the credential to use for this seed - see Credentials API |
throttlePolicy | string | Optional | a throttle policy id - see Policies API |
routingPolicies | string | Optional | An optional list of the routing policy identifiers to use for this seed - see Policies API |
deleteIncrementalPolicy | string | Optional | (from 5.0.2) A delete policy - see Policies API |
workflows | string | Optional | An optional list of the workflow identifiers to use for this seed - see Workflow API |
tags | string | Optional | An optional list of the tags to use for this seed |
properties | object | Optional | Seed properties |
ExampleResponse
Code Block | ||||
---|---|---|---|---|
| ||||
POST /aspire/_api/seeds [{ "seed": [ { "id": "191283d9-183e-4820-8932-32b1fa07d2d5"\\Directory1", "connector":"connectorId", "connection":"connectionId", "type":"filesystem", "descriptionthrottlePolicy": "2500 testthrottlePolicyId", "seedroutingPolicies": "c:\\testdata\\2500"["routingPolicyId1", "routingPolicyId2"], "deleteIncrementalPolicy" : "connectordeletePolicyId": { .... }, { "seed":"\\Directory2", "idconnector": "accd3396-6004-47c9-80a6-d6ae283878f5"connectorId", "descriptionconnection": "NetApp ConnectorconnectionId", "type": {"filesystem", .... "idroutingPolicies": ["filesystempolicy_1"], "nameworkflows": ["workflow_1","workflow_99"] }] |
Response
Code Block | ||||
---|---|---|---|---|
| ||||
{ "seed": [{ "File System" }, "createdid": 1596707252548"5d0b35d5-c946-44e7-9be5-97c9ad9036a3", "updated": 1596707252548 "connector": "accd3396-6004-47c9-80a6-d6ae283878f5", }"seed": "c:\\testdata\\2500", "workflowpriority": { "medium", "idchecksum": "accd3396-4820-8932-80a6-f57191283d985647E40827A6C09CBA868294BB437CE5", "crawl": { "descriptionphase": "My workflowidle", "typestate": "connectornever", } }, { "createdid": 1596707252548"5d0b35d5-c946-44e7-9be5-97c9ad9036a3", "updatedconnector": 1596707252548 "connector_1", "description": }"250,000 files", "prioritycredential": "mediumcred_1", "tagsthrottlePolicy": ["policy_1", "UK","workflow": ["workflow_1","workflow_99"] "GE"seed": "c:\\testdata\\25000", "FR" ]"priority": "medium", "checksum": "499207DDF2E673B3B33D74566D7457B55647E40827A6C09CBA868294BB437CE5", "crawl": { "managerphase": "manager_192.168.188.55:50505//AAABc8Mnl84=idle", "modestate": "fullnever", } }, "phaseproperties": "crawlStart", { This will be a dynamic "state": "running", "start": 1596707252548, "next": 1596707252548 }, "properties": { This will be a dynamic JSON JSON object } ] }, { "id": "5d0b35d5-c946-44e7-9be5-97c9ad9036a3", "seed": "c:\\testdata\\2500", "connector": { "id": "accd3396-6004-47c9-80a6-d6ae283878f5", "description": "NetApp Connector", "type": { "id": "filesystem", "name": "File System" }, "created": 1596707252548, "updated": 1596707252548 }, "workflow": { "id": "accd3396-4820-8932-80a6-f57191283d98", "description": "Stager Workflow", "type": "connector", "created": 1596707252548, "updated": 1596707252548 }, "priority": "medium", "checksum": "5647E40827A6C09CBA868294BB437CE5", "crawl": { "phase": "idle", "state": "never" }, "properties": { This will be a dynamic JSON object } } ] } |
Status
Get information about a single seed configured in Aspire
Panel | ||||
---|---|---|---|---|
| ||||
|
Path Parameters
Response
Code Block | ||
---|---|---|
| ||
{
"seed": {
"id": "191283d9-183e-4820-8932-32b1fa07d2d5",
"connector": "accd3396-6004-47c9-80a6-d6ae283878f5",
"seed": "c:\\testdata\\2500",
"priority": "medium",
"checksum": "499207DDF2E673B3B33D74566D7457B5",
"crawl": {
"manager": "manager_192.168.188.55:50505//AAABc8Mnl84=",
"mode": "full",
"phase": "crawlStart",
"state": "running",
"start": 1596707252548
},
"properties": { This will be a dynamic JSON object }
}
} |
Status
Add seeds to Aspire
Panel | ||||
---|---|---|---|---|
| ||||
POST /aspire/_api/seeds |
Body Parameters
} |
See Response Body for details regarding the response body returned where multiple items are affected with some (or all) returning errors
Status: 201, 406
Section | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Update seed(s)Update seeds in Aspire, this endpoint need the at least the ADMINISTRATOR role to be executed.
Body Parameters
x - at least one field must be present Example for more seeds
Response
See Response Body for details regarding the response body returned where multiple items are affected with some (or all) returning errors Status: 200, 404, 406
|
Section | |||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Delete seed(s)Delete one or more seeds from Aspire, this endpoint need the at least the ADMINISTRATOR role to be executed.
Path Parameters and query parameters
Body parameters
Example
Response
Status: 200, 404, 406
|
Section | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Crawl controlStart, stop, pause and resume crawls of one or more seeds, this endpoint need the at least the OPERATOR role to be executed.
Path Parameters
Query String Parameters
Body Optionally, a filter can be added to specify which seeds to start Examples Starts an incremental crawl for a single seed
Starts an full crawl for a single seed
Reprocess only errored documents from the previous crawl
Pauses a crawl for a single seed
Starts a crawl for multiple seeds
Starts a crawl for multiple seeds (alternative)
Response
Status: 200, 404, 406 |
Section | |||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Export seed(s)Export one or more seed from Aspire, this endpoint needs at least the OPERATOR role to be executed. |
Code Block | ||
---|---|---|
| ||
POST /aspire/_api/seeds
[{
"seed": "c:\\testdata\\2500",
"type": "filesystem"
},
{
"seed": "c:\\testdata\\250000",
"connector": "connector_1",
"description": "250,000 files",
"credential": "cred_1",
"policy": "policy_1",
"workflow": ["workflow_1","workflow_99"]
}] |
Response
Code Block | ||
---|---|---|
| ||
{
"seed": [{
"id": "5d0b35d5-c946-44e7-9be5-97c9ad9036a3",
"connector": "accd3396-6004-47c9-80a6-d6ae283878f5",
"seed": "c:\\testdata\\2500",
"priority": "medium",
"checksum": "5647E40827A6C09CBA868294BB437CE5",
"crawl": {
"phase": "idle",
"state": "never"
}
},
{
"id": "5d0b35d5-c946-44e7-9be5-97c9ad9036a3",
"connector": "connector_1",
"description": "250,000 files",
"credential": "cred_1",
"policy": "policy_1",
"workflow": ["workflow_1","workflow_99"]
"seed": "c:\\testdata\\25000",
"priority": "medium",
"checksum": "5647E40827A6C09CBA868294BB437CE5",
"crawl": {
"phase": "idle",
"state": "never"
}
},
"properties": { This will be a dynamic JSON object }]
} |
Status
Update seeds in Aspire.
Panel | ||||
---|---|---|---|---|
| ||||
|
Body Parameters
|
Info |
---|
Every configuration item has the option to export from the UI, using the single menu or by the bulk actions: |
Note |
---|
Something important that you need to know is that when you export a config item that depends on another, the export will contain also all the dependencies. |
Note |
---|
Take into consideration that components with resources loaded into elastic, will be exported, but the resource itself will not, so you will need to reupload the resource and go and select your resource in the component again. |
Path Parameters and Query parameters
Name | Type | Required | Description |
---|---|---|---|
id | string | Required | The identifier(s) of the seed(s) to export |
Body Parameter
Name | Type | Required | Description |
---|---|---|---|
ids | string | Required | The identifier(s) of the seed(s) to export |
Examples
Code Block | ||||
---|---|---|---|---|
| ||||
GET |
Example
Code Block | ||
---|---|---|
| ||
PUT /aspire/_api/seeds/export/AAABcID5GBc { "AAABcID5GBc=": DELETE /aspire/_api/seeds/export?id=AAABcID5GBc&id=AAABcID5GBd POST /aspire/_api/seeds/export { "idids": ["AAABcID5GBc=", "seed": "c:\\testdata\\2500","AAABcID5GBd"] } |
Response
Code Block | ||||
---|---|---|---|---|
| ||||
{ "export": { "typeseeds": "filesystem"{ }, "AAABcIueWUc=seed": [ { "id": "AAABcIueWUc=<seed_id>", "seedtype": "c:\\testdata\\250000rest-api", "connectordescription": "connector_1REST", "description "connector": "250,000 files<connector_id>", "credentialseed": "cred_1N\/A", "policy "priority": "policy_1medium", "workflowchecksum": ["workflow_1eb4b51659226093casdf3854sdf8f67e4f0de8217c0fd86ea565ce0","workflow_99"] } } |
Response
Code Block | ||
---|---|---|
| ||
{ "seed": [{ "idconnection": "AAABcID5GBc=<connection_id>", "seed "properties": "c:\\testdata\\2500",{ "type": "filesystem", "statusseed": "N\/A", }, { "idcrawlRules": "AAABcIueWUc=",[ "type": "filesystem", { "seed": "c:\\testdata\\250000", "connectorconditionalScript": "connector_1"false, "description": "250,000 files", "credential": "cred_1", "policyentityType": "policy_1root", "workflow": ["workflow_1","workflow_99"] "shouldStop": false, "status": "N" }, "properties": { This will be a dynamic JSON object }] } |
Status
Delete multiple seeds from Aspire, filtered by a specified criteria
Panel | ||||
---|---|---|---|---|
| ||||
|
Body Parameters
Response
Code Block | ||
---|---|---|
| ||
{
"message": "optional response message"
} |
See Response Body for details regrading the response body returned where multiple items are affected with some (or all) returning errors
Status
Delete one or more seeds from Aspire.
Panel | ||||
---|---|---|---|---|
| ||||
|
Query String Parameters
Example
Code Block | ||
---|---|---|
| ||
DELETE /aspire/_api/seeds/AAABcID5GBc%3D |
Response
Code Block | ||
---|---|---|
| ||
{
"message": "optional response message"
} |
Status
...
}
],
"stopOnScannerError": true
}
},
...
]
},
"connectors": {
"connector": [
{
"id": "<connector_id>",
"artifact": "com.accenture.aspire:aspire-rest-source",
"type": "rest-api",
"description": "RestConnector",
"properties": {
"debug": false,
"wDebug": false,
...
},
"checksum": "82a70c88cbfa46dfd79d6430bfesdf5646c13089604fb609831f16f"
},
...
]
},
"credentials": {
"credential": [
{
"id": "<credential_id>",
"type": "rest-api",
"description": "RestCredentials",
"properties": {
"type": "bearer",
"query": {
...
}
}
},
...
]
},
"connections": {
"connection": [
{
"id": "<connection_id>",
"type": "rest-api",
"description": "RestConnection",
"credential": "<credential_id>",
"properties": {
"maxRetries": 3,
"useThrottling": false,
"throttling": "throttling_false",
"useProxy": false,
"proxy": "proxy_false",
"trustAllCertificates": false,
...
}
},
...
]
},
"policies": {
"policy": [
{
"id": "<policy_id>",
"type": "throttle",
"description": "pT",
"period": "day",
"value": 1
},
...
]
},
"schedules": {
"schedule": [
{
"id": "<schedule_id>",
"type": "time",
"description": "test",
"enabled": "false",
"scheduleTimeType": "daily",
"stopOnFail": false,
"schedule": "0 0 0 1\/1 * ?",
"after": null,
"seeds": "<seed_id>",
"crawlMode": "full",
"completeThreshold": 1.0,
"action": "pause"
},
...
]
},
"workflows": {
"workflow": [
{
"id": "<workflow_id>",
"type": "connector",
"description": "myWorkFlow",
"checksum": "dc7d632e4fac3aed7404d2c260sd3f54eea266f9fd4af73b6251d6cb",
"templates": {
...
},
"events": {
"event": [
...
]
},
"rules": {
"rule": [
...
]
}
},
...
]
}
}
} |
Status: 200, 404, 406
Section | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Export multiple seeds, filteredExport multiple seeds from Aspire, filtered by a specified criteria, this endpoint needs at least the OPERATOR role to be executed.
Filters: The connection filter definition here Response
Status: 200 |
Section |
---|
ImportThe import usage can be found here |
Section | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Filters
Some endpoint queries require a filter. A filter is basically a JSON object with the following format: Seed filter:
| |||||||||||||
Section |
Panel | ||||
---|---|---|---|---|
| ||||
|
Path, Query String and Request Body Objects
The action to perform:
Defaults to start if not specified
The type of crawl to start:
Defaults to incremental if not specified
Examples
Starts an incremental crawl for a single seed
Code Block | ||
---|---|---|
| ||
POST /aspire/_api/seeds/191283d9-183e-4820-8932-32b1fa07d2d5/control |
Starts an full crawl for a single seed
Code Block | ||
---|---|---|
| ||
POST /aspire/_api/seeds/191283d9-183e-4820-8932-32b1fa07d2d5/control?action=start&type=full |
Pauses a crawl for a single seed
Code Block | ||
---|---|---|
| ||
POST /aspire/_api/seeds/191283d9-183e-4820-8932-32b1fa07d2d5/control?action=pause |
Starts a crawl for multiple seeds
Code Block | ||
---|---|---|
| ||
POST /aspire/_api/seeds/control
[{
"id": "AAABcID5GBc="
},
{
"id": "AAABcIueWUc="
}] |
Starts a crawl for multiple seeds (alternative)
Code Block | ||
---|---|---|
| ||
PUT /aspire/_api/seeds/control
{
"id": ["AAABcID5GBc=", "AAABcIueWUc="]
} |
Response
Code Block | ||
---|---|---|
| ||
{
"message": "optional response message"
} |
Status
Allows an administrator to manually re-balance the seed to manager allocation for active crawls
Panel | ||||
---|---|---|---|---|
| ||||
|
Code Block | ||
---|---|---|
| ||
{
"message": "optional response message"
} |
Status
Returns the dxf for a specific seed type
Panel | ||||
---|---|---|---|---|
| ||||
GET /aspire/_api/seeds/type/:typeId/dxf |
Query String Parameters
Response
Code Block | ||
---|---|---|
| ||
{
"dxf": {...}
"message": "optional response message"
} |
Status
Some endpoint queries require a filter. A filter is basically a JSON object with the following format:
Credentials filter:
Code Block | ||
---|---|---|
| ||
"filter" : {
"ids" : ["id1", "id2", "id3"],
"type" : "TYPE",
"description" : "DESCRIPTION",
"running": "true|false"
}
|
Note |
---|
When using delete endpoints, ids in the filter are mandatory. |