Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Warning
titlePage in development

This page is in development and as such, its contents may be incorrect

The seeds API provides functionality that allows a administrator to perform actions such as adding and configuring a seed to crawl, or beginning or stopping a crawl

Table of Contents

Pagination query string parameters


Response

Section

Get all seeds

Lists all the seeds configured in the Aspire

Panel
borderColorblack
bgColor#fafafb
GET /aspire/_api/seeds

Query String Parameters

NameTypeRequiredDescription
fromintegerOptionalIndicates the initial page to be retrieved
sizeintegerOptionalSpecifies the size of results page
sortBystringOptionalField by which results are sorted
sortModestringOptional

Sort mode

  • "asc" for ascending sort,
  • "desc" for descending sort
expandstringOptionalList of fields to expand, * will expand everything
Code Block
languagejs
{
  "seed": [
    {
      "id": "191283d9-183e-4820-8932-32b1fa07d2d5",
      "description": "2500 test",
      "seed": "c:\\testdata\\2500",
      "connector": {
        "id": "accd3396-6004-47c9-80a6-d6ae283878f5",
        "description": "NetApp Connector",
        "type": {
          "id": "filesystem",
          "name": "File System"
        },
        "created": 1596707252548,
        "updated": 1596707252548 
      },
      "workflow": {
        "id": "accd3396-4820-8932-80a6-f57191283d98",
        "description": "My workflow",
        "type": "connector",
        "created": 1596707252548,
        "updated": 1596707252548 
      },
      "priority": "medium",
      "tags": [
        "UK",
        "GE",
        "FR"
      ],
      "checksum": "499207DDF2E673B3B33D74566D7457B5",
      "crawl": {
        "manager": "manager_192.168.188.55:50505//AAABc8Mnl84=",
        "mode": "full",
        "phase": "crawlStart",
        "state": "running",
        "start": 1596707252548,
        "next": 1596707252548
      },
   	  "properties": { This will be a dynamic JSON object } 
    },
    {
      "id": "5d0b35d5-c946-44e7-9be5-97c9ad9036a3",
      "seed": "c:\\testdata\\2500",
      "connector": {
        "id": "accd3396-6004-47c9-80a6-d6ae283878f5",
        "description": "NetApp Connector",
        "type": {
          "id": "filesystem",
          "name": "File System"
        },
        "created": 1596707252548,
        "updated": 1596707252548 
      },
      "workflow": {
        "id": "accd3396-4820-8932-80a6-f57191283d98",
        "description": "Stager Workflow",
        "type": "connector",
        "created": 1596707252548,
        "updated": 1596707252548 
      },
      "priority": "medium",
      "checksum": "5647E40827A6C09CBA868294BB437CE5",
      "crawl": {
        "phase": "idle",
        "state": "never"
      },
 	  "properties": { This will be a dynamic JSON object } 
    }
  ]
}


Status

Response codeDescription
200Success




Section

Get all seeds, filtered

Lists seeds configured in the Aspire, filtered by a specified criteria

Panel
borderColorblack
bgColor#fafafb

POST /aspire/_api/seeds/getAll

Query String Parameters

black
bgColor#fafafb

POST /aspire/_api/seeds/getAll

Pagination query string parameters

Common filter (TODO specific filter here)

TODO: expand here!


Query String Parameters

Sort mode

  • "asc" for ascending sort,
  • "desc" for descending sort
    NameTypeRequiredDescription
    NameTypeRequiredDescription
    fromintegerOptionalIndicates the initial page to be retrieved
    sizeintegerOptionalSpecifies the size of results page
    sortBystringOptionalField by which results are sorted
    sortModestringOptional
    expandstringOptionalList of fields to expand, * will expand everything


    Body Parameters

    NameTypeRequiredDescription
    filterJSONRequiredFilters retrieved seeds. Check the filter definition here


    Response

    Code Block
    languagejs
    {
      "seed": [
        {
          "id": "191283d9-183e-4820-8932-32b1fa07d2d5",
          "description": "2500 test",
          "seed": "c:\\testdata\\2500",
          "connector": {
            "id": "accd3396-6004-47c9-80a6-d6ae283878f5",
            "description": "NetApp Connector",
            "type": {
              "id": "filesystem",
              "name": "File System"
            },
            "created": 1596707252548,
            "updated": 1596707252548 
          },
          "workflow": {
            "id": "accd3396-4820-8932-80a6-f57191283d98",
            "description": "My workflow",
            "type": "connector",
            "created": 1596707252548,
            "updated": 1596707252548 
          },
          "priority": "medium",
          "tags": [
            "UK",
            "GE",
            "FR"
          ],
          "checksum": "499207DDF2E673B3B33D74566D7457B5",
          "crawl": {
            "manager": "manager_192.168.188.55:50505//AAABc8Mnl84=",
            "mode": "full",
            "phase": "crawlStart",
            "state": "running",
            "start": 1596707252548,
            "next": 1596707252548
          },
       	  "properties": { This will be a dynamic JSON object } 
        },
        {
          "id": "5d0b35d5-c946-44e7-9be5-97c9ad9036a3",
          "seed": "c:\\testdata\\2500",
          "connector": {
            "id": "accd3396-6004-47c9-80a6-d6ae283878f5",
            "description": "NetApp Connector",
            "type": {
              "id": "filesystem",
              "name": "File System"
            },
            "created": 1596707252548,
            "updated": 1596707252548 
          },
          "workflow": {
            "id": "accd3396-4820-8932-80a6-f57191283d98",
            "description": "Stager Workflow",
            "type": "connector",
            "created": 1596707252548,
            "updated": 1596707252548 
          },
          "priority": "medium",
          "checksum": "5647E40827A6C09CBA868294BB437CE5",
          "crawl": {
            "phase": "idle",
            "state": "never"
          },
     	  "properties": { This will be a dynamic JSON object } 
        }
      ]
    }


    Status

    Response codeDescription
    200Success




    Section

    Get a single seed

    Get information about a single seed configured in Aspire

    Panel
    borderColorblack
    bgColor#fafafb

    GET /aspire/_api/seeds/:id


    Path Parameters

    NameTypeRequiredDescription
    idstringRequiredThe id of the seed to return


    Query String Parameters

    NameTypeRequiredDescription
    expandstringOptionalList of fields to expand, * will expand everything


    Response

    Code Block
    languagejs
    {
      "seed": {
        "id": "191283d9-183e-4820-8932-32b1fa07d2d5",
        "connector": "accd3396-6004-47c9-80a6-d6ae283878f5",
        "seed": "c:\\testdata\\2500",
        "priority": "medium",
        "checksum": "499207DDF2E673B3B33D74566D7457B5",
        "crawl": {
          "manager": "manager_192.168.188.55:50505//AAABc8Mnl84=",
          "mode": "full",
          "phase": "crawlStart",
          "state": "running",
          "start": 1596707252548
        },
    	"properties": { This will be a dynamic JSON object } 
      }
    }


    Status

    Response codeDescription
    200Success
    404The given seed id was not found




    Section

    Add seeds

    Add seeds to Aspire

    Panel
    borderColorblack
    bgColor#fafafb
    POST /aspire/_api/seeds


    Body Parameters

    NameTypeRequiredDescription
    seedstringRequiredThe url/path indicating the content to crawl
    typestringRequiredThe type of connector to use for this seed (may be omitted if connector is specified)
    connectorstringRequiredThe identifier of the connector configuration to use for this seed (may be omitted if type is specified)
    descriptionstringRequiredAn optional description of the seed
    credentialstringOptionalAn optional id of the credential to use for this seed
    policystringOptionalAn optional list of the policy identifiers to use for this seed
    workflowstringOptionalAn optional list of the workflow identifiers to use for this seed


    Example

    Code Block
    languagejs
    POST /aspire/_api/seeds
    [{
      "seed": "c:\\testdata\\2500",
      "type": "filesystem"
    },
    {
      "seed": "c:\\testdata\\250000",
      "connector": "connector_1",
      "description": "250,000 files",
      "credential": "cred_1",
      "policy": "policy_1",
      "workflow": ["workflow_1","workflow_99"]
    }]


    Response

    Code Block
    languagejs
    {
      "seed": [{
        "id": "5d0b35d5-c946-44e7-9be5-97c9ad9036a3",
        "connector": "accd3396-6004-47c9-80a6-d6ae283878f5",
        "seed": "c:\\testdata\\2500",
        "priority": "medium",
        "checksum": "5647E40827A6C09CBA868294BB437CE5",
        "crawl": {
          "phase": "idle",
          "state": "never"
        }
      },
      {
        "id": "5d0b35d5-c946-44e7-9be5-97c9ad9036a3",
        "connector": "connector_1",
        "description": "250,000 files",
        "credential": "cred_1",
        "policy": "policy_1",
        "workflow": ["workflow_1","workflow_99"]
        "seed": "c:\\testdata\\25000",
        "priority": "medium",
        "checksum": "5647E40827A6C09CBA868294BB437CE5",
        "crawl": {
          "phase": "idle",
          "state": "never"
        }
      }, 
      "properties": { This will be a dynamic JSON object }]
    }


    Status

    Response codeDescription
    201Created
    406Not acceptable - there was an issue validating the input




    Section

    Update seeds

    Update seeds in Aspire.

    Panel
    borderColorblack
    bgColor#fafafb

    PUT /aspire/_api/seeds


    Body Parameters

    NameTypeRequiredDescription
    idstringRequiredThe identifier of the seed to update
    seedstringRequiredThe url / path indicating the content to crawl
    typestringRequiredThe type of connector to use for this seed (may be omitted if connector is specified)
    connectorstringRequiredThe identifier of the connector configuration to use for this seed (may be omitted if type is specified)
    descriptionstringOptionalAn optional description of the seed
    credentialstringOptionalAn optional id of the credential to use for this seed
    policystringOptionalAn optional list of the policy identifiers to use for this seed
    workflowstringOptionalAn optional list of the workflow identifiers to use for this seed


    Example

    Code Block
    languagejs
    PUT /aspire/_api/seeds
    {
      "AAABcID5GBc=": {
        "id": "AAABcID5GBc=",
        "seed": "c:\\testdata\\2500",
        "type": "filesystem"
      },
      "AAABcIueWUc=": {
        "id": "AAABcIueWUc=",
        "seed": "c:\\testdata\\250000",
        "connector": "connector_1",
        "description": "250,000 files",
        "credential": "cred_1",
        "policy": "policy_1",
        "workflow": ["workflow_1","workflow_99"]
      }
    }


    Response

    Code Block
    languagejs
    {
      "seed": [{
        "id": "AAABcID5GBc=",
        "seed": "c:\\testdata\\2500",
        "type": "filesystem",
        "status": "N"
       },
       {
        "id": "AAABcIueWUc=",
        "type": "filesystem",
        "seed": "c:\\testdata\\250000",
        "connector": "connector_1",
        "description": "250,000 files",
        "credential": "cred_1",
        "policy": "policy_1",
        "workflow": ["workflow_1","workflow_99"]
        "status": "N"
      },
      "properties": { This will be a dynamic JSON object }]
    }


    Status

    Response codeDescription
    200Success
    404Not found - a given seed identifier was not found
    406Not acceptable - there was an issue validating the input




    Section

    Delete multiple seeds, filtered

    Delete multiple seeds from Aspire, filtered by a specified criteria

    Panel
    borderColorblack
    bgColor#fafafb

    POST /aspire/_api/seeds/deleteAll


    Body Parameters

    NameTypeRequiredDescription
    filterJSONRequiredFilters retrieved seeds. Check the filter definition here


    Response

    Code Block
    languagejs
    {
      "message": "optional response message"
    }

    See Response Body for details regrading the response body returned where multiple items are affected with some (or all) returning errors

    Status

    Response codeDescription
    200Success
    404Not found - a given credential identifier was not found
    406Not acceptable - there was an issue validating the input




    Section

    Delete single seed

    Delete one or more seeds from Aspire.

    Panel
    borderColorblack
    bgColor#fafafb

    DELETE /aspire/_api/seeds/:id


    Path Parameters

    NameTypeRequiredDescription
    idstringRequiredThe identifier(s) of the seed(s) to delete


    Example

    Code Block
    languagejs
    DELETE /aspire/_api/seeds/AAABcID5GBc%3D


    Response

    Code Block
    languagejs
    {
      "message": "optional response message"
    }


    Status

    Response codeDescription
    200Success
    404Not found - a given seed identifier was not found
    406Not acceptable - there was an issue validating the input




    Section

    Crawl control

    Start, stop, pause and resume crawls of one or more seeds.

    Panel
    borderColorblack
    bgColor#fafafb

    POST /aspire/_api/seeds/:id/control

    POST /aspire/_api/seeds/control


    Path Parameters

    NameTypeRequiredDescription
    idstringRequiredThe identifier(s) of the seed(s) to control


    Query String Parameters

    NameTypeRequiredDescription
    actionstringOptional

    The action to perform:

    • start
    • stop
    • pause
    • resume
    • abort

    Defaults to start if not specified

    typestringOptional

    The type of crawl to start:

    • incremental
    • full
    • test

    Defaults to incremental if not specified


    Examples

    Starts an incremental crawl for a single seed

    Code Block
    languagejs
    POST /aspire/_api/seeds/191283d9-183e-4820-8932-32b1fa07d2d5/control

    Starts an full crawl for a single seed

    Code Block
    languagejs
    POST /aspire/_api/seeds/191283d9-183e-4820-8932-32b1fa07d2d5/control?action=start&type=full

    Pauses a crawl for a single seed

    Code Block
    languagejs
    POST /aspire/_api/seeds/191283d9-183e-4820-8932-32b1fa07d2d5/control?action=pause

    Starts a crawl for multiple seeds

    Code Block
    languagejs
    POST /aspire/_api/seeds/control
    [{
      "id": "AAABcID5GBc="
    },
    {
      "id": "AAABcIueWUc="
    }]

    Starts a crawl for multiple seeds (alternative)

    Code Block
    languagejs
    PUT /aspire/_api/seeds/control
    {
      "id": ["AAABcID5GBc=", "AAABcIueWUc="]
    }


    Response

    Code Block
    languagejs
    {
      "message": "optional response message"
    }


    Status

    Response codeDescription
    200Success
    404Not found - a given seed identifier was not found
    406Not acceptable - there was an issue validating the input




    Section

    Re-balance seed allocation

    Allows an administrator to manually re-balance the seed to manager allocation for active crawls

    Panel
    borderColorblack
    bgColor#fafafb

    POST /aspire/_api/seeds/control/rebalance


    Response

    Code Block
    languagejs
    {
      "message": "optional response message"
    }

    Status

    Response codeDescription
    200Success
    404The given batch id was not found
    Section

    Get seed type dxf (TODO)

    Returns the dxf for a specific seed type

    Panel
    borderColorblack
    bgColor#fafafb
    GET /aspire/_api/seeds/type/:typeId/dxf


    Path Parameters

    NameTypeRequiredDescription
    typeIdstringRequiredId of the type of the seed


    Response

    Code Block
    languagejs
    {
      "dxf": {...}
      "message": "optional response message"
    }


    Status

    Response codeDescription
    200Success
    404Not found - a given service identifier was not found




    Section

    Filters
    Anchor
    FiltersAnchor
    FiltersAnchor

     Some endpoint queries require a filter. A filter is basically a JSON object with the following format:

    Credentials filter:

    Code Block
    languagejs
      "filter" : {
        "ids" : ["ID1", "ID2", "ID3", ...],
        "type" : "TYPE",
        "description" : "DESCRIPTION",
    	"seed" : "SEED",
    	"tags" : ["TAG1", "TAG2", "TAG3", ...],
    	"connector" : "CONNECTOR_ID",
    	"status" : "STATUS",
    	"workflows" : ["WORKFLOW_ID1", "WORKFLOWID2", "WORKFLOW_ID3", ...],
    	"policies" : ["POLICY_ID1", "POLICY_ID2", "POLICY_ID3", ...]
      }
    
    Note
    When using endpoints that use this filter, the filter cannot be empty: at least one field of the filter must be specified.