Versions Compared

Old Version 2

changes.mady.by.user Gerald Holgado

Saved on

compared with

New Version Current

changes.mady.by.user Pablo Bonilla

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Elasticsearch Connector will The Elasticsearch Connector will crawl content from a Elasticsearch repositoryan Elasticsearch repository.


Easy Heading Free
navigationTitleOn this Page
wrapNavigationTexttrue
navigationExpandOptionexpand-all-by-default

Introduction

The Elasticsearch connector retrieves documents stored in an Elastic index using an Elasticsearch query to filter the documents to extract.

Environment and Access Requirements

Repository Support

The Elasticsearch connector supports crawling Elasticsearch connector supports crawling the following the repositories:

RepositoryVersionConnector Version
ElasticsearchALL5.0

Account Privileges

For the Elasticsearch connector the Elasticsearch connector to be able to crawl content, the Aspire Worker nodes must be run with an account with (permissions)that has the necessary permissions.

If authentication is enabled in the Elasticsearch serverthe Elasticsearch server, a user account with sufficient privileges must be supplied.

Environment Requirements


Framework and Connector Features

Framework Features

Name Supported
Content CrawlingYESyes
Identity CrawlingNOno
Snapshot-based IncrementalsYESyes
Non-snapshot-based IncrementalsNOno
Document HierarchyNOno

Connector Features

The Elasticsearch connector has the following features:

  • Extract documents from multiple Elasticsearch indexesElasticsearch indexes
  • Use of  Query DSL to define queries.
  • Slice support for querying
  • Basic and AWS Signature V4 Authentication.
  • Use of Get or MGet Elasticsearch methods for fetching content.


Content Crawled

The Elasticsearch connector is able to crawl the following objects:

NameTypeRelevant MetadataContent Fetch and ExtractionDescription
Limitations
Indexescontainer
N/AThe
Elasticsearch Connector has the following limitations:
ones that hold the documents.
Documentsdocument
YesThe documents hold by indices. A document can be any structured data (numbers, strings, dates, etc.) encoded in JSON. 

Limitations

No limitations defined

<Limitation 1>