The Elasticsearch Connector will crawl content from a Elasticsearch repository.
Introduction
The Elasticsearch connector retrieves documents stored in an Elastic index using an Elasticsearch query to filter the documents to extract.
Environment and Access Requirements
Repository Support
The Elasticsearch connector supports crawling the following the repositories:
| Repository | Version | Connector Version |
|---|---|---|
| Elasticsearch | ALL | 5.0 |
Account Privileges
For the Elasticsearch connector to be able to crawl content, the Aspire Worker nodes must be run with an account with (permissions).
If authentication is enabled in the Elasticsearch server, a user account with sufficient privileges must be supplied.
Environment Requirements
Framework and Connector Features
Framework Features
| Name | Supported |
|---|---|
| Content Crawling | yes |
| Identity Crawling | no |
| Snapshot-based Incrementals | yes |
| Non-snapshot-based Incrementals | yes |
| Document Hierarchy |
Connector Features
The Elasticsearch connector has the following features:
- Extract documents from multiple Elasticsearch indexes
- Use of Query DSL to define queries.
- Slice support for querying
- Basic and AWS Signature V4 Authentication.
- Use of Get or MGet Elasticsearch methods for fetching content.
Content Crawled
The Elasticsearch connector is able to crawl the following objects:
| Name | Type | Relevant Metadata | Content Fetch and Extraction | Description |
|---|---|---|---|---|
| Indexes | container | N/A | The ones that hold the documents. | |
| Documents | document | Yes | The documents hold by indices. A document can be any structured data (numbers, strings, dates, etc) encoded in JSON. |
Limitations
No limitations defined
Overview
Content Tools
Copyright © 2024 Accenture
