Step 3. Add the Elasticsearch Publisher to the Workflow
Select the event for which you want to add the Elasticsearch Publisher to, from the Event combo.
To add a Elasticsearch Publisher drag the Elasticsearch Publisher from the Rules Section on the right side of the screen and drop it below the Workflow Event to the left side of the screen. This will automatically open the Elasticsearch Publisher window for the configuration of the publisher.
Step 3a. Specify a description for the Publisher
In top section of the ElasticSearch Publisher configuration window, specify the description for the publisher.
Step 3b. Specify Server Configuration
In the Server section of the ElasticSearch Publisher configuration, specify the information related to the server.
ElasticSearch URL: Select how you want to enter the ElasticSearch URL
Host and port
ElasticSearch Host: Enter the ElasticSearch host.
ElasticSearch Port: Enter the ElasticSearch port (9200 by default)
Complete Url
ElasticSearch URL: Enter the url for the ElasticSearch bulk index endpoint, it must have this format <protocol>://<host>:<port>/_bulk
ElasticSearch Index: Enter the index to which the jobs are going to be publish.
Step 3c. Specify Authentication Configuration
In the Authentication section of the ElasticSearch Publisher configuration, specify the authentication information.
None: The server requires no authentication
Basic: provide credentials for basic authentication
User:Provide the user for basic authentication.
Password: Provide the password for basic authentication.
Amazon Web Service (AWS): provide the configuration to authenticate using AWS
Region: Specify the AWS region to use.
Use credentials provider chain: enable to specify a credentials provider chain
Access key: provide the access key for authentication with AWS.
Secret key: provide the secret key for authentication with AWS.
Step 3d. Specify Transform Documents
In the Transform Documents section of the ElasticSearch Publisher configuration, specify the groovy transformation file path.
Groovy Transform: the default value is set to "${component.home}/config/groovy/transform.groovy" for the default JSON transformation file provided with Aspire. To use a custom file, follow the instructions in JSON Transformation.
Step 3e. Specify Pre/Post Processing Options
In the Pre/Post Processing section of the ElasticSearch Publisher configuration, specify the Pre/Post Processing configuration options.
Clear index on full crawl: select to clear the index on full crawls.
Clear index by: select the approach to clear the index.
Deleting all documents: deletes the documents from the index.
Delete index: deletes the index completely.
Step 3f. Specify Connection Settings Values
In the Connection Settings section of the ElasticSearch Publisher configuration, specify the Connection Settings values for the connection to the server.
Connection Pool:
Timeout Settings:
Connection Throttling:
Retries:
Step 3g. Specify Index Dump Configuration
In the Index Dump section of the ElasticSearch Publisher configuration, specify the Index Dump configuration values.
Max Results per Request: maximum number of documents that the search engine can fetch in a single query.
Page Size: maximum number of documents to fetch by query page.
Id field: the name of the field containing the document id, relative to the top level "hits" node in Elasticsearch.
Url field: the name of the field containing the document url, relative to the top level "hits" node in Elasticsearch.
Timestamp field: the name of the field holding the document feed timestamp, relative to the top level "hits" node in Elasticsearch.
Step 3h. Specify Debug Configuration
In the Debug section of the ElasticSearch Publisher configuration, specify the Debug flag.
Debug: Check to enable debug mode to show debug messages from the publisher.