Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Elasticsearch Publisher's "type" must always be specified as "application".

Elasticsearch Publisher's "_type" must always be specified as "publisher".

Elasticsearch Publisher's "description" must be a descriptive string without spaces.

Elasticsearch Publisher's "config" must always be specified as "com.accenture.aspire:aspire-elasticsearch-publisher-source".

Elasticsearch Publisher's "appType" must always be specified as "elasticsearch-publisher".

Elasticsearch Publisher's "appName" must always be specified as "Elasticsearch Publisher".

The Properties specific to the Elasticsearch Publisher are described below.

Easy Heading Free
navigationTitleOn this Page
navigationExpandOptionexpand-all-by-default

ServiceNow Connection Properties


FieldRequiredDefaultMultipleNotesExample
propertiesYes-NoConfiguration object
elasticNoUrlYesfalseNoSelects how to enter the ElasticSearch URL. True: server and port are specified. False: full URL is specified.true / false
elasticUrlNo-NoEnter the url for the ElasticSearch bulk index endpoint, it must have this format <protocol>://<host>:<port>/_bulk . Required if elasticNoUrl is false."http://myServer:9200"
elasticHostNo-NoEnter the ElasticSearch host. Required if elasticNoUrl is true.
"myServer"
elasticPortNo9200NoEnter the ElasticSearch port. Required if elasticNoUrl is true."9201"
elasticIndexYes-NoEnter the index to which the jobs are going to be publish."test-index"
authTypeNo-NoSpecify the authentication information. Allowed values are: "none", "basic" and "aws"."none"
userNo-NoProvide the user for basic authentication. Required if authType is "basic"."john.doe"
passwordNo-NoProvide the password for basic authentication. Required if authType is "basic"."myP@ssword11"
awsRegionNo-NoSpecify the AWS region to use. Required if authType is "aws"."us-east-2"
useCredentialsProviderChainNofalseNoEnable to specify a credentials provider chain.true / false
awsAccessKeyNo-NoProvide the access key for authentication with AWS. Required if authType is "aws" and useCredentialsProviderChain is false."AKIAQYO33L5HIS3N55NN"
awsSecretKeyNo-NoProvide the secret key for authentication with AWS. Required if authType is "aws" and useCredentialsProviderChain is false."PPA3Qt+FqUA4Kk07DRS7w4T6Bya1IWebbcqFmqmI"
transformTypeYes-NoType of the transformation file used."JSON"
transformFileYes-NoPath to the transform file. The default value is set to "${component.home}/config/groovy/transform.groovy" for the default JSON transformation file provided with Aspire."C:\transformfiles\groovy\mytransform.groovy"
processClearNofalseNoSet to true to clear the index on full crawls.true / false
deleteOnClearNofalseNoSet to true to delete the index completely.true / false
uploadMappingsNofalseNoUpload Mappings.true / false
uploadMappingsFromTypeNo"config"NoSource for the mappings. Required if uploadMappingsFrom is true."config"
mappingsTextNo-NoMappings specified directly. Required if uploadMappingsFrom is true and uploadMappingsFromType is "config"."{\"mappings\":{\"properties\":{\"doc._id\":{\"type\":\"text\",\"fields\":{\"keyword\":{\"type\":\"keyword\"}}}}}}"
uploadMappingsFileNo-NoMappings file path.  Required if uploadMappingsFrom is trueand uploadMappingsFromType is not "config"."C:\mappings\myMappings\myMappingsFile.txt"
idleConnectionTimeoutNo-NoMaximum time (in milliseconds) to keep an idle connection open.3600000
maxConnectionsNo-NoMaximum number of connections to be opened.100
maxConnectionsPerRouteNo-NoMaximum number of connections opened for the same target.10
connectionTimeoutNo-NoMaximum time (in milliseconds) to wait for the connection.15000
socketTimeoutNo-NoMaximum time (in milliseconds) to wait for a socket response.15000
useThrottlingNo-NoSet to true to specify Throttling Settings.true / false
throttlingRateNo5000NoTime period (in milliseconds) to throttle the connection.6000
throttlingConnectionRateNo500NoMaximum number of connections used during the Throttling Period.600
maxRetriesNo3NoMaximum number of retries for a failed document.5
retryWaitTimeNo5NoTime period (in milliseconds) to wait before a retry.6000
batchSizeNo-NoMaximum size of the batches that will be created.50
simultaneousBatchesNo-NoNumber of batches that will be processed simultaneously.5
batchTimeoutNo-NoPeriod (in ms) after which a batch of documents will be closed and executed.5000
debugNo-NoSet to true to enable debug mode to show debug messages from the publisher.true / false

Create example


Code Block
themeRDark
titlePOST /aspire/_api/connections
{
	"type": "application",
	"_type": "publisher",
	"description": "ElasticsearchPublisherTest",
	"config": "com.accenture.aspire:aspire-elasticsearch-publisher-source",
	"appType": "elasticsearch-publisher",
	"appName": "Elasticsearch Publisher",
	"properties": {
		"elasticNoUrl": true,
		"elasticHost": "myEShost",
		"elasticPort": 9200,
		"elasticIndex": "test-index",
		"authType": "none",
		"transformType": "JSON",
		"transformFile": "${component.home}/config/groovy/transform.groovy",
		"processClear": false,
		"idleConnectionTimeout": 3600000,
		"maxConnections": 100,
		"maxConnectionsPerRoute": 10,
		"connectionTimeout": 15000,
		"socketTimeout": 15000,
		"useThrottling": false,
		"maxRetries": 3,
		"retryWaitTime": 5000,
		"batchSize": 50,
		"simultaneousBatches": 5,
		"batchTimeout": 5000,
		"debug": false
	}
}