Page History
Create Job Summarizer Executor
Field | Required | Default | Multiple | Notes | Example | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| type | Yes | - | No | The value must be "application". | "application" | ||||||
| _type | Yes | - | No | The value must be "application". | "application" | ||||||
| appName | Yes | - | No | The name of the application | "Job-Executor" | ||||||
| appType | Yes | - | No | The value must be "job-summarize-executor". | "job-summarize-executor" | ||||||
| config | Yes | - | No | The value must be "com.accenture.aspire:app-jobsummarize-executor". | "com.accenture.aspire:app-jobsummarize-executor" | ||||||
| description | Yes | - | No | The description | "Job-Executor" | ||||||
| properties | Yes | - | No | Configuration object | addSchema|||||||
| dataPath | Yes | - | No | The path of the job that contains the tables data | "/doc" | ||||||
| containerPath | Yes | - | No | The sub path of the data that contains each table | "container" | ||||||
| tableIdPath | Yes | - | No | The sub path of table data that contains the table id | "container/url" | ||||||
| seedIdPath | Yes | true- | No | If enabled the table schema will be added to the processed columns. | true | The sub path of table data that contains the seed id | "container/seed/id" | ||||
| columnsPath | Yes | - | No | The sub path of table objects that contains the columns information | "dataProfile/columns" | ||||||
| columnNamePath | Yes | - | No | The sub path of column objects that contains the column name | "columnName" | ||||||
| columnTypePath | Yes | - | No | The sub path of column objects that contains the column type | "column_type" | ||||||
| columnsPatterns | Yes | [] | Yes | The columns patterns to detect each column type | [{"type":"TEXT","pattern":"STRING"},{"type":"INT","pattern":"INT32"}] | ||||||
| type | Yes | "TEXT" | No | The data type to use for the specified pattern. Accepted values: "TEXT", "LONG", "INT", "FLOAT", "DOUBLE", "BOOLEAN" | "TEXT" | ||||||
| pattern | Yes | - | No | The pattern to match | "STRING" | threadPool | Yes | 5 | No | The number of threads to use for parallel processing. | 5 |
| logFrequency | Yes | 1000 | No | The frequency for reporting the processed rows. | 1000 | ||||||
| filterRows | Yes | false | No | Enable to filter the rows to process. | true | ||||||
| useFilterFile | Yes | true | No | Enable to use a groovy file to filter the rows | true | ||||||
| groovyPath | No | - | No | The path of the groovy script that contains the filter logic. It must return a boolean value, if true the row will be filtered | "C:\\Aspire\\config\\rowsGroovyFilter.txt" | ||||||
| groovyScript | No | - | No | Script used to filter the rows. It must return a boolean value, if true the row will be filtered | "row.getBoolean(\"sensitive\") == true" | ||||||
| url | Yes | - | No | Server URL | "http://localhost:9200/" | ||||||
| authType | Yes | "none" | No | The authentication type. Accepted values: "none", "basic", "aws" | "none" | ||||||
| username | Yes | - | No | User with the permissions to read from the Elastic index specified. Used only if the authType is "basic" | "admin" | ||||||
| password | Yes | - | No | The password for the specified user. Used only if the authType is "basic" | "password" | ||||||
| region | Yes | - | No | AWS region. Used only if the authType is "aws" | "us-east-2" | ||||||
| useCredentialsProviderChain | Yes | false | No | Use AWS Credentials Provider Chain. Used only if the authType is "aws" | "true" | ||||||
| accessKey | Yes | - | No | Key utilized to access Amazon Web Services (AWS). Used only if the authType is "aws" and if useCredentialsProviderChain is false | "AKIAIOSFODNN7EXAMPLE" | ||||||
| secretKey | Yes | - | No | Secret key for the access key. Used only if the authType is "aws" and if useCredentialsProviderChain is false | "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" | ||||||
| assumeRole | No | false | No | Enable to assume the specified role to get the credentials. Used only if the authType is "aws" | true | ||||||
| roleArn | No | - | No | The Role ARN to assume. Used only if the authType is "aws" and if assumeRole is true | "arn:aws:iam::123456789012:user/group/role" |
Example
| Code Block | ||||
|---|---|---|---|---|
| ||||
{
"type": "application",
"_type": "application",
"description": "Job-Executor",
"config": "com.accenture.aspire:app-Jobsummarize-executor",
"appType": "Job-summarize-executor",
"appName": "Job Summarize Executor",
"properties": {
"addSchema": true,
"useTempFile": true,
"debug": false,
"threadPool": 5,
"logFrequency": 1000,
"filterRows": true,
"useFilterFile": false,
"groovyScript": "// This script must return a boolean.\n// The references of the job, doc, component, row and table objects are available.\n// Javadoc references \n// Row (row) - http://{manager}/javadocs/com/accenture/aspire/services/summarization/Row.html\n// Table (table) - http://{manager}/javadocs/com/accenture/aspire/services/summarization/Table.html\nrow.getBoolean(\"sensitive\") == true"
}
} |
Update Job Summarizer Executor
Field | Required | Default | Multiple | Notes | Example |
|---|---|---|---|---|---|
| id | Yes | - | No | Id of the application to update | "61014782-442a-4587-ab85-ba1439a7f7b5" |
| type | Yes | - | No | The value must be "application". | "application" |
| _type | Yes | - | No | The value must be "application". | "application" |
| appName | Yes | - | No | The name of the application | "Job-Executor" |
| appType | Yes | - | No | The value must be "job-summarize-executor". | "job-summarize-executor" |
| config | Yes | - | No | The value must be "com.accenture.aspire:app-jobsummarize-executor". | "com.accenture.aspire:app-jobsummarize-executor" |
| description | Yes | - | No | The description | "Job-Executor" |
| properties | Yes | - | No | Configuration object | |
| addSchema | Yes | true | No | If enabled the table schema will be added to the processed columns. | true |
| threadPool | Yes | 5 | No | The number of threads to use for parallel processing. | 5 |
| logFrequency | Yes | 1000 | No | The frequency for reporting the processed rows. | 1000 |
| filterRows | Yes | false | No | Enable to filter the rows to process. | true |
| useFilterFile | Yes | true | No | Enable to use a groovy file to filter the rows | true |
| groovyPath | No | - | No | The path of the groovy script that contains the filter logic. It must return a boolean value, if true the row will be filtered | "C:\\Aspire\\config\\rowsGroovyFilter.txt" |
| groovyScript | No | - | No | Script used to filter the rows. It must return a boolean value, if true the row will be filtered | "row.getBoolean(\"sensitive\") == true" |
Example
| Code Block | ||||
|---|---|---|---|---|
| ||||
{
"id": "61014782-442a-4587-ab85-ba1439a7f7b5",
"type": "application",
"_type": "application",
"description": "Job-Executor",
"config": "com.accenture.aspire:app-Jobsummarize-executor",
"appType": "Job-summarize-executor",
"appName": "Job Summarize Executor",
"properties": {
"addSchema": true,
"useTempFile": true,
"debug": false,
"threadPool": 5,
"logFrequency": 1000,
"filterRows": true,
"useFilterFile": false,
"groovyScript": "// This script must return a boolean.\n// The references of the job, doc, component, row and table objects are available.\n// Javadoc references \n// Row (row) - http://{manager}/javadocs/com/accenture/aspire/services/summarization/Row.html\n// Table (table) - http://{manager}/javadocs/com/accenture/aspire/services/summarization/Table.html\nrow.getBoolean(\"sensitive\") == true"
}
} |
Overview
Content Tools