Release Notes - Aspire 5.0.3

NoSQL DB provider supported by the Aspire 5.0.3 release:
• New Elasticsearch/Kibana versions supported (7.17.4)
• OpenSearch v. 1.1

Java version supported
• OpenJDK 11

New Features
• Connectors
• Documentum DQL
• Dropbox
• Elasticsearch Lookup Caches
• LDAP Identity
• REST
o ASPIRE-11136: Alternate query body format.
o ASPIRE-10825: Allow Persistent Variables.
o ASPIRE-10772: RequesterImpl - Update how headers are added.
o ASPIRE-10773: Add option to specify headers for each query request.
o ASPIRE-10798: Add option to configure a proxy.
o ASPIRE-11081: Inherit data from parent query to child query (at document level).
o ASPIRE-11044: Grovy editor popup like the one for Workflows.
• ServiceNow
o ASPIRE-10735: inherit Knowledge Base User Criteria for Knowledge Article items
o ASPIRE-10674: Add deny ACLs
• VeevaVault

• UI
• ASPIRE-11044: Grovy editor popup like the one for Workflows.
• ASPIRE-10771: Add option to copy entities
• ASPIRE-10913: Extensions page error messages are not clear
• ASPIRE-10811: Make code dxf control window bigger
• ASPIRE-10810: Allow pause and abort actions while the seed status is pausing or aborting

• Framework
• ASPIRE-10216/10476 Add Delete Policies to Connections UI (all connector types).
• ASPIRE-10755: Improved job distribution for crawls (connectorMaxBatchSize & workerRoundRobin).
• ASPIRE-10799: Jobs Performance Statistics.
• ASPIRE-10802: Seed allocation to use routing tags.
• ASPIRE-10722: Property for Seeds that not support incremental crawls.
• ASPIRE-10738: Autostart enabled using environment property.

• Workflow
• Language Detector
• Summarizers
o Job Summarizer Executor
o Parquet Summarizer Executor
o RDB Summarizer Executor
o Sample Summarizer
o Sas Summarizer Executor
o Value Count Summarizer
o Tesseract OCR

• Bugs Fixes

• Aspire Framework
• General
o ASPIRE-9933: Improve Job cleanup for idle connectors. Known issue on 5.0.2.
o ASPIRE-9900: Manager source info initialization errors. Known issue on 5.0.2.
o ASPIRE-11160: custom connectorMaxBatch size does not throw all the expected messages
o ASPIRE-11075: Process Deletes add check to avoid infinite loop due to cyclic parent references

• NoSQL Provider
o ASPIRE-10131: Nodes are not shutting down in the time expected having ES down. Known issue on 5.0.2.
• Connectors
• DBServer
o ASPIRE-10640: Incremental Crawl option enabled but crawl type is not supported.
• REST
o ASPIRE-10783: Add option to specify connection throttling
o ASPIRE-10651:
o ASPIRE-10783:
o ASPIRE-10783:
o ASPIRE-10783:
o ASPIRE-10783:
• Service Now
o ASPIRE-11147: public custom permissions must be reflected in the ACLs
o ASPIRE-11157: multiple roles are not processed for Catalog Items
o ASPIRE-11167: hierarchy exception crawling KA
• Publishers
• Publisher Framework
o ASPIRE-11001: Batch monitor thread is not stopped when publisher is removed
• Elasticsearch Publlisher
o ASPIRE-11114: The complete url expects "/_bulk"
• DBServer Publlisher
o ASPIRE-10919: DXF errors
• File System Publlisher
o ASPIRE-11106: is displayed in JSON format in the publishToFile.jobs file
• UI
• ASPIRE-10361: Some UX issues on navigation (page size, tag filter, etc.)
• ASPIRE-10324: Resizing name column does not do the same for the text contained.
• ASPIRE-11150: Narrow popup windows for WF applications.
• ASPIRE-11039: Delete / Delete Incremental is missing in policy help pane
• ASPIRE-10847: Credentials must be required when creating veeva vault connector
• ASPIRE-11111: Rename "Index directories/binders" with "Index containers" in Veeva Vault Connections page
• ASPIRE-10849: Error message is overlapping connection settings of veeva vault connection when scrolled down
• ASPIRE-11104: Error message is overlapping with the response page size when API Base Version is invalid for Veeva Vault
Known Issues
• Aspire Framework
• ASPIRE-9878: Throttling is considering control items during the crawl.
• Aspire UI
• ASPIRE-10188 Edit page for Seeds loading empty rare times.
• ASPIRE-10110: Seeds field should be required for any type of Schedules.
• ASPIRE-9994: UI actions are limited for users with both Admin and Operator roles.
• ASPIRE-10732 - Filtering by name does not support the underscore character. Workaround: use the dash character as separator; do not use space and underscore.

• Connectors
• SharePoint Online
o Error crawling long URLs.

External Technical Limitations
• Connectors
• ServiceNow
o ASPIRE-11155: security changes are not picked up by an incremental crawl.

Migrating from 5.0.2 to 5.0.3

Update the aspire-mappings indice to refresh mappings
PUT aspire-audit/_mapping
{
"properties": {
"audit.timestamp": {
"type": "date"
},
"audit.seedId": {
"type": "keyword"
},
"audit.crawlId": {
"type": "keyword"
},
"audit.type": {
"type": "keyword"
},
"audit.worker": {
"type": "keyword"
},
"audit.statistics.seedId": {
"type": "keyword"
},
"audit.statistics.connectionId": {
"type": "keyword"
},
"audit.statistics.connectorId": {
"type": "keyword"
},
"audit.statistics.id": {
"type": "keyword"
}
}
}

NoSQL DB provider supported by the Aspire 5.0.3 release:

New Elasticsearch/Kibana versions supported (7.17.4)
OpenSearch v. 1.1

Java version supported

OpenJDK 11

New Features

Connectors
- REVIEW TICKETS

Documentum DQL
Dropbox
Elasticsearch Lookup Cache
LDAP Identity
REST
ServiceNow
VeevaVault

Framework

ASPIRE-10216/10476 Add Delete Policies to Connections UI (all connector types).
ASPIRE-10755: Improved job distribution for crawls (connectorMaxBatchSize & workerRoundRobin).
ASPIRE-10799: Jobs Performance Statistics.
ASPIRE-10802: Seed allocation to use routing tags.
ASPIRE-10722: Property for Seeds that not support incremental crawls. NOT TESTED
ASPIRE-10738: Autostart enabled using environment property. NOT TESTED

Workflow
- Job Summarizer Executor
- Parquet Summarizer Executor
- RDB Summarizer Executor
- Sample Summarizer
- Sas Summarizer Executor
- Valuecount Summarizer

Language Detector
Summarizers
Tesseract OCR

Publishers

?

Bugs Fixes

Aspire Framework
- ASPIRE-9933: Improve Job cleanup for idle connectors. Known issue on 5.0.2.
- ASPIRE-9900: Manager source info initialization errors. Known issue on 5.0.2.
- ASPIRE-10131: Nodes are not shutting down in the time expected to have ES down. Known issue on 5.0.2.
- General
- NoSQL Provider
Connectors
- ASPIRE-10640: Incremental Crawl option enabled but crawl type is not supported. REVIEW THIS
- REVIEW TICKETS
- DBServer
- REST

Publishers
- ?
UI
- ASPIRE-10361: Some UX issues on navigation (page size, tag filter, etc.)
- ASPIRE-10324: Resizing name column does not do the same for the text contained.

Known Issues

Aspire Framework

ASPIRE-9878: Throttling is considering control items during the crawl.

Aspire UI

ASPIRE-10188 Edit page for Seeds loading empty rare times.
ASPIRE-10110: Seeds field should be required for any types of Schedules.
ASPIRE-9994: UI actions are limited for users with both Admin and Operator roles.
ASPIRE-10732 - Filtering by name does not support the underscore character. Workaround: use the dash character as separator; do not use space and underscore.

Connectors
- Error crawling long URLs.

SharePoint Online

External Technical Limitations

Connectors
- ASPIRE-11155: security changes are not picked up by an incremental crawl.

ServiceNow

Migrating from 5.0.2 to 5.0.3

Update the aspire-mappings index to refresh mappings

aspire-mappings

PUT aspire-audit/_mapping
{
  "properties": {

    "audit.timestamp": {
      "type": "date"
    },
    "audit.seedId": {
      "type": "keyword"
    },
    "audit.crawlId": {
      "type": "keyword"
    },
    "audit.type": {
      "type": "keyword"
    },
    "audit.worker": {
      "type": "keyword"
    },
    "audit.statistics.seedId": {
      "type": "keyword"
    },
    "audit.statistics.connectionId": {
      "type": "keyword"
    },
    "audit.statistics.connectorId": {
      "type": "keyword"
    },
    "audit.statistics.id": {
      "type": "keyword"
    }
  }
}

Page tree

Contact Us: [email protected]