Release Notes - Aspire 5.1

NoSQL DB provider supported by the Aspire 5.1 release:

• New Elasticsearch/Kibana versions supported (7.17.7).
• OpenSearch v. 1.3.7.

Java version supported

• OpenJDK 17. 

New Features & Improvements

• Aspire Framework
  • API
    • ASPIRE-11564 Bulk actions for Seeds and Schedules using filters (tags included).
  •  General
    • ASPIRE-10668/ASPIRE-11275 JRE v. 17 now embebbed on the distribution. 
    • ASPIRE-9500 Improved queue management allowing timeouts.
    • ASPIRE-11458 Clarified the escape characters for specific URLs on Scope fields (Connections).
    • ASPIRE-11362 Changed MavenRepository implementation to use Apache Maven Resolver instead of Maven Aether Provider.
  • NOSQL Providers
    • ASPIRE-10828 Implemented index rollover management.
  • Resource Manager
    • ASPIRE-10894 Configuration item manager instead of using file paths.
•  Connectors
  • Azure Identity
    • ASPIRE-11505 Allows multiple threads to speed up crawling.
  • Confluence. Now supporting On-Premise and Cloud Servers.
  • Confluence Identity.
  • DB Server
    • ASPIRE-10943 Support for the SAP HANA and IRIS database ports. 
    • ASPIRE-10699 Separated fields for Table and View Metadata query.
  • OneDrive.
  • REST
    • ASPIRE-11556 - 'Stop on Scan Error' option added. 
    • ASPIRE-11005 - Pagination by next page link.
    • ASPIRE-11377 - Support for expiration date format for Bearer authentication.
    • ASPIRE-11317 - Include children metadata info inside customizable field.
  • ServiceNow
    • ASPIRE-10735 Inherit Knowledge Base User Criteria for Knowledge Article items.
    • ASPIRE-xxxx Custom Search Query option for Knowledge Articles.
• Publishers
  • Solr v. 8.9.
• Python Migration Scripts for Aspire 4.0 configurations. Available for the following connectors:
  
  • File System.
  • SMB.
  • Sharepoint Online.
• S3
  • ASPIRE-11512 MinIO support.
• Services
  
  • HTTP Listener.
• UI
• Workflow
  
  • Components
    • ASPIRE-11404 Archive Extractor.
    • ASPIRE-11772 Tabular Files Extractor.
  • Summarizers
    • Job Summarizer Executor
      • ASPIRE-11759 Row sampling options added.
      • ASPIRE-11227 - 'Fetch row using slices' option added.
    • Saga Summarizer Executor
      • ASPIRE-11725 - 'Python server manager & cache' option added.
      • ASPIRE-11253 - 'Limit Entity Samples' option added to matched tags.

Bugs

• Aspire Framework
  
  • API
  •  General
    • ASPIRE-11405 Workers node not closing RAP Connections after completion.
    • ASPIRE-11513 Pausing a crawl closing in use connections immediately.
    • ASPIRE-11327 AspireObject not allowing valid characters on JSON format. Known issue on 5.0.4.
    • ASPIRE-11601 Items marked as excluded being processed in the Scan phase.
  • Security
    • ASPIRE-11078 Single Sign-on authentication method now supported (UI and API).
  • NOSQL Providers
• Connectors
  • Aspider
    • ASPIRE-11065 - Crawling a URL including the meta tag "robots" with content="noindex,nofollow".
    • ASPIRE-11064 - Credentials not being encrypted correctly.
  •  ServiceNow
  • • ASPIRE-11697 & ASPIRE-11698 Missing metadata fields for Knowledge Articles and their attachments.
  • Sharepoint Online
    • ASPIRE-11752 Crawl failing due to folder with special characters.
    • Hotfixes migrated to this version.
    • Some minor issues.
• Publishers
  • Elasticsearch
    • ASPIRE-11313 Publisher failing having ES server configured to use self-signed certificates.
• Scan Reports
  • Security Assesstments: High, medium, and low tickets fixed. See report here.
  • Vulnerabilities: Critical vulnerabilities fixed. See report here.
• UI
  • ASPIRE-10468 Improved redirect after creating configuration items.
  • ASPIRE-11814 Some columns case-sensitive on the Seeds page when filtering.
• Workflow
  
  • Summarizers
    
    • Saga Summarizer Executor
      • ASPIRE-11296 -  'Entity Metadata' option removed.

Known Issues

• Aspire Framework
  • Throttling is considering control items during the crawl.
• Aspire UI
  
  • Edit page for Seeds loading empty rare times.
  • Seeds field should be required for any type of Schedule.
  • UI actions are limited for users with both Admin and Operator roles.
  • Filtering by name does not support the underscore character. Workaround: use the dash character as a separator; do not use space and underscore.  
• Connectors
  
  • ServiceNow
  • 'Can Read' permissions not considered for Knowledge Articles.
  • SharePoint Online
    
    • Error crawling long URLs on MS Windows. A Microsoft workaround is available.

External Technical Limitations

• Connectors
  
  • ServiceNow
    
    • Security changes are not picked up by an incremental crawl.

Migrating from 5.0.2 to 5.1

Update the aspire-mappings index to refresh mappings:

PUT aspire-audit/_mapping
{
  "properties": {
    "audit.timestamp": {
      "type": "date"
    },
    "audit.seedId": {
      "type": "keyword"
    },
    "audit.crawlId": {
      "type": "keyword"
    },
    "audit.type": {
      "type": "keyword"
    },
    "audit.worker": {
      "type": "keyword"
    },
    "audit.statistics.seedId": {
      "type": "keyword"
    },
    "audit.statistics.connectionId": {
      "type": "keyword"
    },
    "audit.statistics.connectorId": {
      "type": "keyword"
    },
    "audit.statistics.id": {
      "type": "keyword"
    }
  }
}