Release Notes - Aspire 5.0.3

NoSQL DB provider supported by the Aspire 5.0.3 release:

• New Elasticsearch/Kibana versions supported (7.17.4)
• OpenSearch v. 1.1

Java version supported

• OpenJDK 11

New Features

• Connectors
  • Documentum DQL
  • Dropbox
  • Elasticsearch Lookup Caches
  • LDAP Identity
  • REST
    • ASPIRE-11136: Alternate query body format.
    • ASPIRE-10825: Allow Persistent Variables.
    • ASPIRE-10772: RequesterImpl - Update how headers are added.
    • ASPIRE-10773: Add option to specify headers for each query request.
    • ASPIRE-10798: Add option to configure a proxy.
    • ASPIRE-11081: Inherit data from parent query to child query (at document level).
    • ASPIRE-11044: Groovy editor popup like the one for Workflows.
  • ServiceNow
    • ASPIRE-10735: inherit Knowledge Base User Criteria for Knowledge Article items
    • ASPIRE-10674: Add deny ACL
  • VeevaVault - New Connector

• UI
  • ASPIRE-11044: Grovy editor popup like the one for Workflows.
  • ASPIRE-10771: Add option to copy entities
  • ASPIRE-10913: Extensions page error messages are not clear
  • ASPIRE-10811: Make code dxf control window bigger
  • ASPIRE-10810: Allow pause and abort actions while the seed status is pausing or aborting
• Framework
  • ASPIRE-10216/10476 Add Delete Policies to Connections UI (all connector types).
  • ASPIRE-10755: Improved job distribution for crawls (connectorMaxBatchSize & workerRoundRobin)
  • ASPIRE-10799: Jobs Performance Statistics.
  • ASPIRE-10802: Seed allocation to use routing tags.
  • ASPIRE-10722: Property for Seeds that not support incremental crawls.
  • ASPIRE-10738: Autostart enabled using environment property.
• Workflow
  • Language Detector
  • Summarizers
    • Job Summarizer Executor
    • Parquet Summarizer Executor
    • RDB Summarizer Executor
    • Sample Summarizer
    • SaS Summarizer Executor
    • Value Count Summarizer
    • Tesseract OCR

Bugs Fixes

• Aspire Framework
  • General
    • ASPIRE-9933: Improve Job cleanup for idle connectors. Known issue on 5.0.2.
    • ASPIRE-9900: Manager source info initialization errors. Known issue on 5.0.2.
    • ASPIRE-11160: custom connectorMaxBatch size does not throw all the expected messages
    • ASPIRE-11075: Process Deletes add check to avoid infinite loop due to cyclic parent references
  • NoSQL Provider
    • ASPIRE-10131: Nodes are not shutting down in the time expected, having ES down. Known issue on 5.0.2.
  • Connectors
    • DBServer
      • ASPIRE-10640: Incremental Crawl option enabled, but crawl type is not supported.
    • REST
      • ASPIRE-10783: Add option to specify connection throttling
    • ServiceNow
      • ASPIRE-11147: public custom permissions must be reflected in the ACLs
      • ASPIRE-11157: multiple roles are not processed for Catalog Items
      • ASPIRE-11167: hierarchy exception crawling KA
    • Publishers
      • Publisher Framework
        • ASPIRE-11001:    Batch monitor thread is not stopped when publisher is removed
      • Elasticsearch Publisher
        • ASPIRE-11114:    The complete URL expects "/_bulk"
      • DBServer Publisher
        • ASPIRE-10919:    DXF errors
      • File System Publisher
        • ASPIRE-11106:    is displayed in JSON format in the publishToFile.jobs file
    • UI
      • ASPIRE-10361: Some UX issues on navigation (page size, tag filter, etc.)
      • ASPIRE-10324: Resizing name column does not do the same for the text contained.
      • ASPIRE-11150: Narrow popup windows for WF applications.
      • ASPIRE-11039: Delete / Delete Incremental is missing in policy help pane
      • ASPIRE-10847: Credentials must be required when creating Veeva Vault connector
      • ASPIRE-11111: Rename "Index directories/binders" with "Index containers" in Veeva Vault Connections page
      • ASPIRE-10849: Error message is overlapping connection settings of Veeva Vault connection when scrolled down
      • ASPIRE-11104: Error message is overlapping with the response page size when API Base Version is invalid for Veeva Vault

Known Issues

• Aspire Framework
  • ASPIRE-9878: Throttling is considering control items during the crawl.
• Aspire UI
  
  • ASPIRE-10188 Edit page for Seeds loading empty rare times.
    
    • ASPIRE-10110: Seeds field should be required for any type of Schedules.
    • ASPIRE-9994: UI actions are limited for users with both Admin and Operator roles.
    • ASPIRE-10732 - Filtering by name does not support the underscore character. Workaround: use the dash character as separator; do not use space and underscore.  
  • Connectors
    
    • SharePoint Online
      
      • Error crawling long URLs.

External Technical Limitations

• Connectors
  
  • ServiceNow
    
    • ASPIRE-11155: security changes are not picked up by an incremental crawl

Migrating from 5.0.2 to 5.0.3

Update the aspire-mappings index to refresh mappings

PUT aspire-audit/_mapping
{
  "properties": {
    "audit.timestamp": {
      "type": "date"
    },
    "audit.seedId": {
      "type": "keyword"
    },
    "audit.crawlId": {
      "type": "keyword"
    },
    "audit.type": {
      "type": "keyword"
    },
    "audit.worker": {
      "type": "keyword"
    },
    "audit.statistics.seedId": {
      "type": "keyword"
    },
    "audit.statistics.connectionId": {
      "type": "keyword"
    },
    "audit.statistics.connectorId": {
      "type": "keyword"
    },
    "audit.statistics.id": {
      "type": "keyword"
    }
  }
}