Versions Compared

Old Version 12

changes.mady.by.user Danny Herrera

Saved on

compared with

New Version Current

changes.mady.by.user Danny Herrera

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Easy Heading Free
navigationTitleOn this Page
navigationExpandOptionexpand-all-by-default

NoSQL DB provider supported by the Aspire 5.1 release:

  • New Elasticsearch/Kibana versions supported (7.17.7).
  • OpenSearch v. 1.3.7.

Java version supported

  • OpenJDK 17. 

New

Features & Improvements

Features 

  • Aspire Framework
    • Cluster-wide resource management (Files).
    • New workflow events (onCrawlStart, onCrawlEnd, and onSubJob).
    • Advanced Groovy component.
    • Bulk action improvements (Seeds and Schedules).
    • Single Sign-on authentication method now supported (UI and API).
    • Support for hierarchical ACLs (Intersection ACLs) supported for Confluence crawls, Confluence Identity crawls, and Group Expansion.
  • Connectors. Newly migrated.
    • Confluence. Now supporting On-Premise and Cloud Servers.
    • OneDrive.
  • New Python Migration Scripts for Aspire 4.0 configurations. Available for the following connectors:
    • File System.
    • SMB.
    • Sharepoint Online.
  •  Publishers. Newly migrated.
    • Solr v. 8.9. 
  • Services. Newly migrated.
    • HTTP Listener.
  • Workflow. Newly migrated.
    •  Components
      • Archive Extractor. 
      • Tabular Files Extractor. 

Improvements

  • Aspire Framework
    •  General
      • API
        • ASPIRE-11564 & ASPIRE-11566 Bulk actions for Seeds and Schedules using filters (tags included).
      •  General
        • ASPIRE-10668/ASPIRE-11275 JRE v. 17 now embebbed embedded on the distribution. 
        • ASPIRE-9500 Improved queue management, allowing timeouts.
        • ASPIRE-11546 Improved requests to nodes in case of communication failure.
        • ASPIRE-11458 Clarified the escape characters for specific URLs on Scope fields (Connections).
        • ASPIRE-11362 Changed MavenRepository implementation to use Apache Maven Resolver instead of Maven Aether Provider.
      • NOSQL Providers
        • ASPIRE-10828 Implemented index rollover management.
      • Scan Reports
        • Security Assessments: Critical, high, medium, and low tickets fixed (Dynamic and Static Application Assessments).
        • Vulnerabilities: Critical vulnerabilities fixed.
      • Resource Manager
        • ASPIRE-10894 Configuration item manager instead of using file paths.
    •  Connectors
      • Azure Identity
        • ASPIRE-11505 Allows multiple threads to speed up crawling.
      • Confluence. Now supporting On-Premise and Cloud Servers.
      • Confluence Identity
        • .
      • DB Server
        • ASPIRE-10943 Support for the SAP HANA and IRIS database ports. 
        • ASPIRE-10699 Separated fields for Table and View Metadata query.
        OneDrive
        • .
      • REST
        • ASPIRE-11556 'Stop on Scan Error' option added. 
        • ASPIRE-11005 Pagination by next page link.
        • ASPIRE-11377 Support for expiration date format for Bearer authentication.
        • ASPIRE-11317 Include children metadata info inside customizable fieldfields.
      • S3
        • MinIO support.
      •  ServiceNowServiceNow
        • ASPIRE-10735 Inherit Knowledge Base User Criteria for Knowledge Article items. Known issue on 5.0.4.
        • ASPIRE-XXXX Custom Search Query option for Knowledge Articles.
    • Publishers
      • Solr v. 8.9.
    • Python Migration Scripts for Aspire 4.0 configurations. Available for the following connectors:
      • File System.
      • SMB.
      • Sharepoint Online.
    •  S3
      • ASPIRE-11512 MinIO support.
    • Services
      • HTTP Listener.
    • UI
    •  Workflow
        Workflow
        • Components
          • ASPIRE-11404 Archive Extractor.
          • ASPIRE-11772 Tabular Files Extractor.
        • Summarizers
          • Job Summarizer Executor
            • ASPIRE-11759 Row sampling options added.
            • ASPIRE-11227 'Fetch row using slices' option added.
          • Saga Summarizer Executor
            • Allows to detect Saga tags in columns of tabular files.
            • ASPIRE-11725 'Python server manager & cache' option added.
            • ASPIRE-11253 'Limit Entity Samples' option added to matched tags.

      Bugs

      • Aspire Framework
        • API
          • ASPIRE-11676 NullPointerException executing a schedule with no seeds.
        •  General
          • ASPIRE-11405 Workers nodes not closing RAP Connections after completion.
          • ASPIRE-11513 Pausing a crawl closing in use connections immediately.
          • ASPIRE-11327 AspireObject not allowing valid characters on in JSON format. Known issue on 5.0.4.
          • ASPIRE-11601 Items marked as excluded being processed in the Scan phase.
          • ASPIRE-11547 non Non released items for dead workers.
          • ASPIRE-11409 Aspire not recovering after errors on standalone mode.
        • Security
          • ASPIRE-11078 Single Sign-on authentication method now supported (UI and API).
        • NOSQL Providers
      • Connectors
        • Aspider:
          • ASPIRE-11065 Crawling a URL including the meta tag "robots" with content="noindex,nofollow".
          • ASPIRE-11064 Credentials not being encrypted correctly.
        • Group Expansion Manager
          • ASPIRE-11649 Issue merging entities.
          • ASPIRE-11855 No option to map groups based on attributes.
          • ASPIRE-11630 Some duplicated entries.
          • Some other minor issues.
        •  ServiceNow
          • ASPIRE-11697 & ASPIRE-11698 Missing metadata fields for Knowledge Articles and their attachments.
        • Sharepoint Online
          • ASPIRE-11752 Crawl failing due to folder with special characters.
          • Hotfixes migrated to this version.
          • Some minor issues.
      • Publishers
        • Elasticsearch
          • ASPIRE-11313 Publisher failing having ES server configured to use self-signed certificates.
        Scan Reports
        • Security Assesstments: High, medium, and low tickets fixed. See report here.
        • Vulnerabilities: Critical vulnerabilities fixed
          • .
          See report here.
      • Schedules
        • ASPIRE-11579 Schedules triggered when it was not time for execution.
        • ASPIRE-11745 Duplicated entries for schedules on the Debug Console.
        • ASPIRE-11739 Crawl executed for disabled Sequence Schedule.
      • UI
        • ASPIRE-10468 Improved redirect after creating configuration items.
        • ASPIRE-11814 Some columns case-sensitive on the Seeds page when filtering.
      • Workflow
        • Summarizers
          • Saga Summarizer Executor
            • ASPIRE-11296  'Entity Metadata' option removed.

      Known Issues

      • Aspire Framework
        • Throttling is considering control items during the crawl.
        • Resource Manager
          • Resources (drivers) loaded not working for the RDB connections.
      • Connectors
        • REST
          • ASPIRE-11815 Bearer authentication failing with specific unknown expiring time format.
        • ServiceNow
          • Include pattern option not getting items by using the Short Description pattern field
          SharePoint Online
          • Error crawling long URLs on MS Windows. A Microsoft workaround is available.
      • UI
        • Edit page for Seeds loading empty rare times.
        • UI actions are limited for users with both Admin and Operator roles.
      • Workflow
        • Extract Text
          • ASPIRE-11776 The Custom mappings option is not working.

      Migrating from 5.0.2 to 5.1

      Update the aspire-mappings index to refresh mappings:

      Code Block
      titleaspire-mappings
      PUT aspire-audit/_mapping
{
  "properties": {
    "audit.timestamp": {
      "type": "date"
    },
    "audit.seedId": {
      "type": "keyword"
    },
    "audit.crawlId": {
      "type": "keyword"
    },
    "audit.type": {
      "type": "keyword"
    },
    "audit.worker": {
      "type": "keyword"
    },
    "audit.statistics.seedId": {
      "type": "keyword"
    },
    "audit.statistics.connectionId": {
      "type": "keyword"
    },
    "audit.statistics.connectorId": {
      "type": "keyword"
    },
    "audit.statistics.id": {
      "type": "keyword"
    }
  }
}