Aspire 5.0.1

NoSQL DB provider supported by the Aspire 5.0.1 release:

• Elasticsearch/Kibana versions 7.9.2

Java version supported

• OpenJDK 11

New Features

• Aspire Framework

  • Parametrize sharding parameters on index creation.

  • Consistency for all the environment variable names.

  • Handling HTTP error code 429 for the ES provider.

• Aspire UI

  • Guided Tour!

  • Type ahead for Connectors.

  • Start crawl option on popup menu for failed crawls.

  • Added search bar for type selector.

  • Option to pin the left-side menu.

  • User friendly HTTP error code 401.

• Connectors

  • Aspider

  • RDB Tables

  • RDB Snapshot

  • REST

  • Selenium

  • SMB

• Publishers

  • File System

    • New JSON format as default output.

Bugs Fixes

• Aspire Framework

  • Fixed connections leak.

  • Missing entries from QueueEntry.

  • NPE selecting connector type.

  • Improved error handling for crawl in progress.

  • Throttling being applied per Seed, when it should be applied per Policy. Known issue on 5.0.
• Connectors
  

  • General

    • Possible massive deletes and incorrect "completed" crawls when they should be "failed".

    • Scan recursively option not working as expected.

    • Crawl marked as completed with invalid server URL.

    • Workflows could not be updated, not being used by any Seed.

    • Removed unnecessary properties for the aspire.properties file.

  • File System

    • UncheckedExecutionException generating hierarchy info with Index Containers checked. Known issue on 5.0.

    • Set stop on scanner error.

  • Publishers

    • General

      • Removed the Index Dump option from the DXF.

  • UI

    • No redirect page for 401 message (unauthorized) accessing Aspire Debug Console. Known issue on 5.0.

    • Failed Documents -> Error Retry Patterns section with temporary checkbox to enable it and it requires at least 2 items to work. Known issue on 5.0.

    • DXF not enforcing minimum count on multiple fields.

    • Refresh button clearing selections in the dropdown.

    • No rows to show after deleting item in the 2nd page.

    • Enlarged Bulk actions popup for Seeds.

    • Set of buttons of the Groovy Playground page enabled on the bottom.

    • DXF validation for URL fields not allowing underscores.

    • ASPIRE-10356: Saving with just white spaces.

Known Issues

• Aspire Framework

  • Improve Job cleanup for idle connectors.

  • Manager source info initialization errors.

  • Nodes are not shutting down in the time expected, having Elasticsearch down.

  • Throttling is considering control items during the crawl.

• Aspire UI

  • Seeds field should be required for any type of Schedules.

  • UI actions are limited for users with both Admin and Operator roles.

  • Edit page for Seeds loading empty rare times.

  • Add Delete Policies to Connections UI (all connector types).

  • Some UX issues on navigation (page size, tag filter, etc.)

  • Resizing name column does not do the same for the text contained.

• Connectors

  • RDB Tables:
    • No recovering action after killing the NoSql Provider during a crawl. 

  • REST

    • ID attribute appearing twice once published.

  • SharePoint Online

    • Error crawling long URLs.

• Publishers

  • Elasticsearch

    • HTTPS option not supported for the 'Host and port' option.