Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Status
colourYellow
titleDRAFT

Info

For version 4.0, Aspire requires a license file to run.

See Aspire Licensing for information on obtaining a license.


The following are the NoSQL DB providers supported by the Aspire 4.0 release:

  • MongoDB version 3.6
  • HBase version 1.2.4

The supported version of Elasticsearch is 6.3.0

The supported version of StageR is 1.2  Note:  The latest version of Stager is v. 1.2 and it supports MongoDB v. 3.4.10 


Below you can find the list of the updates for this version.

anchorknownissuesknownissuesKnown Issues AnchorconnectorknownconnectorknownConnectors Connectorname AnchorservicesknownservicesknownServicesServicename


Anchor
enhancements
enhancements
New and

Enhancements

Enhanced Features


Anchor
AspireCoreEnhance
AspireCoreEnhance
Aspire Core and Framework Components

  • The Request log now contains the remote IP addresses for successful and failed logins
  • The following fields have been added for every record: 
    • “ingestionStart” (date time when a record was first created by the connector)
    • “ingestionEnd” (date time when a record was ingested into the search engine) 
    • “crawlStart” (date time when the crawl responsible for a record was started)

   For debugging, we can now identify which records were ingested when and what batches of records exist.  We can also more easily identify and remove orphans

  • An option has been added to the Aspire Parcel and Service to configure the Aspire log directory.
  • Connectors now have a concept of a “domain”
    • When creating or indexing ACLs, the search engine will include the domain, which defaults to the connector name (or ID)
    • The domain can be overridden
  • Improvements have been made to failed document handling
  • Aspire now works with Java 11
  • A message appears when adding a custom connector with ‘com.searchtechnologies.aspire’ Group ID
  • Aspire Parcel and Service – An option has been added to configure the Aspire log directory
  • The Aspire wiki has been updated to indicate that system properties can be configured in the settings.xml file for use in the Aspire UI.
    This is useful for connectors, services, workflow and can be applied to content sources and services to configure from the UI

Anchor
PublishFrameEnhance
PublishFrameEnhance
Publisher Framework

  • A Publisher framework has been added that uses a provider for the actual calls to the repository, handles batches, allows extensions, records errors and supports clear/commit jobs

Anchor
UIenhance
UIenhance
Aspire UI

  • SMBJ
    • You can now disable the "last accessed" update from the SMB2 client for Java open source connector
  • The ability to show Provider Information has been added

Anchor
connectorEnhance
connectorEnhance
Connectors

  • Aspider
    • Added functionality to cleanse the ID on incremental crawls
    •  Multiqueue (based on item status and grouping) has been added in HBase
  • Elastic
    • The Elastic connector code would not compile in 4.0
  • ServiceNow
    • ACL security has been added
  • SharePoint Online
    • You can now crawl SharePoint content sources using either the Change Tokens or Snapshots
  • Staging Repository
    • Field level help has been added for the special scope $record
  • Yammer
    • A new Yammer connector retrieves Yammer messages including some metadata
    Connectorname

Anchor
publisherEnhance
publisherEnhance
Publishers

  • Elasticsearch
    • In order to support Elastic 6.x, the mapping script for Elastic has been changed to use only one "_type" value regardless of the situation
    • Elasticsearch publisher now forces a lowercase index name
    • DeleteByQuery was not working on 6.1.1

Anchor
ServEnhance
ServEnhance
Services

  • Unable to see errors for failed services
  • The LDAP Cache Service can now validate users from multiple domains.  Similarly, LDAP group caching can now cache groups from multiple domainsHBase 

Anchor
AppEnhance
AppEnhance
Applications


Anchor
bugfixes
bugfixes
Bug Fixes


Anchor
AspireCorebugs
AspireCorebugs
Aspire Core and Framework Components

  • Connector framework now supports Jive connector hierarchy
  • Validation has been added for application input at the server-side for length, type, and business rules before accepting any data to be stored or processed
  • For enhanced security, use HTTP POST (without parameters in the URL string) to avoid the disclosure of URLs and parameter values.
  • A password placeholder has been added for developer users.
  • If the HTML contained multiple meta tags with the same name but different values, the extract-text component was only extracting one value
  • Group Expansion is no longer rendered for the connectors that do not use it:
    • File System, CIFS, Amazon S3
    • RDB Tables, RDB Snapshots
    • Jira Issues, FTP, Feed One, Hbase, RSS,
    • IBM Connections, Kinesis, ServiceNow
  • Connector Framework
    • AspireObject was casting an incorrect numeric type with createFromJSON
    • Aspire Distributed Mode - Services in master node were not starting automatically after saving changes
    • The EncryptPassword script was deleting comments in the settings.xml file
    • ProcessDeletes was missing a status page
  • Aspire Application
    • SMB2 - An  error could occur when loading the connector for the first time

Anchor
UIbugs
UIbugs
Aspire UI

  • It was not possible to edit a custom application in the Admin UI
  • The link that points to the Wiki needed to be updated

Anchor
connectorsbugs
connectorsbugs
Connectors

  • Aspider
    • Aspider
  • Documentum
  • File System
    • to crawl dynamic rendering page
  • Confluence
    • Incremental crawls when using a list were not working
    • When executing runs, no audit logs were being shown for jobs being "Excluded" nor "Not Changed"
    • Parent ACL's are now taken from the immediate ancestor
  • IBM Connections
    • The connector was unable to look up ACL information in LDAP-Cache
  • SharePoint Online
    • Added attachment was not crawled until the second incremental crawl
  • SharePoint 2013
    • The connector could request more list items in one request than allowed
    • The content was not extracted (401 UNAUTHORIZED)
    • The connector could not process change item type SP.ChangeSite
    • When crawling a specific list, incremental reports could show deletes that never happened
    KafkaStandalone Mode

Anchor
publishersbugs
publishersbugs
Publishers

  • Elasticsearch
      KafkaPublish to AvroSharePoint 2013
      • DeleteByQuery was not working on 6.1.1
    • SolrCloud
    • Solr
    • Publish to StageR
      • Unable to add the component

    Anchor
    servicesbugs
    servicesbugs
    Services

    • LDAP Cache Service
      • Refresh was taking too long
      • The service was refusing to start

    Anchor
    appbugs
    appbugs
    Applications


Anchor
knownissues
knownissues
Known Issues


Anchor
connectorknown
connectorknown
Connectors 

  • Connectorname

Anchor
servicesknown
servicesknown
Services

  • ServicenameArchive ExtractorAVRO Extractor