New and Enhanced Features

Aspire Core and Framework Components

• The Request log now contains the remote IP addresses for successful and failed logins
• The following fields have been added for every record: 
  • “ingestionStart” (date time when a record was first created by the connector)
  • “ingestionEnd” (date time when a record was ingested into the search engine) 

• • “crawlStart” (date time when the crawl responsible for a record was started)

   For debugging, we can now identify which records were ingested when and what batches of records exist.  We can also more easily identify and remove orphans

• An option has been added to the Aspire Parcel and Service to configure the Aspire log directory.
• Connectors now have a concept of a “domain”
  • When creating or indexing ACLs, the search engine will include the domain, which defaults to the connector name (or ID)
  • The domain can be overridden
• Improvements have been made to failed document handling
• Aspire now works with Java 11
• A message appears when adding a custom connector with ‘com.searchtechnologies.aspire’ Group ID
• Aspire Parcel and Service – An option has been added to configure the Aspire log directory
• The Aspire wiki has been updated to indicate that system properties can be configured in the settings.xml file for use in the Aspire UI.
  This is useful for connectors, services, workflow and can be applied to content sources and services to configure from the UI

Publisher Framework

• A Publisher framework has been added that uses a provider for the actual calls to the repository, handles batches, allows extensions, records errors and supports clear/commit jobs

Aspire UI

• SMBJ
• You can now disable the "last accessed" update from the SMB2 client for Java open source connector

• The ability to show Provider Information has been added

Connectors

• Aspider
  • Added functionality to cleanse the ID on incremental crawls
  •  Multiqueue (based on item status and grouping) has been added in HBase
• Elastic
  • The Elastic connector code would not compile in 4.0
• ServiceNow
  • ACL security has been added
• SharePoint Online
  • You can now crawl SharePoint content sources using either the Change Tokens or Snapshots
• Staging Repository
  • Field level help has been added for the special scope $record
• Yammer
  • A new Yammer connector retrieves Yammer messages including some metadata

Publishers

• Elasticsearch
  • In order to support Elastic 6.x, the mapping script for Elastic has been changed to use only one "_type" value regardless of the situation
  • Elasticsearch publisher now forces a lowercase index name
  • DeleteByQuery was not working on 6.1.1

Services

• Unable to see errors for failed services
• The LDAP Cache Service can now validate users from multiple domains.  Similarly, LDAP group caching can now cache groups from multiple domains

Applications

Bug Fixes

Aspire Core and Framework Components

• Connector framework now supports Jive connector hierarchy
• Validation has been added for application input at the server-side for length, type, and business rules before accepting any data to be stored or processed
• For enhanced security, use HTTP POST (without parameters in the URL string) to avoid the disclosure of URLs and parameter values.
• A password placeholder has been added for developer users.
• If the HTML contained multiple meta tags with the same name but different values, the extract-text component was only extracting one value
• Group Expansion is no longer rendered for the connectors that do not use it:
• File System, CIFS, Amazon S3
• RDB Tables, RDB Snapshots
• Jira Issues, FTP, Feed One, Hbase, RSS,
• IBM Connections, Kinesis, ServiceNow
• Connector Framework
  • AspireObject was casting an incorrect numeric type with createFromJSON
  • Aspire Distributed Mode - Services in master node were not starting automatically after saving changes
  • The EncryptPassword script was deleting comments in the settings.xml file
  • ProcessDeletes was missing a status page
• Aspire Application
• SMB2 - An  error could occur when loading the connector for the first time

Aspire UI

• It was not possible to edit a custom application in the Admin UI
• The link that points to the Wiki needed to be updated
  

Connectors

• Aspider
  • Aspider to crawl dynamic rendering page
• Confluence
  • Incremental crawls when using a list were not working
  • When executing runs, no audit logs were being shown for jobs being "Excluded" nor "Not Changed"
  • Parent ACL's are now taken from the immediate ancestor
• IBM Connections
  • The connector was unable to look up ACL information in LDAP-Cache
• SharePoint Online
  • Added attachment was not crawled until the second incremental crawl
• SharePoint 2013
  • The connector could request more list items in one request than allowed
  • The content was not extracted (401 UNAUTHORIZED)
  • The connector could not process change item type SP.ChangeSite
  • When crawling a specific list, incremental reports could show deletes that never happened

Publishers

• Elasticsearch
  • DeleteByQuery was not working on 6.1.1
• SolrCloud
  
  • Unable to add the component

Services

• LDAP Cache Service
• Refresh was taking too long
• The service was refusing to start

Applications

Known Issues

Connectors 

• Connectorname

  • 
    

Services

• Servicename
  

  •