Versions Compared

Old Version 5

changes.mady.by.user Unknown User (nnavarro)

Saved on

compared with

New Version Current

changes.mady.by.user user-1b188

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Panel
titleOn this page
Table of Contents

Table of Contents

Aspire Index Auditing

Available from  (2.1 Release)   The Aspire Index Auditing is a feature aimed to help the Administrators to administrators keep track of all content source actions and search engine indexes in order to identify possible differences and problems between both of them. The

Index Auditing consists in of three new additionscomponents:

  • Content Source auditing
  • Search Engine index auditing (publisher index dumps)
  • Reconciliation file between the content source and search engine auditing files


Training Material

If you're interested in learning more, here's a recording of the Tech Talk on the Performance and Auditing Tech Talk along with the Performance and Auditing Tech Talk presentation.


Content

sources auditing

Sources Auditing

By default, every content source will log every action done for each of the documents crawled, to disable it go to the the Advanced Connector Properties in  in the content source configuration and uncheck the the Enable Auditing option. option.

Image Added


There are 2 types of events logged:

Job

  • Indicates an event for one single job

Batch

  • Indicates an event for a batch of jobs


The actions that are being logged by the auditing are:

Workflow completed

Add: 

  • The document was sent to be processed to the workflow as an add

BatchCompleted: 

  • The processing batch finished successfully

BatchError: 

  • The processing batch finished with error

Excluded: 

  • The document was excluded by index pattern configuration, no further processing was done for it

Update: 

  • The document was sent to be processed to the workflow as an update

Delete: 

  • The document was sent to be processed to the workflow as a delete

NoChange: 

  • The document was found as not changed, no further processing was done for it
  • Excluded

The document was excluded by index pattern configuration, no further processing was done for it

WorkflowComplete: 

  • The document finished the workflow successfully

Workflow

error

Error: 

  • The document finished the workflow with an error

Workflow

terminated

Terminated: 

  • The document was terminated by a workflow rule

CrawlBegin: 

  • Indicates the beginning of the crawl process

CrawlEnd: 

  • Indicates the ending of the crawl process


How to Access the Auditing

Step 1

  • Batch completed

The processing batch finished successfully

  • Batch error
The processing batch finished with error

To see the audit logs of any crawls from the Aspire UI, open the content source statistics, and click click View Audit Logs:

View-audit-logs.pngImage Removed

Image Added


Step 2

After you click Once you clicked on View Audit Logs, the following page will be displayed:Auditing-page.pngImage Removed

Image Added



Step 3

You can also filter the audit logs by action:Auditing-filters.pngImage Removedtype and/or action.

Image Added

By Type

Image Added

By Action


Search Engine

index auditing

Index Auditing

The auditing log files for a search engine are generated via index dumps. At the moment only Only these publishers are able to create index dumps:


To dump an index and compare it you have to:

Go to any auditing page of a content source, and click on Index Compare, select
  1. Select the publisher (should be configured to create index dumps) and click
on
  1. on Compare to:
  2. Go to any auditing page of a content source, and click on Image Added, 

Image Added


  1. It will open a pop-up window for generating both index dumps and reconciliation files
 Select New Index Dump and then click on
  1. Click on Start Dump
to
  1.  to start an index dump. Take into account that the index dump will be executed
agains
  1. against the documents indexed by this content source only.

Image Added

  1. You will see the dump state getting refresh by clicking on
the
  1. the refresh
button
  1.  button, and once it finish you will see it in the dumps dropdown list:
 
  1. Select the index dump you have just created (notice the button action changes when you select an index dump) and click
on
  1. on Start Comparison
  2. When the comparison finishes you are going to be able to see the reconciliation file:



Auditing

files

Files

All publisher and content source audit files are located at {aspire-distribution-home}/audit.

  • The reconciliation audit files, once created, will be located under the folder named: {content-source-name}_{publisher-name}_diff
  • Each content source, publisher, or reconciliation folder under the audit folder can contain multiple audit files each identified by a timestamp:
Audit-files.pngImage Removed
  • For content sources audit files, the timestamp is the crawl start time.
  • For publishers and reconciliation the timestamp is the time of the audit file creation.

Image Added