Content Sources

All of the management of Contetn Content Sources can be done in the Admin UI Content Sources, where we have you can access to all of the management features, and we .

• You can see all the content sources in their new presentation.

• Each content source card displays

• further detailed information.
• You can identify

• which is the content source

• you want including its current state, how many jobs it has crawled, and how many errors were produced.

• You can access the controls for copy, delete, crawl control, activate, and deactivate.

Image Modified

Controls

For the new display of content sources Aspire 2.0 adds adds new features and information into card like objects that represents each content source, these cards contains .

Image Added

The cards contain several functions to control the content source, the following are all the controls of the card-content source

Image Removed

.

1. Content Source Name & Icon
   • The display name of the content source, if the name is to long the name will appear follow by an ellipsis (e.g. ABC...), and if the mouse is over the name, a tooltip will appear with the full name. The Content Source Name is also a link to the configuration of the respective content source.
     
     
2. Content Source Status
   • Indicates the current status of the content source. When the status changes not only does the label change, the color of the content source card changes.
     
     
3. Time of Crawl
   • Indicates the length of time the crawl has been crawling, or how long it took the crawl to finish. In case the content source has never being started the label will be Never Executed. If you put the mouse over the Time of Crawl control, it will show a tool-tip in your local timezone, of the exact date and time the content source was started.
     
     
4. Jobs Done

   • Completed jobs shows the total number of successful jobs, you can also click on Complete and open the statistics.
      

5. Errors

   • Errors will show the number of document errors if any; if there is at least one error, you can click on the number and go to the Error Page.
      

6. Statistics

   • It will show all the information available about the current crawl, including crawl type, documents per second, start time, jobs status, etc. 
     
     

7. Start Full Crawl

   • Starts a full crawl, but before that it will show a warning indicating all incremental indexing data will be deleted.

    

8. Start Incremental Crawl

   • Starts an incremental crawl.
     
     

9. Start Test Crawl

   • Starts a Test Crawl that will ask how many documents to crawl and how many to skip before it starts to crawl.
     
     

10. Copy

    • Creates a new content source with the same configuration.
      
      

11. Export

    • Downloads a zip file with the configuration of the content source that you can use to import it into a different aspire instance.
      
      

12. Enable/Disable

    • It will enable or disable the content source. (you can only disable the content source if it's status is new, completed, error, failed or canceled)
       

13. Delete

    • If you click the delete button a confirmation will appear, if you click OK the delete will proceed and the content source will be deleted.

States

The content sources can be in one of several states, in . In each state, some controls change and some are disabled. In the section above, we saw the controls of a content source, in . In this section we will see which are the controls for each state.

Grouping

1. • The display name of the group, if the name is to long the name will appear follow by an ellipsis (e.g. ABC...), and if the mouse is over the name, a tool-tip will appear with the full name. The Group Name is also a link that will expand the content source, so we can see the content source inside it.

2. Number of Content Sources

   • The group will display the number of content sources that has contained.

3. Expand

   • If clicked, it will expand the content source, so we can see the content source inside it.

4. Add to Group

   • If clicked, Add to Group will open the group menu, and put the name of the group so we can only choose the content sources and click on Add Group.

5. Content Sources Status

   • Has well as the number of content sources the group will have the status of the content sources and how many content sources inside him has that specific status

     1. Green: Stands for the Running status.

     2. Blue: Stands for the Paused status.

     3. Red: Stands for the three unsuccessful status Error, Failed and Aborted.

     4. Orange: Stands for the three transitory status Pausing, Resuming and Stopping.

     5. White: Stands for the idle status New and Completed and Canceled Cancelled.

     6. Gray: Stands for the Disabled status.

6. Ungroup

   • If clicked, Ungroup will take all the content sources inside the group and put them in the first level (root), and it will delete the group.

Manage a Group

This section walks through the steps necessary to create, use and dispose of a group, and how to interact with the group itself.

Step 1: Select the

content sources

Click on the Group button in the Action Bar, a text field will appear, and the bottom of all the content sources will change into a check box that says Group. Select the content sources you want to group together by checking the Group check box, then put the name of the group in the text field next to the Group button.

Image Modified

Step 2: Create the

group

Once you have selected the content sources and filled the name, you can click on Add Group, this will fade out and in the content source, and a group card will appear at the end of the content sources. This will be the group you just create with all the selected content sources inside it.

Step 3: Expand the

group

Once we have the group created we can expand it by clicking on the Group Name or by clicking on the expand button Image Modified, this will fade out and in the content sources and display only the content sources inside the group. Also a legend will appear in the Action Bar indicating in which group we are in now, right next to the legend is the Return turn button Image Modified, if we click on it, it will return us to the first level (root).

Also while we are in the expanded group we can see that the content source has another button right before the copy button, this button is the Ungroup One button Image Modified, it looks exactly as the Return button Image Modified, this button will remove the content source from the group and put it on the first level (root)

Image Modified

Step 4: Remove the

group

If you want to remove a group, the only way is to ungroup the entire group by clicking the Ungroup button Image Modified, this will move all the content sources from our group to the first level (root) and delete the group.

Filtering

In Aspire Admin UI, we you can do filtering to filter  the content sources, and we can apply several filters for a more accurate result.

Text Filter (Search)

With this filter, we You can do regex searches base on the Content Source Name and the Group Name. To make a search we just put the regex we want in the text field on the top right corner of the Action Bar and press the Enter key. Only the content sources that match the regex will be displays

Image RemovedImage Added

Cookie Filters

The cookie filters are regular filters that will be saved in a cookie so once we apply a cookie filter, this will be active until we remove it. We can access the cookie filters by clicking on the Filter button Image Removed, and when you activate a filter the Filter button will highlight Image Removed. Image Added,

We have three ( 3 ) categories of cookie filters, all of then explained below.

Image Added

General

filters

We have three ( 3 ) general filters:

1. Active: (Checked by default ) If  If checked shows all the content sources that are activeInactive: active (Checked by default )
2. Groups:  If checked shows all the groups. (Checked by default)
3. Inactive:  If If checked shows all the content sources that are inactiveGroups: inactive (Checked by default) If checked shows all the groups.

Image Removed

Status

filters

The status filters will has all the possible status for the content sources, also it will have the All filter (Checked by default), if any of the status filters is checked, it will unchecked the All filter and only the content sources with matching the matching checked status will be displayed. If the All filter is checked again, it will unchecked all the status filters.

Image RemovedImage Added

Connector

filters

The connector filters will be build according to the types of content sources we have available for the aspire account, but it will always will have the the All filter (Checked by default), if any of the connector filters is checked, it will unchecked the All filter and only the content sources with matching the matching checked connector types will be displayed. If the All filter is checked again, it will unchecked all the connector filters.

Image RemovedImage Added

Time

filters

The time filters can be applied for start and end time of the crawl.

• Start Time: (Unchecked by default) Compares the time given with the start time of the content source, if the time given is after or the exact time of the content source, the content source will be display, if we check the Start Time filter but we don't give a start time, the filter won't be applied. Also if the content source doesn't have a start time, the content source won't be displayed.
  • To set the date and time of the filter click on the calendar button (2)
  • To enable the filter check the filter (1)
     
• End Time: (Unchecked by default) Compares the time given with the end time of the content source, if the time given is before or the exact time of the content source, the content source will be display, if we check the End Time filter but we don't give a start time, the filter won't be applied. Also if the content source doesn't have a end time, the content source won't be displayed.

  Image Removed Image Removed

  • • To set the date and time of the filter click on the calendar button (2)
    • To enable the filter check the filter (1)

  Image Added 

Import

In Admin UI,

Import

In Aspire UI 2.0 we can import a content source zip file and load the content source directly to our management page. For this we just need to click on the Import button in the Action Bar, this will open a browse window where wecan search for our content source zip file, select it and click open. Automatically the content source will be load into the management page.

Image Removed

Add Source

With Add Source we can choose , select the type of content source we you want to do by choosing the connector. The Add Source menu has three (3) main sections:.

 Image Added

Image Removed

1. Add Source
   • Access the Source Menu from the Add Source button
2. Legacy Connectors
   • These connector will be identified with a LEGACY label, which means these connector haven't been updated to use the new connector framework.
3. New Connectors
   • These connectors have been updated to use the new connector framework. 
4. . Artifact Id
   • Indicates the maven Artifact Id of the connector.
5. Legacy Label
   
   • The Legacy label will indicate which connectors are not updated to use the new connector framework.
6. Custom
7. Official Connectors: Is the lost of all the connector created by Search Technologies for Aspire. Just by clicking on the connector we want to use, we will be redirect to the configuration page. The Official connector may change according to your connector entitlements.
8. Custom Connectors:
   • It will open a menu to install a custom connector from maven coordinates or a set of config files.
   • Refresh Sources: 
     • With the Refresh button we can update the list of the connectors available for us.

Custom Connector

By clicking on the Custom Connectors button, we will Click Custom to open a window where we you can choose between two methods to install a custom connector , repository and configuration files, both . Both show as toggle buttons on at the top of the window.

Image Removed

* If the dxf file doesn't have the new valid format for connectors, it won't be possible to configure the connector.

Loaded Custom Connectors

In case that a custom connector was added without an icon, and alert icon will appear before the connector's name.

Image Removed

If the added custom connector doesn't exist, the alert icon will be appear before the content source name and the icon option will be disabled.

Image Removed