The Selenium connector will crawl content from websites using an internet browser to retrieve the pages.
The Aspire Selenium connector requires to have the latest instance of the web browser to be used, and its respective web driver. The web driver only supports a range of browser versions, if the browser is outside that range the connector will throw an exception while trying to start using the browser.
Before installing the Selenium connector, make sure that:
Environment Requirements
The Selenium connector run on either Windows or Linux. The web drivers include a version appropriate for each operative system
Name | Supported |
---|---|
Content Crawling | Yes |
Identity Crawling | No |
Snapshot-based Incremental s | Yes |
Non-snapshot-based Incrementals | No |
Document Hierarchy | Yes |
Some of the features of the Selenium connector include:
The content retrieved by the connector is entirely defined using SQL statements, so you can select all or subsets of columns from one or more tables. Initially, the data is inserted in to Aspire using the returned column names, but this may be changed by further Aspire processing.
The RDB via Snapshots connector is able to crawl the following objects:
Name | Type | Relevant Metadata | Content Fetch & Extraction | Description |
---|---|---|---|---|
database row | table fields | NA | Fields requested by SQL |
Due Selenium's own limitations, the connector doesn't support:
Due to API limitations, Selenium connector is only compatible with browsers that have a Web Driver implementation, for example:
Other features are also dependent on browser support, such as Headless Mode.