Since the Beginning with release 3.1 release0, Aspire needs uses an external MongoDB instance in order to keep its for connectors built with the new NoSQL Connector Framework. The database is used to keep crawl metadata and distribute the allow processing and scanning to be distributed. All the MongoDB configuration should be is done in the settings.xml file.
...
| Excerpt |
|---|
| Code Block |
|---|
| language | xml |
|---|
| firstline | 78 |
|---|
| linenumbers | true |
|---|
| <!-- noSql database provider for the 4.0 connector framework -->
<noSQLConnectionProvider sslEnabled="false" sslInvalidHostNameAllowed="false">
<implementation>com.searchtechnologies.aspire:aspire-mongodb-provider</implementation>
<servers>mongodb-host:27017</servers>
</noSQLConnecitonProvider> |
|
Aspire will create one MongoDB database for each content source configured. When the content source is deleted, the database will be dropped. The database name will the taken from the normalised value of the content source name. Starting in Aspire 4.0, the database names will be prefixed with "aspire-" to avoid possible conflicts of name. If you wish to change the prefix, add a "namespace" to the configuration:| Code Block |
|---|
| language | xml |
|---|
| linenumbers | true |
|---|
|
<!-- noSql database provider for the 4.0 connector framework -->
<noSQLConnectionProvider sslEnabled="false" sslInvalidHostNameAllowed="false">
<namespace>myNamespace</namespace>
<implementation>com.searchtechnologies.aspire:aspire-mongodb-provider</implementation>
<servers>mongodb-host:27017</servers>
</noSQLConnecitonProvider> |
| Anchor |
|---|
| Connect+to+a+Multi-node+MongoDB+Installation |
|---|
| Connect+to+a+Multi-node+MongoDB+Installation |
|---|
|
...
If you want to be extra safe and encrypt the URLs, IDs, or any other metadata stored in MongoDB, you can do by specifying the name of the fields to encrypt:
| Code Block |
|---|
| language | xml |
|---|
| firstline | 78 |
|---|
| linenumbers | true |
|---|
|
<!-- noSql database provider for the 4.0 connector framework -->
<noSQLConnectionProvider sslEnabled="false" sslInvalidHostNameAllowed="false">
<implementation>com.searchtechnologies.aspire:aspire-mongodb-provider</implementation>
<servers>mongodb-host:27017</servers>
<encryptFields>
<field>_id</field> <!-- Encrypts all the IDs -->
<field>url</field> <!-- Encrypts the url fields -->
<field>fetchUrl</field>
<field>parentId</field>
</encryptFields>
</noSQLConnecitonProvider> |