Page History

...

After we are done with changes, script must to be run with other parameter "-v [name of new directory]"

...

After we are done with file, script must to be run with other parameter "-i [filepath]"

...

Routing Policies - Aspire 5.0 - Confluence (accenture.com)

Script must to be run with other parameter "-t [tag1, tag2, ..]"

...

# sharepoint connector
<siteCollectionsToCrawl>
    <siteCollectionUrl>https://cao365.sharepoint.com/sites/qasite/davidgtest2</siteCollectionUrl>
    <siteCollectionUrl>https://cao365.sharepoint.com/sites/qasite/davidgtest2<davidgtest</siteCollectionUrl>
</siteCollectionsToCrawl>

#smb connector
<urls>smb://10.89.26.106:445/</urls>
<urls>smb://10.89.26.105:445/</urls>

#filesystem connector
<urls>c:\tmp</urls>
<urls>c:\Users</urls>

 Urls xml tags are not standardized for all connectors. It is created mechanism in * connection_transform_matrix.json to deal with it.

# sharepoint connector 
"transform":{
  "conn_url_prop_name": "serverUrl",
  "source_url_prop_name": "siteCollectionsToCrawl:siteCollectionUrl",
...

#smb connector
"transform":{
  "conn_url_prop_name": "host",
  "source_url_prop_name": "urls",
..

#file system connector
"transform":{
  "conn_url_prop_name": "url",
  "source_url_prop_name": "urls",
..

...

Script read urls from "content-source.xml" file or txt file , splits them and create  several connections and seeds by HTTP API call.

Ability to splitting url to the connection and seed

Script read an url splits it to connection part and seed part and create several connections and seeds by HTTP API call.the connection and the seed.

Concretely Filesystem url C:\tmp/abc will be splitted to drive part C:\ (connection) and directory part /tmp/abc (seed).

Sharepoint url https://cao365.sharepoint.com/sites/qasite/davidgtest will be splitted to scheme part https://,  hostname part cao365.sharepoint.com, path part /sites/qasite/davidgtest, 

scheme + hostname will be in the connection, path part will be in the seed.

Almost same will be splitted smb url smb://10.89.26.106:445/, only we don't need scheme in this situation so this will be not used. To control usage of scheme, we need to setup in file  connection_transform_matrix.json property

"url_scheme_included":"false".

Ability to pass as parameter a suffix of http object description

Script must be run with other parameter "-d [migr]"

python __init.py__ -d migr -p smb_connector-content-source.zip

Related articles

...