You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 20
Next »
Responsibilities that the Connector developers have to implement:
- Scan the repository document containers to discover new documents to process
- Populate document metadata
- Fetch document content
If you want to start creating your connector right away go to Write Your Own Connector from Scratch
Responsibilities of the Connector Framework (you don't have to worry about this):
- Multi-threading processing
- Distribute the crawl processing
- Store and fetch documents from the database.
- Maintain a snapshot for incremental crawling (adding, updating or deleting documents)
- Handle statistics
- Start, Pause, Stop, Resume the crawl
- Send the documents to the respective workflows for processing and search engine indexing
If you want to learn more about the Connector Framework check out NoSQL Connector Framework Overview.