Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The overall structure of Saga is shown in the diagram below:

A Saga

...

engine is a

...

pipeline of text processing stages

  1. The first stage in the pipeline is a "reader"
    • This reads raw text from a text stream and returns it as text blocks to be processed by the stages.

2. Then there

...

is a list of pipeline stages.

3. The result is the final interpretation graph of text blocks, tokens, and semantic tags.

4. Different orders will result in different results.


Resources

Resources are any of the data structures which typically support an engine like this. This includes pipeline configurations, dictionaries, pattern databases (perhaps from text mining), machine learning models, etc.

Resource Providers

Resources are provided by "resource providers" which insulate the pipeline stages from having to know the details of the underlying storage technology. Example providers are:  "FileSystem" and "Elasticsearch".

...