This stages are contained inside the Saga Core library and available in all time
Text Block Readers
Readers read text streams and create text blocks to process.
Tokenizers
Tokenizers read text blocks and divide them up into individual tokens to be processed.
Splitters
Splitters split up tokens into multiple smaller tokens as an alternative interpretation.
Normalizers
Normalizers create alternative normalized interpretations of tokens from original tokens.
Recognizers
Recognizers identify and flag tokens based on their character patterns.
Taggers
Taggers create semantic tags which are added to the interpretation graph as alternative interpretations.
- RegexPattern - Looks up matches to regular expressions in a dictionary across multiple tokens and then tags the match with one or more semantic tags as an alternative representation. For a simple regex expression where a match only needs to occur against a singe token, the Simple Regex Stage is recommended.
- DictionaryTagger -
- AdvancedPattern -
Overview
Content Tools