Excerpt |
---|
Analyzes the case of every token (adds additional flags) and optionally adds a lower - case normalized token to the interpretation graph. |
...
Operates On: Lexical Items with TOKEN flag
Generic Configuration Parameters
- boundaryFlags (string, optional)
- The tokens to process must be inside two vertex mark with this flags (e.g ["TEXT_BLOCK_SPLIT"])
- skipFlags (string array, optional) - Flags to be skipped by this stage
- Tokens marked with this flags will be ignore by this stage, and no process will be performed.
- requiredFlags (string array, optional)
- Tokens need to have all the specified flags, in order to be processed.
- atLeastOneFlag (string array, optional)
- Tokens will need at least one of the flags specify in this array.
- debug (boolean, optional)
- Enable all debug log functionality of the stage, if any.
Configuration Parameters
and possibly other flags as specified below.
Include Page |
---|
| Generic Configuration Parameters |
---|
| Generic Configuration Parameters |
---|
|
Configuration Parameters
- normalize (boolean, optional) -
If true, all tokens are normalized to all lower case |
|
. ( = )
...
...
Saga_config_stage |
---|
boundaryFlags | text block split |
---|
stage | CaseAnalysis |
---|
requiredFlags | token |
---|
|
"normalize":false |
Example Output
Saga_graph |
---|
V--[Sentence]--V--[with]--V--[UPPER]--V--[and]--V--[LoWer]--V--[Words!]--V
^--[sentence]--^ ^--[upper]--^ ^--[lower]--^--[words!]--^ | js |
theme | Eclipse |
---|
title | Example Configuration |
---|
{
"type":"CaseAnalysis",
"normalize":false
} |
Output Flags
Note that flags are placed on every token as appropriate to the current token:
- If the token is "President" then that token will have the TITLE_CASE flag.
- If a new lower - case normalized interpretation, "president" is added as an alternative, ; this alternative will have the "ALL_LOWER_CASE" flag.
...
- ALL_LOWER_CASE - All of the characters in the token are lower - case characters.
- ALL_UPPER_CASE - All of the characters in the token are upper - case characters (for example, acronyms).
- TITLE_CASE - The first character is upper case, ; all of the other characters are lower case.
- MIXED_CASE - Handles any mixed upper & lower case scenario not covered above.
- LOWERED - Applied Applies only to tokens which where change to complete that were changed to all lower case, preexisted ; preexisting tokens with all lower case will not be mark marked with this flag.
- TOKEN - Identifies that the Lex-Items produced by this stage are tokens and not text blocks.
Vertex Flags:
Example
With Defaults
Info |
---|
No vertices are created in this stage |
Code Block |
---|
language | text |
---|
theme | FadeToGrey |
---|
|
V--[Sentence]--V--[with]--V--[UPPER]--V--[and]--V--[LoWer]--V--[Words!]--V
^--[sentence]--^ ^--[upper]--^ ^--[lower]--^--[words!]--^ |