Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Parameter
    summaryIf true, all tokens are normalized to all lower case
    defaulttrue
    namenormalize
    typeboolean
Code Block
Saga_config_stage
boundaryFlagstext block split
stageCaseAnalysis
requiredFlagstoken
"normalize":false

Example Output

Code Block
languagetext
themeFadeToGrey
titleExample Output
V--[Sentence]--V--[with]--V--[UPPER]--V--[and]--V--[LoWer]--V--[Words!]--V
^--[sentence]--^          ^--[upper]--^         ^--[lower]--^--[words!]--^  


Output Flags

Note that flags are placed on every token as appropriate to the current token:

...

  • ALL_LOWER_CASE - All of the characters in the token are lower case characters.
  • ALL_UPPER_CASE - All of the characters in the token are upper case characters (for example, acronyms).
  • TITLE_CASE - The first character is upper case; all of the other characters are lower case.
  • MIXED_CASE - Handles any mixed upper & lower case scenario not covered above.
  • LOWERED - Applies only to tokens that were changed to all lower case; preexisting tokens with all lower case will not be marked with this flag.
  • TOKEN - Identifies that the Lex-Items produced by this stage are tokens and not text blocks.

Vertex Flags:

Info

No vertices are created in this stage

...