Page History

...

Operates On:  Lexical Items with TOKEN flagand possibly other flags as specified below.

Configuration Parameters

• normalize (boolean, optional) -

  Parameter
  summary

  If true, all tokens are normalized to all lower case

  . (

  default

  =

  true

  )
• skipFlags (string array, optional) - Flags to be skipped by this stage
  • Tokens marked with this flags will be ignore by this stage, and no process will be performed.
• requireFlags (string array, optional)
  • Tokens need to have all the specified flags, in order to be processed
• debug (boolean, optional)
  • Enable all debug log functionality of the stage, if any.

• name normalize type boolean

"normalize":false

Example Output

V--[Sentence]--V--[with]--V--[UPPER]--V--[and]--V--[LoWer]--V--[Words!]--V
^--[sentence]--^          ^--[upper]--^         ^--[lower]--^--[words!]--^

{
  "type":"CaseAnalysis",
  "normalize":false
}

Output Flags

Note that flags are placed on every token as appropriate to the current token:

• If the token is "President" then that token will have the TITLE_CASE flag.
• If a new lower - case normalized interpretation, "president" is added as an alternative, ; this alternative will have the "ALL_LOWER_CASE" flag.

...

• ALL_LOWER_CASE - All of the characters in the token are lower - case characters.
• ALL_UPPER_CASE - All of the characters in the token are upper - case characters (for example, acronyms).
• TITLE_CASE - The first character is upper case, ; all of the other characters are lower case.
• MIXED_CASE - Handles any mixed upper & lower case scenario not covered above.
• LOWERED - Applies only to tokens that were changed to all lower case; preexisting tokens with all lower case will not be marked with this flag.
• TOKEN - Identifies that the Lex-Items produced by this stage are tokens and not text blocks.

Vertex Flags:

• none

Example

With Defaults