Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Analyzes the case of every token (adds additional flags) and optionally adds a lower-case normalized token to the interpretation graph.


Operates On:  Lexical Items with TOKEN flag

Include Page
Generic Configuration Parameters
Generic Configuration Parameters

Configuration Parameters

  • normalize (boolean, optional) - If true, all tokens are normalized to all lower case. (default = true)


Code Block
languagejs
themeEclipse
titleExample Configuration
{
  "type":"CaseAnalysis",
  "normalize":false
}

Output Flags

Note that flags are placed on every token as appropriate to the current token:

  • If the token is "President" then that token will have the TITLE_CASE flag.
  • If a new lower-case normalized interpretation, "president" is added as an alternative, this alternative will have the "ALL_LOWER_CASE" flag.

Lex-Item Flags:

  • ALL_LOWER_CASE - All of the characters in the token are lower-case characters.
  • ALL_UPPER_CASE - All of the characters in the token are upper-case characters (for example, acronyms).
  • TITLE_CASE - The first character is upper case, all of the other characters are lower case.
  • MIXED_CASE - Handles any mixed upper & lower case scenario not covered above.
  • LOWERED - Applied only to tokens which where change to complete lower case, preexisted tokens with all lower case will not be mark with this flag

Vertex Flags:

  • none

Example

With Defaults 

Code Block
languagetext
themeFadeToGrey
V--[Sentence]--V--[with]--V--[UPPER]--V--[and]--V--[LoWer]--V--[Words!]--V
^--[sentence]--^          ^--[upper]--^         ^--[lower]--^--[words!]--^