You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 5
Next »
Analyzes the case of every token (adds additional flags) and optionally adds a lower-case normalized token to the interpretation graph.
Operates On: Lexical Items with TOKEN flag
Configuration Parameters
- normalize (boolean, optional) - If true, all tokens are normalized to all lower case. (default = true)
Flags
Note that flags are placed on every token as appropriate to the current token:
- If the token is "President" then that token will have the TITLE_CASE flag.
- If a new lower-case normalized interpretation, "president" is added as an alternative, this alternative will have the "ALL_LOWER_CASE" flag.
Lex-Item Flags:
- ALL_LOWER_CASE - All of the characters in the token are lower-case characters.
- ALL_UPPER_CASE - All of the characters in the token are upper-case characters (for example, acronyms).
- TITLE_CASE - The first character is upper case, all of the other characters are lower case.
- MIXED_CASE - Handles any mixed upper & lower case scenario not covered above.
Vertex Flags: