Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Note that flags are placed on every token as appropriate to the current token.:

  • So, if If the token is "President" then that token will have the TITLE_CASE flag.
  • If a new lower-case normalized interpretation, "president" is added as an alternative, this alternative will have the "ALL_LOWER_CASE" flag.

Lex-Item Flags:

  • ALL_LOWER_CASE - All of the characters in the token are lower-case characters.
  • ALL_UPPER_CASE - All of the characters in the token are upper-case characters (for example, acronyms).
  • TITLE_CASE - The first character is upper case, all of the other characters are lower case.
  • MIXED_CASE - Handles any mixed upper & lower case scenario not covered above.

Vertex Flags:

  • none