Versions Compared

Old Version 2

changes.mady.by.user Paul E. Nelson

Saved on

compared with

New Version 3

changes.mady.by.user Paul E. Nelson

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • TOKEN - Identifies that the Lex-Items produced by this stage are tokens and not text blocks.
  • ORIGINAL - Identifies that the Lex-Items produced by this stage have an are the original, as written, representation of every token (e.g. before normalization)

...

  • ALL_WHITESPACE - Identifies that the characters spanned by the vertex contains all white-space.are all whitespace characters (spaces, tabs, new-lines, carriage returns, etc.)