Page History

...

• TOKEN - All tokens produced are tagged as TOKEN
• ALL_PUNCTUATION - Tokens processed or produced composed only of punctuation characters are tagged as ALL_PUNCTUATION 
• HAS_DIGIT - Tokens produced with at least one digit character are tagged as HAS_DIGIT 
• HAS_PUNCTUATION - Tokens produced with at least one punctuation character are tagged as HAS_PUNCTUATION. (ALL_PUNCTUATION will not be tagged as HAS_PUNCTUATION)

Vertex Flags:

• CHAR_CHANGE -  Identifies the vertex as a change between character formats

...