Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • DATE_TIME - Identifies the token as a date or time indicator.
  • SEMANTIC_TAG - Identifies all lexical items which are semantic tags.
  • TIME - Identidies Identifies the token as just time indicator
  • HAS_PUNCTUATION - Tokens produced with at least one punctuation character are tagged as HAS_PUNCTUATION. (ALL_PUNCTUATION will not be tagged as HAS_PUNCTUATION).
  • ALL_PUNCTUATION - Tokens processed or produced composed only of punctuation characters are tagged as ALL_PUNCTUATION.

...