Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Splits tokens on specified characters, typically punctuation. Multiple split characters in a row will create a single split (not multiple splits).


Operates On:  Lexical Items with TOKEN and possibly other flags as specified below.

Saga_is_recognizer
Recognizerfalse

...