Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Operates On:  Lexical Items with TOKEN flag

Configuration

  • casecase (boolean, optional) - If true, all tokens are separated on a case change (default = true)
  • numbernumber (boolean, optional) - If true, all tokens are separated on a letter-number. (default = true)
  • punctuationpunctuation (boolean, optional) - If true, all tokens are separated on an alphanumeric-punctuation. (default = true)

...

Code Block
languagejs
titleExample Configuration
{
  	"type":"CharChangeSplitter",
  	"case": true,
	"number": true,
	"punctuation": true
}

Output Flags

...