...
Operates On: Lexical Items with TOKEN flag
Configuration
- casecase (boolean, optional) - If true, all tokens are separated on a case change (default = true)
- numbernumber (boolean, optional) - If true, all tokens are separated on a letter-number. (default = true)
- punctuationpunctuation (boolean, optional) - If true, all tokens are separated on an alphanumeric-punctuation. (default = true)
...
Code Block |
---|
language | js |
---|
title | Example Configuration |
---|
|
{
"type":"CharChangeSplitter",
"case": true,
"number": true,
"punctuation": true
} |
Output Flags
...