Creates a new token from the original but excluding the characters on the "characters" list parameter.
Excerpt |
---|
|
Creates a new token from the original but excluding the characters on the "characters" list parameter. |
...
Parameter |
---|
summary | Text containing all the character that will be collapse |
---|
name | characters |
---|
|
- Each character in this text will be omitted in the new lexical item created
Parameter |
---|
summary | Indicates if the characters to collapse are case insensitive |
---|
default | false |
---|
name | caseInsensitive |
---|
|
Saga_config_stage |
---|
boundaryFlags | text block split |
---|
requiredFlags | token |
---|
|
Code Block |
---|
language | js |
---|
theme | Eclipse |
---|
title | Example Configuration |
---|
|
{
"type":"CharacterCollapser",
"characters":";-!:",
"caseInsensitive": false
} |
Example Output
...
Code Block |
---|
language | text |
---|
theme | FadeToGrey |
---|
|
V---------------[e-5s Hello World! We need: one, two, three]---------------V
^-[e-5s]-V-[Hello]-V-[World!]-V-[We]-V-[need:]-V-[one,]-V-[two,]-V-[three]-^
^-[e5s]--^-[hello]-^-[world!]-^-[we]-^-[need]--^
^-[World]--^
^-[world]--^ |
...
- COLLAPSED - Identifies all lexical items which were created from committing characters.
- TOKEN - All tokens produced are tagged as TOKEN
Vertex Flags:
Info |
---|
No vertices are created in this stage |