Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Creates a new token from the original but excluding the characters on the "characters" list parameter.

Excerpt
hiddentrue

Creates a new token from the original but excluding the characters on the "characters" list parameter.

...

  • Parameter
    summaryText containing all the character that will be collapse
    namecharacters
    • Each character in this text will be omitted in the new lexical item created
  • Parameter
    summaryIndicates if the characters to collapse are case insensitive
    defaultfalse
    namecaseInsensitive


Saga_config_stage
boundaryFlagstext block split
requiredFlagstoken
Code Block
languagejs
themeEclipse
titleExample Configuration
{
 "type":"CharacterCollapser",
 "characters":";-!:",
 "caseInsensitive": false
}

Example Output

...

Code Block
languagetext
themeFadeToGrey
 V---------------[e-5s Hello World! We need: one, two, three]---------------V 
 ^-[e-5s]-V-[Hello]-V-[World!]-V-[We]-V-[need:]-V-[one,]-V-[two,]-V-[three]-^ 
 ^-[e5s]--^-[hello]-^-[world!]-^-[we]-^-[need]--^ 
                    ^-[World]--^ 
                    ^-[world]--^ 

...

  • COLLAPSED - Identifies all lexical items which were created from committing characters.
  • TOKEN - All tokens produced are tagged as TOKEN

Vertex Flags:

Info

No vertices are created in this stage