Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Creates a new token from the original but excluding the characters on the "characters" list parameter.


Operates On:  Lexical Items with TOKEN and possibly other flags as specified below.

Saga_is_recognizer
Recognizerfalse

Include Page
Generic Configuration Parameters
Generic Configuration Parameters

Configuration Parameters

  • Parameter
    summaryText containing all the character that will be collapse
    namecharacters
    • Each character in this text will be omitted in the new lexical item created
  • Parameter
    summaryIndicates if the characters to collapse are case insensitive
    defaultfalse
    namecaseInsensitive


Saga_config_stage
boundaryFlagstext block split
requiredFlagstoken
"characters":";-!:",
"caseInsensitive": false

Example Output

Code Block
languagetext
themeFadeToGrey
 V---------------[e-5s Hello World! We need: one, two, three]---------------V 
 ^-[e-5s]-V-[Hello]-V-[World!]-V-[We]-V-[need:]-V-[one,]-V-[two,]-V-[three]-^ 
 ^-[e5s]--^-[hello]-^-[world!]-^-[we]-^-[need]--^ 
                    ^-[World]--^ 
                    ^-[world]--^ 

Output Flags

Lex-Item Flags:

  • COLLAPSED - Identifies all lexical items which were created from committing characters.
  • TOKEN - All tokens produced are tagged as TOKEN

Vertex Flags:

Info

No vertices are created in this stage