Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Operates On:  Lexical Items with TEXT_BLOCK and possibly other flags as specified below.

Library: saga-sentence-breaker-stage

Include Page
Generic Configuration Parameters
Generic Configuration Parameters

...

  • language (string, required) - Indicates the language of the text to process. default "en" (i.e. English)
    • Languages available areinclude:
      • English - "en"
      • German - "de"
      • Portuguese - "pt"
      • Dutch - "nl"
Code Block
languagejs
themeEclipse
titleExample Configuration
{
 "type":"SentenceBreakerStage",
 "language":"en",
 "skipFlags": ["SKIP"],
 "debug": true,
}



Example Output

The sentence detector will remove any space spaces and dot, dots at the beginning and end of a sentence.

Code Block
languagetext
themeFadeToGrey
V-----------[Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed eget luctus lorem. Nam cursus eleifend efficitur. Cras nec ultricies nulla. Maecenas porta cursus massa non consectetur.]------------V
^--[Lorem ipsum dolor sit amet, consectetur adipiscing elit]--V--[Sed eget luctus lorem]--V--[Nam cursus eleifend efficitur]--V--[Cras nec ultricies nulla]--V--[Maecenas porta cursus massa non consectetur]--^

Output Flags

Lex-Item Flags

...

  • TEXT_BLOCK - Flags all of the text blocks produced by the SimpleReader
  • SENTENCE - Every text block processed by this breaker will be marked as SENTENCE

Vertex Flags

...

  • SENTENCE_SPLIT - Indicates the split (start/end) between sentences.
  • TEXT_BLOCK_SPLIT - Indicates the split of the textblock.