Versions Compared

Old Version 11

changes.mady.by.user Potter (Esteban Alvarado)

Saved on

compared with

New Version Current

changes.mady.by.user Luis Diego Vargas Guell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Reads a text stream and outputs a list of text blocks.


Operates On:  Text Streams

Configuration

 Text Streams.  

Saga_is_recognizer
Recognizerfalse

Include Page
Generic Configuration Parameters
Generic Configuration Parameters

Configuration Parameters

  • Parameter
    summaryA Java Pattern identifying
    splitRegex (string, required) - A Java Pattern which identifies
    where a block should be split.
    namesplitRegex
    requiredtrue
Code Block
languagejs
themeEclipse
titleExample Configuration
{
  "type":"SimpleReader",
  "splitRegex":"\s*\n\n\s*"
}

...

 Info
*Example regex, split blocks on two new-lines
...
Output Flags
Lex-Item Flags:
  • TEXT_BLOCK - Flags all text blocks produced by the SimpleReader.
Vertex Flags:
  • TEXT_BLOCK_SPLIT - Identifies the vertex as a split between text blocks.
  • OVERFLOW_SPLIT - Identifies that an entire buffer was read without finding a split between text blocks.
    • The current maximum size of a text block is 64K characters.  Text blocks larger than this will be split arbitrarily split, and the vertex will be marked with "OVERFLOW_SPLIT"\.