Page History
| Excerpt |
|---|
Reads a text stream and outputs a list of text blocks. |
Operates On: Text Streams.
Saga_is_recognizer Recognizer false
| Include Page | ||||
|---|---|---|---|---|
|
Configuration Parameters
Parameter summary A Java Pattern identifying where a block should be split.
...
name splitRegex required true
| Code Block | ||||
|---|---|---|---|---|
| ||||
"splitRegex":"\ |
...
s*\n\n |
...
\s*" |
| Info |
|---|
*Example regex, split blocks on two new-lines |
Output Flags
Lex-Item Flags:
- TEXT_BLOCK - Flags all text blocks produced by the SimpleReader.
Vertex Flags:
- TEXT_BLOCK_SPLIT - Identifies the vertex as a split between text blocks.
- OVERFLOW_SPLIT - Identifies that an entire buffer was read without finding a split between text blocks.
- The current maximum size of a text block is 64K characters. Text blocks larger than this will be split arbitrarily, and the vertex will be marked with "OVERFLOW_SPLIT".
Overview
Content Tools