Excerpt |
---|
Reads a text stream and outputs a list of text blocks. |
Operates On: Text Streams Text Streams.
Include Page |
---|
| Generic Configuration Parameters |
---|
| Generic Configuration Parameters |
---|
|
Configuration Parameters
Parameter |
---|
summary | A Java Pattern identifying where a block should be split. |
---|
name | splitRegex |
---|
required | true |
---|
|
Saga_config_stage |
---|
title | Example Configuration |
---|
|
"splitRegex":"\s*\n\n\s*" |
Info |
---|
*Example regex, split blocks on two new-lines |
Output Flags
Lex-Item Flags:
- TEXT_BLOCK - Flags all text blocks produced by the SimpleReader.
Vertex
...
Flags:
- TEXT_BLOCK_SPLIT - Identifies the vertex as a split between text blocks.
- OVERFLOW_SPLIT - Identifies that an entire buffer was read without finding a split between text blocks.
- The current maximum size of a text block is 64K characters. Text blocks larger than this will be split arbitrarily, and the vertex will be marked with "OVERFLOW_SPLIT".
...