Excerpt |
---|
Reads a text stream and outputs a list of text blocks. |
Operates On: Text Streams.
Include Page |
---|
| Generic Configuration Parameters |
---|
| Generic Configuration Parameters |
---|
|
Configuration Parameters
- splitRegex - which identifies
identifying where a block should be split. | name | splitRegex |
---|
required | true |
---|
|
Code Block |
---|
language | js |
---|
title | Example Configuration |
---|
|
{
"splitRegex":"\s*\n\n\s*"
} |
...
Info |
---|
*Example regex, split blocks on two new-lines |
...
Output Flags
Lex-Item Flags:
- TEXT_BLOCK - Flags all text blocks produced by the SimpleReader.
Vertex Flags:
- TEXT_BLOCK_SPLIT - Identifies the vertex as a split between text blocks.
- OVERFLOW_SPLIT - Identifies that an entire buffer was read without finding a split between text blocks.
- The current maximum size of a text block is 64K characters. Text blocks larger than this will be split arbitrarily split, and the vertex will be marked with "OVERFLOW_SPLIT"\.