Excerpt |
---|
Reads a text stream and outputs a list of text blocks. |
Operates On: Text Text Streams.
Include Page |
---|
| Generic Configuration Parameters |
---|
| Generic Configuration Parameters |
---|
|
Configuration Parameters
Parameter |
---|
summary | A Java Pattern identifying where a block should be split. |
---|
name | splitRegex |
---|
required | true |
---|
|
Code Block |
---|
language | js | theme | Eclipse |
---|
title | Example Configuration |
---|
|
{
"type":"SimpleReader",
"splitRegex":"\s*\n\n\s*"
} |
...
Info |
---|
*Example regex, split blocks on two new-lines |
...
Output Flags
Lex-Item Flags:
- TEXT_BLOCK - Flags all text blocks produced by the SimpleReader.
Vertex
...
Flags:
- TEXT_BLOCK_SPLIT - Identifies the vertex as a split between text blocks.
- OVERFLOW_SPLIT - Identifies that an entire buffer was read without finding a split between text blocks.
- The current maximum size of a text block is 64K characters. Text blocks larger than this will be split arbitrarily, and the vertex will be marked with "OVERFLOW_SPLIT".
...