Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Info

*Example regex, split blocks on two new-lines

Output Flags

Lex-Item Flags:

  • TEXT_BLOCK - Flags all text blocks produced by the SimpleReader.

Vertex

...

Flags:

  • TEXT_BLOCK_SPLIT - Identifies the vertex as a split between text blocks.
  • OVERFLOW_SPLIT - Identifies that an entire buffer was read without finding a split between text blocks.
    • The current maximum size of a text block is 64K characters. Text blocks larger than this will be split arbitrarily, and the vertex will be marked with "OVERFLOW_SPLIT".

...