Page History

...

• Whitespace Tokenizer - 

  Excerpt Include
  Whitespace Tokenizer Stage Whitespace Tokenizer Stage nopanel true

• Lucene Pipeline Stage - 

  Excerpt Include
  Lucene Pipeline Stage Lucene Pipeline Stage nopanel true

  
  

Splitters

Splitters split up tokens into multiple smaller tokens as an alternative interpretation.

...

• Sentence Filter Producer - 

  Excerpt Include
  Sentence Filter Stage Sentence Filter Stage nopanel true

• Length Filter Stage - 

  Excerpt Include
  Length Filter Stage Length Filter Stage nopanel true