Page History
| Excerpt | ||
|---|---|---|
Creates N-Grams from of TOKEN flagged lexical items of size between a . The size of the N-Gram can be specified by minimum and a maximum settings. It will also will breaks break the N-Grams on SPLIT_FLAGS
|
Configuration
Parameter summary Minimum size of tokens for an N-Gram default 2 name Min N-Gram size type integer required true Parameter summary Maximum size of tokens for an N-Gram default 2 name Max- N-Gram size type integer required true Parameter summary Split the N-Gram if any of the next token has one of this flags. (i.e. if a token has any of this flags, stops the building of the N-Gram) default ALL_PUNCTUATION, ALL_DIGITS, HAS_PUNTUATION, HAS_DIGIT name Split Flags type string array Parameter summary Specifies flags for token that will not be added to an N-Gram name Ignore On Boundary Flags
General Settings
| Include Page | ||||
|---|---|---|---|---|
|
Overview
Content Tools