Page History

Operates On:  Lexical Items with TOKEN and possibly other flags as specified below.

Configuration Parameters

• Parameter
  summary Minimum length number for tokens. Can work with “Filter Tokens With Length Lower Than” option to create a range of lengths filtered. default true name Filter Tokens With Length Higher Than type boolean

• Parameter
  summary Maximum length number for tokens. Can work with “Filter Tokens With Length Higher Than” option to create a range of lengths filtered. default false name Filter Tokens With Length Lower Than type boolean

• Parameter
  summary Replace token tag with a new one if the length of the token is accepted by the filter. default false name Tag Filtered Token with type boolean

• Parameter
  summary Stop processing tokens filtered. default false name Stop Pipeline Process On Filtered type boolean

"boundaryFlags": [],
"debug": false,
"tagText": false,
"tagName": "filtered",
"filterMin": false,
"minChars": 0,
"atLeastOneFlag": [],
"confidenceAdjustment": 1,
"requiredFlags": [],
"haltProcessing": true,
"maxChars": 100,
"filterMax": true,
"skipFlags": []

Example Output

Filters by a minimum length of 10 (with option set to 10 instead of 100 and replacing token checked).

For example, the token:  "ThisTokenIsLong" will produce the following graph:

V-------[ThisTokenIsLong]-------V
^---------[{filtered}]----------^

Output Flags

Lex-Item Flags:

• FILTERED - All tokens produced are tagged as FILTERED.

Vertex Flags: