Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Flag tokens matched to stop words, to be skipped for following stages

Operates On:  Lexical Items with TOKEN

Include Page
Generic Configuration Parameters
Generic Configuration Parameters

Configuration Parameters

  • caseInsensitive (string, optional) - If true, all stop words and tokens will be process as case insensitive (default = true)

  • stopWords (string, optional) - The resource containing the list of stop words

    • See below for the format. if no resource is provided the stage will use the default list of stop words
  • skipFlags (string array, optional) - Flags to be skipped by this stage
    • Tokens marked with this flags will be ignore by this stage, and no process will be performed.
  • requiredFlags (string array, optional)
    • Tokens need to have all the specified flags, in order to be processed
  • debug (boolean, optional)Enable all debug log functionality of the stage, if any.


Info
titleDefault list of stop words

a, an, and, are, as, at, be, but, by, for, if, in, into, is, it, no, not, of, on, or, such, that, the, their, then, there, these, they, this, to, was, will, with

...