Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Looks up matches to regular expressions in a dictionary across multiple tokens and then tags the match with one or more semantic tags as an alternative representation. For a simple regex expression , where a match only needs to occur against a singe token. , the Simple Regex Stage is recommended.

Operates On:  Lexical Items with TOKEN flagand possibly other flags as specified below.

Saga_is_recognizer

Note

All possibilities are tagged (including overlaps and sub-patterns) with the expectation that later disambiguation stages will choose which tags are the correct interpretation.

...

Code Block
languagejs
themeEclipse
titleExample Configuration
{
 "type":"RegexPattern",
 "patterns":"regex-provider:patterns",
 "maxLength": 25,
 "caseInsensitive": true
}

Example Output

In the following example, "What's your name" is in the dictionary as a regex for self-name, and there are also regex for numbers "[0-9]+" and "[0-9]+\\.[0-9]+" :

Code Block
theme
languagetextFadeToGrey
 V--------------------------------------[What's your name 12 @#$ 25 63.3]---------------------------------------V  
  ^-----[What's]-----V--[your]--V--[name]--V-----[12]-----V--[@#$]--V-----[25]-----V-----------[63.3]------------^  
  ^--[What]--V--[s]--^                     ^--[{number}]--^         ^--[{number}]--^-----[63]-----V-----[3]------^  
  ^-----[what's]-----^                                                             ^---------[{number}]----------^  
  ^--[what]--^                                                                     ^--[{number}]--^--[{number}]--^  
  ^-------------[{self-name}]--------------^                                       

Output Flags

Lex-Item Flags:

  • SEMANTIC_TAG - Identifies all lexical items that are semantic tags.PROCESSED - Placed on all tokens composing the semantic tag.

Vertex Flags:

Info

No vertices are created in this stage

...

  • Parameter
    summaryIdentifies the entity by unique ID. This identifier must be unique across all entries (across all dictionaries).
    nameid
    requiredtrue
    • Typically, this identifier has meaning to the larger application that is using the Language Processing ToolkitSaga.
  • Parameter
    summaryThe list of semantic tags to add to the interpretation graph whenever any of the patterns are matched.
    nametags
    typestring array
    requiredtrue
    • These will all be added to the interpretation graph with the SEMANTIC_TAG flag.
  • Parameter
    summaryA list of patterns to match in the content.
    namepatterns
    typestring array
    requiredtrue
  • Parameter
    summaryIndicates whether or not the partialmatch partial match will create a regex tag even if a full match was not met.
    defaultfalse
    namesplitMatch
    typeboolean
  • Parameter
    summarySpecifies the confidence level of the entity, independent of any patterns matched.
    nameconfidence
    typedouble

    • This is the confidence of the entry, in comparison to all of the other entries. Essentially, the likelihood that this entry will be randomly encountered.

...