Excerpt |
---|
This stage works in a similar way to the Dictionary Tagger stage in the sense that looks up sequences of tokens in a dictionary to match the text being processed. The difference is that it will also include in the matching text N tokens to the right and/or left of the original matched text. |
Operates On: Lexical Items with TOKEN and possibly other flags as specified below.
Saga_is_recognizer
Include Page | ||||
---|---|---|---|---|
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
|
Saga_config_stage | ||||
---|---|---|---|---|
| ||||
"type": "TokenMatcherRecognizer", "dictionary": "dict-provider:token_matcher_patterns", "groupTokens": truefalse, "leftGroupTagName": "_leftTokens_", "matchGroupTagName": "_matchedTokens_", "rightGroupTagName": "_rightTokens_", "boundaryFlags": ["TEXT_BLOCK_SPLIT"], "requiredFlags": ["TOKEN", "SEMANTIC_TAG"], "skipFlags": : ["SKIP"], "atLeastOneFlag": [], "confidenceAdjustment": 1, "debug": false, "enable": true |
Saga_graph |
---|
V-----------------[call 333-4444 for pizza]------------------V ^------[call]------V-----[333-4444]------V-[for]-V--[pizza]--^ ^-[{_leftTokens_}]-^---[{phonenumber}]---^-[{_rightTokens_}]-^ ^-[{_matchedTokens_}]-^ ^----------------------[{pizza_phone}]-----------------------^ |
Info |
---|
No vertices are created in this stage |
Description of resourceToken matcher must have a dictionary of patterns which is a list of JSON records.
Saga_json | ||
---|---|---|
| ||
"_id" : "Nlp3kXYBOOvNPbzJXDcQ", "tag": "qVRZi3YBvyJs83wnkfik", "pattern": "{phonenumber}", "confAdjust": 0.95, "options" : { "maxTokensLeft": 1, "maxTokensRight": 1 } |
Note |
---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
| ||||||
Parameter | ||||||
|
These will all be added to the interpretation graph with the SEMANTIC_TAG flag.
Tip |
---|
Tags are hierarchical representations of the same intent. For example, {city} → {administrative-area} → {geographical-area} |
Parameter | ||||||
---|---|---|---|---|---|---|
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Include Page | ||||
---|---|---|---|---|
|