You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 7
Next »
Generic Configuration Parameters
-
boundaryFlags ( type=string array
| optional
)
- List of vertex flags that indicate the beginning and end of a text block.
Tokens to process must be inside two vertices marked with this flag (e.g ["TEXT_BLOCK_SPLIT"]) -
skipFlags ( type=string array
| optional
)
- Flags to be skipped by this stage.
Tokens marked with this flag will be ignored by this stage, and no processing will be performed. -
requiredFlags ( type=string array
| optional
)
- Lex items flags required by every token to be processed.
Tokens need to have all of the specified flags in order to be processed. -
atLeastOneFlag ( type=string array
| optional
)
- Lex items flags needed by every token to be processed.
Tokens will need at least one of the flags specified in this array. -
confidenceAdjustment ( type=double
| default=1
| required
)
- Adjustment factor to apply to the confidence value of 0.0 to 2.0 from (Applies for every pattern match).
- 0.0 to < 1.0 decreases confidence value
- 1.0 confidence value remains the same
- > 1.0 to 2.0 increases confidence value
-
debug ( type=boolean
| default=false
| optional
)
- Enable all debug log functionality for the stage, if any.
-
enable ( type=boolean
| default=true
| optional
)
- Indicates if the current stage should be consider for the Pipeline Manager
- Only applies for automatic pipeline building
Configuration Parameters
-
patterns ( type=string array
| required
)
- The resource which contains the pattern database
$action.getHelper().renderConfluenceMacro("$codeS$body$codeE")
Example Output
The following shows sample output from the advanced pattern matcher, which has multiple patterns for the {product} and {person-product-preference} semantic tags.
V--------------------[Abe Lincoln likes the iPhone-7]--------------------V
^---[Abe]----V--[Lincoln]--V--[likes]--V--[the]--V------[iPhone-7]-------^
^---[iPhone]----V--[7]--^
^---[abe]----^--[lincoln]--^ ^---[iphone]----^
^--[{name}]--^--[{place}]--^ ^-----------[{product}]-----------^
^-------[{product}]-------^
^---------[{name}]---------^ ^--[{product}]--^
^--------[{place}]---------^ ^------[iphone-7]-------^
^------[{product}]------^
^-----------------[{person-product-preference}]------------------^
^---------------------[{person-product-preference}]----------------------^
Output Flags
Lexical Item Flags
- SEMANTIC_TAG - Identifies all lexical items which are semantic tags.
- PROCESSED - Placed on all tokens that compose the semantic tag.
Vertex Flags
Resource Data
The resource data is a database of advanced patterns and the resulting semantic tags that they produce.
Resource Format
The pattern database is a series of JSON records, typically indexed by "pattern block ID". Each JSON record represents a block of patterns (one or more) that all produce the same semantic tag. The format is as follows:
$action.getHelper().renderConfluenceMacro("$codeS$body$codeE")
Fields
-
id ( type=string
| required
)
- Identifies the entry. This identifier may not be unique, and is not the id of the database, but an specific use case id
Typically, this is an identifier with meaning to the larger application that is using the Language Processing Toolkit.
-
display ( type=string
| required
)
- What to show the user when browsing this entity
-
tag ( type=string
| required
)
- Tag which will identify any match in the graph, as an interpretation
These will all be added to the interpretation graph with the SEMANTIC_TAG flag.