You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 3
Next »
V---------------[this is COSTA RICA !!! and Costa Verda]---------------V
^-[this]-V-[is]-V-[COSTA]-V-[RICA]-V-[!!!]-V-[and]-V-[Costa]-V-[Verda]-^
^-[costa]-^-[rica]-^ ^-[costa]-^-[verda]-^
^--[{_geoname_}]---^ ^---[{_geoname_}]---^
Identifies geo locations, based on the patterns loaded.
Operates On: Lexical Items with TOKEN and possibly other flags as specified below.
Generic Configuration Parameters
-
boundaryFlags ( type=string array
| optional
)
- List of vertex flags that indicate the beginning and end of a text block.
Tokens to process must be inside two vertices marked with this flag (e.g ["TEXT_BLOCK_SPLIT"]) -
skipFlags ( type=string array
| optional
)
- Flags to be skipped by this stage.
Tokens marked with this flag will be ignored by this stage, and no processing will be performed. -
requiredFlags ( type=string array
| optional
)
- Lex items flags required by every token to be processed.
Tokens need to have all of the specified flags in order to be processed. -
atLeastOneFlag ( type=string array
| optional
)
- Lex items flags needed by every token to be processed.
Tokens will need at least one of the flags specified in this array. -
confidenceAdjustment ( type=double
| default=1
| required
)
- Adjustment factor to apply to the confidence value of 0.0 to 2.0 from (Applies for every pattern match).
- 0.0 to < 1.0 decreases confidence value
- 1.0 confidence value remains the same
- > 1.0 to 2.0 increases confidence value
-
debug ( type=boolean
| default=false
| optional
)
- Enable all debug log functionality for the stage, if any.
-
enable ( type=boolean
| default=true
| optional
)
- Indicates if the current stage should be consider for the Pipeline Manager
- Only applies for automatic pipeline building
Configuration Parameters
-
parameter ( type=string
| default=cheese
| optional
)
- description
$action.getHelper().renderConfluenceMacro("$codeS$body$codeE")
Example Output
$action.getHelper().renderConfluenceMacro("$codeS$body$codeE")
Output Flags
Lex-Item Flags:
- SEMANTIC_TAG - Identifies all lexical items that are semantic tags.
- GEONAME- Identifies a geographical location name.
Vertex Flags:
Resource Data
The only file that is absolutely required is the geonames dictionary. It is a series of JSON records, typically indexed by entity ID.
Each JSON record represents an entity. The format is as follows:
$action.getHelper().renderConfluenceMacro("$codeS$body$codeE")
Fields
-
id ( type=string
| required
)
- An ID normally refering the ID of a database, a document, an API key, not necessary unique
-
tag ( type=string
| required
)
- Tag which will identify any match in the graph, as an interpretation
-
patterns ( type=string array
| required
)
- A list of patterns to match in the content
-
display ( type=string
| optional
)
- What to show the user when browsing this entity
-
fields ( type=json
| optional
)
- Free space to add extra data in any format supported by JSON
_id ( type=string
| required
)
- Identifies the entity by unique ID. This identifier must be unique across all entries (across all dictionaries).
confAdjust ( type=boolean
| required
)
- Adjustment factor to apply to the confidence value of 0.0 to 2.0
- This is the confidence of the entry, in comparison to all of the other entries. (Essentially, the likelihood that this entity will be randomly encountered.)
- 0.0 to < 1.0 decreases confidence value
- 1.0 confidence value remains the same
- > 1.0 to 2.0 increases confidence value
-
updatedAt ( type=date epoch
| required
)
- Date in milliseconds of the last time the entry was updated
-
createdAt ( type=date epoch
| required
)
- Date in milliseconds of the creation time of the entry
GeoName Index
To improve performance especially for every large databases of entities, the entity dictionary is inverted and indexed.
This currently happens in RAM inside the GeoNames stage. An off-line option for pre-inverting the dictionary will be provided in the future.