Excerpt |
---|
Creates a bag of words / tfidf tag with the vector information for the document/text_block/sentence. Accumulates the vector until the engine cannot read any further |
Operates On: Lexical Items with TOKEN and possibly other flags as specified below all lexical Items.
Saga_is_recognizer Recognizer false
Warning |
---|
This stage is disabled since version 1.2.2 |
Include Page | ||||
---|---|---|---|---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
|
Parameter | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
|
Code Block | ||
---|---|---|
| ||
"vocabulary": "saga-provider:saga_vocabulary", "vectorType": "BOW", "datasetId": "dataset-234ifgbqafgoail3", "min": 1, "max": 3, |
In this example the stage load a predefined vocabulary to generate a vector for the sentence using BOW, the same is done but using TF_IDF
Code Block | ||
---|---|---|
| ||
V---------------------------[The pilot landed safely the aircraft after gear failed when approaching the runaway.]----------------------------V ^-[The]-V-[pilot]-V-[landed]-V-[safely]-V-[the]-V-[aircraft]-V-[after]-V-[gear]-V-[failed]-V-[when]-V-[approaching]-V-[the]-V---[runaway.]----^ ^-[the]-^ ^---[landed safely]---^---[the aircraft]---^---[after gear]---^---[failed when]---^---[approaching the]---^-[runaway]-V-[.]-^ ^---[pilot landed]---^---[safely the]---^---[aircraft after]---^---[gear failed]---^---[when approaching]---^ ^---[runaway .]---^ ^---[The pilot]---^ ^-----[the runaway.]------^ ^---[the pilot]---^ ^---[the runaway]---^ ^-------------------------------------------------------------------[{BOW}]-------------------------------------------------------------------^ V---------------------------[The pilot landed safely the aircraft after gear failed when approaching the runaway.]----------------------------V ^-[The]-V-[pilot]-V-[landed]-V-[safely]-V-[the]-V-[aircraft]-V-[after]-V-[gear]-V-[failed]-V-[when]-V-[approaching]-V-[the]-V---[runaway.]----^ ^-[the]-^ ^---[landed safely]---^---[the aircraft]---^---[after gear]---^---[failed when]---^---[approaching the]---^-[runaway]-V-[.]-^ ^---[pilot landed]---^---[safely the]---^---[aircraft after]---^---[gear failed]---^---[when approaching]---^ ^---[runaway .]---^ ^---[The pilot]---^ ^-----[the runaway.]------^ ^---[the pilot]---^ ^---[the runaway]---^ ^-----------------------------------------------------------------[{TF_IDF}]------------------------------------------------------------------^ |
Info |
---|
No vertices are created in this stage |
Description of resource.
Saga_jsoncode | ||||
---|---|---|---|---|
| ||||
"count" : 15,
"docsPerTerm" : 15,
"datasetId" : "f92e1394-5f52-3331-aa6a-9c510ad31da5",
"tokenCount" : 1,
"docCount" : 204021,
"word" : "depict",
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||||
---|---|---|---|---|---|---|---|---|
|
Parameter | ||||||
---|---|---|---|---|---|---|
|