Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Connects directly to the Python Bridge, to send text or sections of the interpretation graph to be processed by ML algorithms in Python


Operates On:  Lexical Items with TEXT_BLOCK, EOF, others.


The Python Classification Watcher Stage is an implementation of the abstract class called Watcher Stage, this Stage is used to classify large blocks of texts as for example: complete paragraphs or whole documents. The Watcher saves the classification paths for every text block and then verifies the vertices to look for triggers which mark the end of the saving cycle and start to process the saved data, then returns a weight vector that would be the classification of the text block.


Saga_is_recognizer

Tip

The difference between this and the Python Model Recognizer Stage is that this stage requires a trigger flag to start processing the text.

Include Page
Generic Configuration Parameters
Generic Configuration Parameters

Configuration Parameters

  • Parameter
    summaryModel name registered in the python bridge
    namemodelName
    requiredtrue
  • Parameter
    summaryModel version registered in the python wrapper to query
    defaultlatest
    namemodelVersion
  • Parameter
    summaryModel method to call for the model
    namemodelMethod
    requiredtrue
  • Parameter
    summaryPython server communication hostname
    defaultlocalhost
    namehostname
  • Parameter
    summaryPython server communication port
    default5000
    nameport
  • Parameter
    summaryExpected content for this model are tokens
    defaultfalse
    namesendTokens
    typeboolean
  • Parameter
    summaryInclude text of tokens flagged as vertices
    defaultfalse
    nameincludeVertexText
    typeboolean


text block split
Saga_config_stage
boundaryFlags
Code Block
"dependencyTags": [],
"modelName": "bert-base-nli-stsb-mean-tokens",
"modelVersion": "1",
"modelMethod": "predict",
"normalizeTags": false,
"hostname": "localhost",
"port": 5000,    


Example Output

The output of the Watcher Stage is at the metadata of the vertex flagged as the trigger, for this example it is the EOF but it could be configured to work with TEXT_BLOCK_SPLIT or any other flag.

Saga_graphcode
V--------------[abraham lincoln likes macaroni and cheese]--------------------V <=== EOF, at this vertex's metadata is the embedded vector
^--[abraham]--V--[lincoln]--V--[likes]--V--[macaroni]--V--[and]--V--[cheese]--^
              ^---{place}---^           ^----{food}----^         ^---{food}---^
^----------{person}---------^           ^-----------------{food}--------------^

Output Flags

Lex-Item Flags:

  • SEMANTIC_TAG - Identifies all lexical items that are semantic tags.
  • ML_PREDICT- Result from a machine learning algorithm for prediction
  • ML_CLASSIFY- Result from a machine learning algorithm for classification
  • ML_REGRESS- Result from a machine learning algorithm for regression
  • TEXT_BLOCK - Flags all text blocks.

Vertex Flags:

  • WEIGHT_VECTOR - Identifies the text block related to this vertex as a weight vector representation