You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

Identifies tokens which look like emails and flags them with the "EMAIL" flag.

Operates On:  Lexical Items with TOKEN

Stage is a Recognizer for Saga Solution, and can also be used as part of a manual pipeline or a base pipeline

Currently handles the following situations:

  • Local part could contain letters, digits and symbols except square/angle brackets, exclamation/question mark and quotes

  • Local part cannot start or finish with period (.). Also it cannot have repeated periods in the middle

  • Quotes are permitted if entire local part is quoted. When quoted, any symbol is permitted except for exclamation and question marks

  • Domain part could contain only letters, digits and the symbol dot (.) and/or dash (-)

  • Symbols dot (.) and dash (-) cannot be placed at the beginning or the end. Also they cannot be repeated in the middle

  • Domain could also be an IP v4 number


Generic Configuration Parameters

  • boundaryFlags ( type=string array | optional ) - List of vertex flags that indicate the beginning and end of a text block.
    Tokens to process must be inside two vertices marked with this flag (e.g ["TEXT_BLOCK_SPLIT"])
  • skipFlags ( type=string array | optional ) - Flags to be skipped by this stage.
    Tokens marked with this flag will be ignored by this stage, and no processing will be performed.
  • requiredFlags ( type=string array | optional ) - Lex items flags required by every token to be processed.
    Tokens need to have all of the specified flags in order to be processed.
  • atLeastOneFlag ( type=string array | optional ) - Lex items flags needed by every token to be processed.
    Tokens will need at least one of the flags specified in this array.
  • confidenceAdjustment ( type=double | default=1 | required ) - Adjustment factor to apply to the confidence value of 0.0 to 2.0 from (Applies for every pattern match).
    • 0.0 to < 1.0  decreases confidence value
    • 1.0 confidence value remains the same
    • > 1.0 to  2.0 increases confidence value
  • debug ( type=boolean | default=false | optional ) - Enable all debug log functionality for the stage, if any.
  • enable ( type=boolean | default=true | optional ) - Indicates if the current stage should be consider for the Pipeline Manager
    • Only applies for automatic pipeline building


Flags

Lex-Item Flags:

  • EMAIL- Identifies the token as an email.
  • SEMANTIC_TAG - Identifies all lexical items which are semantic tags.

Example

V--------------[please send an email to [email protected] thank you ]---------------V 
^-[please]-V-[send]-V-[an]-V-[email]-V-[to]-V-[[email protected]]-V-[thank]-V-[you]-^ 
                                            ^-----------[{email}]------------^
  • No labels