Versions Compared

Old Version 18

changes.mady.by.user Mauricio Rizo

Saved on

compared with

New Version 19

changes.mady.by.user Mauricio Rizo

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • LEX_ITEM - Identifies then token text as lexical item.
  • NUMBER - Flagged on all tokens which are numbers according to the rules above.
  • SEMANTIC_TAG - Identifies all lexical items which are semantic tags.

...

Code Block
languagetext
themeFadeToGrey
V----------[1984 42 -10 3.14 ]-----------V  
^--[1984]--V--[42]--V--[-10]--V--[3.14]--^  
^----[#]---V---[#]--V---[#]---V----[#]---^  

Item [1984] - [NUMBERORIGINAL,HAS_DIGIT,TOKEN]
Item [42]   - [NUMBERORIGINAL,HAS_DIGIT,TOKEN]
Item [-10]  - [NUMBERORIGINAL,HAS_DIGIT,HAS_PUNCTUATION,TOKEN]
Item [3.14] - [NUMBERORIGINAL,HAS_DIGIT,HAS_PUNCTUATION,TOKEN]