Versions Compared

Old Version 12

changes.mady.by.user Ronny Ortega Ugalde

Saved on

compared with

New Version Current

changes.mady.by.user Steven Peraza

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Parameter
    summarypath to the OpenNLP language model
    defaultlangdetect-183.bin
    namelangModel

...

requiredFlagstext_block
Code Block
languagejs
"atLeastOneFlag": []
"boundaryFlags": ["SENTENCE_SPLIT", "TEXT_BLOCK_SPLIT"]
"confidenceAdjustment": 1
"debug": false
"langModel": "langdetect-183.bin"
"dontProcessFlags": []
"requiredFlags": []
"skipFlags": []


Example Output

As you can see, the first sentence is tagged with "LANG_ENG" and the second sentence with "LANG_SPA".

In this case, a sentence breaker stage was configured before the language detector stage. As a result, language identification can occur at the sentence level.


Image RemovedImage Added

Output Flags

Lex-Item Flags

...