...
Library: saga-lang-detector-stage
Saga_is_recognizer Recognizer false
Tip |
---|
It can detect 103 languages outputting ISO 639-3 language codes. (https://opennlp.apache.org/news/model-langdetect-183.html) |
...
Parameter | ||||||
---|---|---|---|---|---|---|
|
Code Block | ||
---|---|---|
| ||
"atLeastOneFlag": []
"boundaryFlags": ["SENTENCE_SPLIT", "TEXT_BLOCK_SPLIT"]
"confidenceAdjustment": 1
"debug": false
"langModel": "langdetect-183.bin"
"dontProcessFlags": []
"requiredFlags": []
"skipFlags": [] | ||
As you can see, the first sentence is tagged with "LANG_ENG" and the second sentence with "LANG_SPA".
In this case, a sentence breaker stage was configured before the language detector stage. As a result, language identification can occur at the sentence level.
...