Excerpt | ||||
---|---|---|---|---|
This stage flags vertices with “Skip-Sentence”. The vertex flag is the start of the sentence. This can be used to ignore a complete sentence by a later stage.
The conditions evaluated by the processor are:
Deny listing a tag always has precedence over the other values, so any sentence with a blacklisteddeny listed flag will always be flagged as “SKIP_SENTENCE”. WhitelistedAllow listed tags will always have precedence over the token limit restriction. And finally token limit restriction is on effect.
|
Include Page | ||||
---|---|---|---|---|
|