Excerpt | ||
---|---|---|
Splits tokens on specified characters, typically punctuation. Multiple split characters in a row will create a single split (not multiple splits) when using the "Split as Vertex" setting.
|
Tokenize Tokens
Split as Vertex
Split Characters In Between (Before/After) - split occurs when split characters are located in the middle of a token text.
Split CharactersAs Prefix/Suffix - Split occurs if the split characters are located at the beginning (prefix) or the end (suffix) of the token text.
Include Page | ||||
---|---|---|---|---|
|