Keyword Tokenizeredit

A tokenizer of type keyword that emits the entire input as a single output.

The following are settings that can be set for a keyword tokenizer type:

Setting Description

buffer_size

The term buffer size. Defaults to 256.