NOTE: You are looking at documentation for an older release. For the latest information, see the current release documentation.
Unique Token Filteredit
The unique
token filter can be used to only index unique tokens during
analysis. By default it is applied on all the token stream. If
only_on_same_position
is set to true
, it will only remove duplicate
tokens on the same position.