You are looking at preliminary documentation for a future release. Not what you want? See the current release documentation.
unique token filter can be used to only index unique tokens during
analysis. By default it is applied on all the token stream. If
only_on_same_position is set to
true, it will only remove duplicate
tokens on the same position.