You are looking at preliminary documentation for a future release.
Not what you want? See the
current release documentation.
Standard Token Filteredit
[6.5.0] Deprecated in 6.5.0. This filter is deprecated and will be removed in the next major version.
A token filter of type standard that normalizes tokens extracted with
the Standard Tokenizer.
The standard token filter currently does nothing. It remains as a placeholder
in case some filtering function needs to be added in a future version.