IMPORTANT: No additional bug fixes or documentation updates
will be released for this version. For the latest information, see the
current release documentation.
Standard Token Filteredit
A token filter of type standard
that normalizes tokens extracted with
the
Standard
Tokenizer.
The standard
token filter currently does nothing. It remains as a placeholder
in case some filtering function needs to be added in a future version.