Decimal digit token filteredit
Converts all digits in the Unicode Decimal_Number General Category to 0-9.
For example, the filter changes the Bengali numeral ৩ to 3.
This filter uses Lucene’s DecimalDigitFilter.
Exampleedit
The following analyze API request uses the decimal_digit
filter to convert Devanagari numerals to 0-9:
response = client.indices.analyze(
body: {
tokenizer: 'whitespace',
filter: [
'decimal_digit'
],
text: '१-one two-२ ३'
}
)
puts response
GET /_analyze
{
"tokenizer" : "whitespace",
"filter" : ["decimal_digit"],
"text" : "१-one two-२ ३"
}
The filter produces the following tokens:
[ 1-one, two-2, 3]
Add to an analyzeredit
The following create index API request uses the
decimal_digit filter to configure a new
custom analyzer.
response = client.indices.create(
index: 'decimal_digit_example',
body: {
settings: {
analysis: {
analyzer: {
whitespace_decimal_digit: {
tokenizer: 'whitespace',
filter: [
'decimal_digit'
]
}
}
}
}
}
)
puts response
PUT /decimal_digit_example
{
"settings": {
"analysis": {
"analyzer": {
"whitespace_decimal_digit": {
"tokenizer": "whitespace",
"filter": [ "decimal_digit" ]
}
}
}
}
}