Whitespace analyzer
edit
IMPORTANT: This documentation is no longer updated. Refer to Elastic's version policy and the latest documentation.
Whitespace analyzer
editThe whitespace analyzer breaks text into terms whenever it encounters a
whitespace character.
Example output
editresp = client.indices.analyze(
analyzer="whitespace",
text="The 2 QUICK Brown-Foxes jumped over the lazy dog's bone.",
)
print(resp)
response = client.indices.analyze(
body: {
analyzer: 'whitespace',
text: "The 2 QUICK Brown-Foxes jumped over the lazy dog's bone."
}
)
puts response
const response = await client.indices.analyze({
analyzer: "whitespace",
text: "The 2 QUICK Brown-Foxes jumped over the lazy dog's bone.",
});
console.log(response);
POST _analyze
{
"analyzer": "whitespace",
"text": "The 2 QUICK Brown-Foxes jumped over the lazy dog's bone."
}
The above sentence would produce the following terms:
[ The, 2, QUICK, Brown-Foxes, jumped, over, the, lazy, dog's, bone. ]
Configuration
editThe whitespace analyzer is not configurable.
Definition
editIt consists of:
- Tokenizer
If you need to customize the whitespace analyzer then you need to
recreate it as a custom analyzer and modify it, usually by adding
token filters. This would recreate the built-in whitespace analyzer
and you can use it as a starting point for further customization:
resp = client.indices.create(
index="whitespace_example",
settings={
"analysis": {
"analyzer": {
"rebuilt_whitespace": {
"tokenizer": "whitespace",
"filter": []
}
}
}
},
)
print(resp)
response = client.indices.create(
index: 'whitespace_example',
body: {
settings: {
analysis: {
analyzer: {
rebuilt_whitespace: {
tokenizer: 'whitespace',
filter: []
}
}
}
}
}
)
puts response
const response = await client.indices.create({
index: "whitespace_example",
settings: {
analysis: {
analyzer: {
rebuilt_whitespace: {
tokenizer: "whitespace",
filter: [],
},
},
},
},
});
console.log(response);