VM configurations on AWS
For the AWS infrastructure upgrade, we use the default instance type configurations provided by AWS which are unique to them. (VM configurations used in FedRAMP Moderate Authorized are found here.)
To make it easy to identify each instance type in AWS, a new common nomenclature is introduced.
For example, Instance ID / SKU: aws.es.datahot.i8g
aws.* |
Denotes the cloud provider, AWS in this case with Azure in future cases. |
\*.es.datahot.* |
Denotes that this configuration is an Elasticsearch (es) cluster component that serves as a data node for hot content. Other options may be datawarm, datacold, datafrozen for data nodes, and kibana, master, and so on for other components. |
*.i8g |
Denotes that this configuration is running on the AWS i8g instance family. |
The following table details the configurations for data nodes and compares them with prior naming conventions where applicable.
| New config name | Notes |
|---|---|
| aws.es.datahot.i8g | This is a new configuration that is similar to the previous “aws.es.datahot.i3” config but with slightly more RAM and similar disk and RAM:CPU ratios. It is powered by AWS Graviton4 processors which offers a better price-performance over previous generation instances. |
| aws.es.datahot.i3en | This configuration is similar to the “aws.data.datahot.i8g” config, but with more disk space to allow for longer retention in ingest use cases, or larger catalog in search use cases. |
| aws.es.datahot.m5d | This configuration maintains the same type of VM configuration as used in the previous config (“aws.data.highcpu.m5d”). |
| aws.es.datahot.m6gd | This configuration is similar to the “aws.es.datahot.m5d” config but with more disk space and similar RAM:CPU ratios. It is powered by AWS Graviton2 which offers a better price-performance over comparable Intel chipsets. |
| aws.es.datahot.c5d | This configuration provides double the CPU capacity compared to “aws.es.datahot.m5d” config. It is intended for high throughput ingest use cases or intensive search use cases. |
| aws.es.datahot.c8gd | This is a new configuration that is similar to the previous “aws.es.datahot.c6gd” config. It is powered by AWS Graviton4 processors which offers a better price-performance over previous generation instances. |
| aws.es.datahot.r6gd | This configuration is powered by AWS Graviton2 processors. |
| aws.es.datawarm.i3en, aws.es.datacold.i3en, aws.es.datafrozen.i3en | These configurations maintain the same type of VM configuration as used in the config (“aws.es.datahot.i3en”). |
For a detailed price list, check the Elastic Cloud price list. For a detailed specification of the new configurations, check Elasticsearch Service default provider instance configurations.
The benefits of the new configurations are multifold:
- i8g instances powered by Graviton4 processors provides upto 40% better price-performance compared to previous generation instances.
- c8gd instances powered by Graviton4 processors provides upto 15% better price-performance compared to previous generation instances.
In addition to data nodes for storage and search, Elasticsearch nodes also include machine learning nodes, master nodes, and coordinating nodes. These auxiliary node types along with application nodes such as APM servers and Kibana have also been upgraded to the latest instances. Both auxiliary node and application node configurations are based on Elasticsearch data node configuration types shown in the previous table.
| New config name | Notes |
|---|---|
| aws.es.master.c5d | This configuration is similar to the “aws.es.datahot.c5d” config. |
| aws.es.master.c8gd | This is a new configuration that is similar to the “aws.es.datahot.c8gd”. |
| aws.es.ml.c5d | This configuration is similar to the “aws.es.datahot.c5d” config. |
| aws.es.coordinating.m5d | This configuration is similar to the “aws.es.datahot.m5d” config. |
| aws.es.coordinating.m6gd | This configuration is similar to the “aws.es.datahot.m6gd” config. |
| aws.kibana.c5d | This configuration is similar to the “aws.es.datahot.c5d” config. |
| aws.kibana.c8gd | This is a new configuration that is similar to the “aws.es.datahot.c8gd” config. |
| aws.apm.c5d or aws.integrationsserver.c5d | This configuration is similar to the “aws.es.datahot.c5d” config. |
| aws.apm.c8gd or aws.integrationsserver.c8gd | This is a new configuration that is similar to the “aws.es.datahot.c8gd” config. |