We provide a large number of conveniences on top of Elasticsearch from an operational standpoint; great stuff that lets companies focus more on code, and less on infrastructure. That is our mission, of course, to help solve infrastructure problems with Elasticsearch. One thing that we can’t do quite as well as you, however, is capacity planning. No one knows your application as well as you do. We can, however, provide ample visibility into your clusters to facilitate smarter capacity planning on your end.
The first tool to check out when planning capacity is the cluster performance metrics, which provide a quick and easy way for you to see how a cluster has been performing over the last 24 hours. There is also the Paramedic tool, accessible on the Overview page of your account. Paramedic tracks a lot, but the key metrics to look out for are disk utilization for the various shards, the amount of CPU usage, the heap (memory) usage, and finally the amount of disk space used by your app. It’s good to check in periodically and make sure that there’s enough headroom to handle spikes in traffic and projected growth.
If you’re unsure about your current capacity, remember that since it only takes a few clicks to scale your Elastic Cloud cluster up and down with zero downtime, it’s easy to experiment with different capacity levels while evaluating your cluster’s performance. Additionally, Elastic Cloud is billed by the hour, so scaling up for a short period of time is quite inexpensive.