Elasticsearch on AWS

We've noticed that a number of you lovely humans are using Elasticsearch on AWS to do interesting and creative work. Doing so involves addressing a number of questions: Where do I start? How do I size my cluster? What types of instances should I use? What are some recommended disk configurations? As many of you know, there really isn't a one-size-fits-all solution to get up and running, and there are a number of factors to consider when configuring your ELK cluster on AWS. Given the massive interest in this area, we thought we would invite you learn from the experiences of others and see how some organizations got up and running.

The first real-world example will be from one of our own engineers, Drew Raines. At Elasticsearch, we use AWS in a few ways: for QA in advance of new releases and when we want to replicate a customer's environment and need to spin up a bunch of machines quickly. Learn from Drew how you can get an ELK cluster running on AWS in minutes and the tradeoffs to consider when configuring ELK on AWS.

Up next will be we're really excited to introduce you to Joe Kinsella, CTO and founder of CloudHealth Technologies. Joe is an Elasticsearch user and will talk about how his company uses Elasticsearch on AWS to monitor the health of cloud services and tools. Of particular interest to most of you out there, he'll talk about how they sized and configured their clusters.


  • How Elasticsearch Uses ELK on AWS - Drew Raines
  • Elasticsearch on AWS at CloudHealth Technologies - Joe Kinsella and Efe Yardimci
  • Q&A

Drew Raines

Drew is an experienced software developer and systems administrator. Since 2010, Drew has been advancing the use of Elasticsearch in all markets, from the smallest of startups to the largest of household names and global mega-corporations. He spent two years as a user, migrating a billion-document archiving platform to Elasticsearch, before joining the company shortly after its founding in 2012. Since then he has had the privilege of playing a role in building that company - in the codebase, the infrastructure, and the classroom, training hundreds of eager students on the wonder of open-source, real-time, distributed search and analytics.

Drew has also worked with Vanderbilt University, Sonian, The Home Depot, and many other clients. Over the course of his career he has administered high-performance Solaris and Linux clusters dedicated to genomic research; deployed sendmail and qmail-based mail systems, built web applications with J2EE, Ruby, Python, and JavaScript; and pioneered the adoption of Clojure in healthcare and eDiscovery at petabyte scale.

He studied Computer Engineering at Virginia Polytechnic Institute and State University.