On-demand webinar

Lyft's Wild Ride from Amazon ES to Self-Managed Elasticsearch

Video thumbnail

Hosted by

Michael Goldsby


From October 2016 to May 2017, Lyft was Amazon's biggest hosted Elasticsearch customer and most frequent support headache. After quickly scaling to the maximum supported size — and then beyond — Lyft found themselves keeping one big support ticket open to address daily (and sometimes hourly) incidents. It was clearly time for a change. After two intense weeks of migration, Lyft became self-hosted, and both companies breathed a sigh of relief.

How did Lyft get there from here? What are the pros and cons of cloud versus self-hosted Elasticsearch deployments? And what has Lyft learned from almost a year of operating their own cluster? Michael Goldsby of Lyft's observability team talks you through the joys and sorrows of scaling a logging cluster from 300,000 to 3 million events per minute.

Want to learn more about the differences between the Amazon Elasticsearch Service and our official Elasticsearch Service? Visit our AWS Elasticsearch comparison page.