Diving In The Deep End: Logging and Metrics at DigitalOcean

Brian Knox

Tech Lead - Metrics & Logging Team

DigitalOcean

From server health checks to network monitoring to customer activity events — logs are everywhere at DigitalOcean. In a single day, we collect more than a terabyte of real-time log data over our entire operations infrastructure. Buried in that non-stop stream of data is everything we need to know to keep DigitalOcean's cloud services up and running. This talk covers how we collect, parse, route, store, and make this data available to operations and engineers while keeping things simple enough for a small team to manage.