Monitoring Anything and Everything with Beats at eBay

One year ago, Vijay Samuel and the monitoring team at eBay embarked on a journey to collect logs and metrics from any application deployed in Kubernetes. And thus Collectbeat was born. It's the little Beat that could:

  • Collect metrics from any Pod that exposes metrics that abide to all supported Metricbeat modules
  • Collect logs written to stdout or files inside the Docker container
  • Append Pod metadata on every log and metric collected
  • Allow Pods to push metrics through Graphite protocol and parse them uniquely
  • Stitch stack traces for application logs

Hear about the team's journey, current path, and vision for the future. Plus, get a glimpse at how eBay is planning to tackle even more complex problems like providing QoS to important data and applying sampling and throttling — all using Beats. They're on a mission to put Beats on every host inside of eBay and collect logs and metrics from any application being deployed (inside and outside of Kubernetes).

Vijay Samuel