Disclaimer: The previously published article has now been modified to reflect the name change from DockerBeat to Dockbeat.Did you ever&nbsp;want&nbsp;to know how your Docker containers behave over time? Did you ever want&nbsp;to have a&nbsp;Beat capable of reading Docker containers statistics and indexing them into Elasticsearch? Today, the solution is at your fingertips: <a href="https://github.com/Ingensi/dockbeat" target="_blank">Dockbeat</a>!&nbsp; Dockbeat is an open source project created by <a href="http://www.ingensi.com/" target="_blank">Ingensi</a>, based on the Beats platform. Ingensi is a business unit of <a href="http://www.cyres.fr/" target="_blank">Cyres Group</a> located in France. Our main goal is to create big data solutions offering powerful decision-making tools to unveil the value in the customer&nbsp;data. For that, we employ our technological expertise in Hadoop, Elasticsearch, and Docker.At Ingensi, we use the Elastic Stack as the basis of our log management solution. We also use Elasticsearch as a search engine in our application as we need fast responding searches.<h2>Docker Big Data platform: Ingensi meets Docker</h2>For resource optimization reasons, when we receive a cluster deployment request from our customers, we deploy it in a shared big data infrastructure based on <a href="https://www.docker.com/" target="_blank">Docker</a>. In 2015, we had our first shared big data infrastructure deployed and we naturally used the Elastic Stack to monitor the entire platform: hosts, network, users, etc. However, our processing workflow did not allow us to monitor Docker containers.That’s when Beats comes into play! The Beats platform allows you to build lightweight data shippers for different types of data that you can search and analyze in Elasticsearch, and visualize in Kibana. From there, we had the idea to create our own beat to collect Docker statistics.<h2>Hello, Dockbeat!</h2>Since the release of Docker 1.5., a new functionality was added to Docker's API: Docker stats. This endpoint returns a live stream of a running container's resource usage statistics, such as CPU, memory, network, disk IO, etc.Therefore, we've decided to collect all these metrics in order to capitalize on the use of our existing Docker infrastructure. Based on the Beats platform, we started to develop our own Beat: Dockbeat.<h3>How does Dockbeat work?</h3>Dockbeat is used for Docker monitoring. It is responsible for collecting the containers' statistics and send them to Logstash or directly to Elasticsearch. As it is very lightweight, Dockbeat’s impct on the server is very low. The collected&nbsp;data can then be visualized in&nbsp;a&nbsp;Kibana&nbsp;dashboard. Today, we are able to view in real time all the containers running on our servers, their consumption, and thus, quickly identify any anomalies. This new beat exports five types of documents corresponding to the different metric sets collected :<ul><li>Container: container’s attributes</li><li>CPU: container's CPU usage statistics</li><li>Net: container's network statistics</li><li>Memory: container's memory statistics</li><li>Blkio: container’s IO access statistics</li></ul><img src="https://api.contentstack.io/v2/assets/57d80bfa748780742c8284c1/download?uid=blt8492c33e9b8ce1ed" data-sys-asset-uid="blt8492c33e9b8ce1ed" alt="dockbeat-workflow.png"/>Figure 1 - Dockbeat Workflow<h3>Great! How can I use Dockbeat?</h3>Simple:&nbsp;Dockbeat is hosted on <a href="https://github.com/Ingensi/dockbeat" target="_blank">GitHub</a>. You first need to clone and build the project (see&nbsp;<a href="https://github.com/Ingensi/dockbeat/blob/develop/README.md" target="_blank">README</a>)&nbsp;or simply&nbsp;<a href="https://github.com/Ingensi/dockbeat/releases" target="_blank">download the latest release version</a> you need.In a basic Docker installation, Dockbeat should work out of the box with its default configuration. If you have your own settings, check the configuration file dockbeat.yml. In this file you can configure:&nbsp;<ul><li>The Docker socket path</li><li>The output that receives the collected data by the beat. Multiple outputs may be used: Elasticsearch, Logstash, Kafka as well as files</li><li>The rate at which Docker stats are sent to the defined output (basically Elasticsearch)</li><li>Whether the Dockbeat has to deal with TLS docker daemon. If so, then you need to enable TLS and configure path for key and certificates.</li></ul>There is no specific configuration&nbsp;to be edited, unless you need to enable the TLS docker daemon.<ul></ul>Finally, you can launch your beat by running the following command :<pre class="“prettyprint”">./dockbeat -c etc/dockbeat.yml </pre><img src="https://api.contentstack.io/v2/assets/57cd20837904d03327be9fd3/download?uid=blt8ad883249bd273bb" data-sys-asset-uid="blt8ad883249bd273bb" alt="dockerbeat-kibana-dashboard.png"/>Figure 2 - Dockbeat Kibana Dashboard<h3>Dockbeat today</h3>Dockbeat grew up and became operational. Today, we are happy to announce the <a href="https://github.com/Ingensi/dockerbeat/releases/tag/v1.0.0" target="_blank">release version 1.0.0</a> It's an open source project and we love to receive contributions from the community. You can contribute to&nbsp;Dockbeat in many ways:&nbsp;<ul><li>Write documentation, tutorials, blog posts&nbsp;</li><li>Submit bug reports or ideas for new features via GitHub&nbsp;</li><li>Implement new features, etc.&nbsp;</li></ul>So, feel free to contact us for further information or contributions, we will be happy to hear from you.<h2>The Team</h2>Erwann Cloarec is a Big Data Engineer <a href="https://twitter.com/ingensi" target="_blank">@Ingensi</a>, Docker passionate, Elastic fan and Hadoop professional, Dockbeat co-creator. <a href="https://twitter.com/erwannc" target="_blank">@ErwannC</a> <a href="https://github.com/erwanncloarec" target="_blank">Github</a> <a href="https://fr.linkedin.com/in/erwann-cloarec-354566a1" target="_blank">LinkedIn</a>Thibaut Marmin is a Software Engineer <a href="https://twitter.com/ingensi" target="_blank">@Ingensi</a>. Interested in Big Data and OpenSource technologies, Docker &amp; Elastic enthusiast, Dockbeat co-creator. <a href="https://twitter.com/thibmarmin" target="_blank">@thibmarmin</a> <a href="https://github.com/marminthibaut" target="_blank">Github</a> <a href="https://www.linkedin.com/in/marminthibaut" target="_blank">LinkedIn</a>Douae Jeouit is an Engineering Student in final year. Curious and ambitious, she&nbsp;loves to discover new intelligent technologies. Elastic fan. She's the blog post author&nbsp;and a&nbsp;Dockbeat contributor. <a href="https://github.com/douaejeouit" target="_blank">Github</a> <a href="https://www.linkedin.com/in/douaejeouit" target="_blank">LinkedIn</a>

container-loading-2000x415.jpg

container-loading-720x420.jpg

Dockbeat: A new addition to the Beats Community

Start free trial

Blog Footer CTA

Sign up for Elastic Cloud free trial

Erwann Cloarec

By submitting you acknowledge that you've read and agree to our <a href="/legal/elastic-cloud-account-terms" target="_self">Terms of Service</a>, and you agree to receive the <a href="/legal/privacy-statement#how-we-use-the-information" target="_self">selected communications</a> at the contact details you provided above. See <a href="/legal/privacy-statement/" target="_self">Elastic’s Privacy Statement</a> for more details or to opt-out at any time.

Communication Preferences - ONLY for /communication-preferences

提交即表示您确认您已阅读并同意我们的<a href="/cn/legal/elastic-cloud-account-terms" target="_self">服务条款</a>，并且您同意通过您提供的上述联系方式接收<a href="/cn/legal/privacy-statement#how-we-use-the-information" target="_self">所选的通信</a>。如需了解更多信息，或想随时取消订阅，请参阅 <a href="/cn/legal/privacy-statement/" target="_self">Elastic 的隐私声明</a>。

By submitting you acknowledge that you've read and agree to our <a href="/legal/serverless-preview-terms" target="_blank">Terms of Service</a>, and that Elastic may <a href="/legal/privacy-statement#how-we-use-the-information" target="_blank">contact you</a> about our related products and services, using the details you provide above. See <a href="/legal/privacy-statement/" target="_blank">Elastic’s Privacy Statement</a> for more details or to opt-out at any time.

Serverless GDPR Text

提交即表示您确认您已阅读并同意我们的<a href="/cn/legal/serverless-preview-terms" target="_self">服务条款</a>，并且 Elastic 可以使用您提供的上述详细信息与您联系，以向您介绍我们相关的<a href="/cn/legal/privacy-statement#how-we-use-the-information" target="_self">产品和服务</a>。如需了解更多信息，或想随时取消订阅，请参阅 <a href="/cn/legal/privacy-statement/" target="_self">Elastic 的隐私声明</a>。

By submitting you agree to <a href="/agreements/global/cloud-services-monthly" rel="nofollow">Elastic Cloud Terms of Service</a>. Your personal data will be processed in accordance with <a href="/legal/privacy-statement">Elastic's Privacy Statement</a>.

Cloud Trial GDPR Text

提交即表示您同意 <a href="/cn/agreements/global/cloud-services-monthly" rel="nofollow">Elastic Cloud 服务条款</a>。我们将会按照 <a href="/cn/legal/privacy-statement">Elastic 的隐私声明</a>处理您的个人数据。

By submitting you acknowledge that you've read and agree to our <a href="/legal/terms-of-use" target="_blank">Terms of Service</a>, and that Elastic may <a href="/legal/privacy-statement#how-we-use-the-information" target="_blank">contact you</a> about our related products and services, using the details you provide above. See <a href="/legal/privacy-statement/" target="_blank">Elastic’s Privacy Statement</a> for more details or to opt-out at any time.

Newsletter GDPR Text

提交即表示您确认您已阅读并同意我们的<a href="/cn/legal/terms-of-use" target="_self">服务条款</a>，并且 Elastic 可以使用您提供的上述详细信息与您联系，以向您介绍我们相关的<a href="/cn/legal/privacy-statement#how-we-use-the-information" target="_self">产品和服务</a>。如需了解更多信息，或想随时取消订阅，请参阅 <a href="/cn/legal/privacy-statement/" target="_self">Elastic 的隐私声明</a>。

Explore similar demos

Overview

Speakers

Close

See more insights

The content on this page is not available in the selected language. As Elastic grows globally, we continue to support content in multiple languages.

The content on this page is not available in the selected language.

本页内容尚不支持所选语言。Elastic 正在不断努力，以实现对多种语言内容的支持。感谢您在此期间给予的耐心与陪伴！

Author

Articles by

Learn more

Watch now (no PT)

Watch now

See all top stories

All (no PT translation)

Contact information

Press Release

Share on Reddit

Share this story

Share by Email

Thank you for your interest!

Contact Info

Follow us on Youtube

Load More

Share on LinkedIn

Follow us on LinkedIn

Search Integrations

All Solutions

Video for

Follow us on Twitter

See when this webinar starts in my time zone

查看本次网络研讨会在我的时区的开始时间

Register to Watch

Register now

See All Posts

Can't make it? Register and we'll send you the recording. You'll also receive an email with related content

无法实时参加？注册后我们会给您发送录像。您还将收到相关内容的电子邮件。

Author

Articles by Erwann Cloarec

Dockbeat: A new addition to the Beats Community

Sign up for Elastic Cloud free trial