17 May 2018

Brewing in Beats: Modules improvements

By Monica Sarbu

Welcome to Brewing in Beats! With these weekly series, we're keeping you up to date with what's new in Beats, including the latest commits and releases.

Did you know that Beats 6.2 is already available? Try it and let us know what you think. If you are curious to see the Beats in action, check out the Getting Started with Beats webinar.

Metricbeat: RabbitMQ module improvements

The RabbitMQ module is receiving some attention these weeks. Thanks to the contributions of @kvalev, Metricbeat is now able to collect exchange metrics and queue message rates. We have also added a new configuration option to support custom management path prefixes and another pull request has been merged to avoid collecting metrics from RabbitMQ masters multiple times. You can find more about these changes in #6442, #6875, #6971 and related issues.

These improvements will be available in the 6.4 release.

Filebeat: Docker input fix for large lines

By default the docker json-file driver will split documents that exceed 16KB into multiple lines, this means events send to ES would be incomplete. Carlos created a PR to change the behaviour of the Filebeat docker input, and the input will now merge theses document by default. this options can be turn off by configuring the combine_partial and set it to false. #6967

This improvement will be available in the Beats 6.4 release.

All Beats changes

Repository: elastic/beats

Metricbeat

Changes in master:

  • Metricbeat: Add configuration for RabbitMQ management prefix path #7074
  • Combine Elasticsearch module integration tests #7049
  • Metricbeat: Ensure canonical naming for JMX beans is disabled #7047
  • Disable fsstat and filesystem as not enabled by default #7030
  • Update elasticsearch/node metricset to use reporter interface #6983
  • Rabbitmq exchanges metricset #6955
  • Elasticsearch index summary metricset #6918
Filebeat

Changes in master:

  • Adds support for RFC3339 timestamp and nanoseconds parsing #7046
  • Join Docker log lines when they are split because of size #6967

Changes in 6.3:

  • Adds support for RFC3339 timestamp and nanoseconds parsing #7046
  • Commit registry writes to stable storage to avoid corrupt registry files #6877
Dashboards

Changes in master:

  • Fix dashboards for Kibana 6.3 #7043
Testing

Changes in master:

  • Travis doesn't do apt-get update anymore #7064
  • Readd BEAT_VERSION to compose project #7042
Documentation

Changes in master:

  • Add missing documentation of --pipelines flag of setup command #7033
  • Add modules.d layout to getting started and fix Windows command examples #6941
  • Add a configurable seccomp filter on Linux #6832