Category: Data Management

Articles tagged Data Management

Filters

Migrate Datadog Kubernetes dashboards to Elastic Observability in under an hour

See how the migration CLI translates a real Datadog Kubernetes dashboard into validated Kibana panels and uploads it to your cluster in under an hour, no manual widget rebuilds required.

Peter Simkins

How Prometheus Remote Write Ingestion Works in Elasticsearch

A look under the hood at Elasticsearch's Prometheus Remote Write implementation: protobuf parsing, metric type inference, TSDS mapping, and data stream routing.

Felix Barnsteiner

Elasticsearch over the years — how LogsDB cuts index size by up to 75% at no throughput cost

By default, Elasticsearch is optimized for retrieval, not storage. LogsDB changes that. Here's the layered architecture behind a 77% index size reduction.

Luca Wintergerst

How to cut Elasticsearch log storage costs with LogsDB

Learn how to enable LogsDB index mode in Elasticsearch and measure real storage savings. We compare a standard index against a LogsDB index using Apache logs and show how much storage you can reclaim.

Jeffrey Rengifo

Monitor dbt pipelines with Elastic Observability

Learn how to set up a dbt monitoring system with Elastic that proactively alerts on data processing cost spikes, anomalies in rows per table, and data quality test failures

Almudena Sanz Olivé

Elastic Universal Profiling: Delivering performance improvements and reduced costs

In this blog, we’ll cover how a discovery by one of our engineers led to cost savings of thousands of dollars in our QA environment and magnitudes more once we deployed this change to production.

Luca Wintergerst

Continuous profiling: The key to more efficient and cost-effective applications

In this post, we discuss why computational efficiency is important and how Elastic Universal Profiling enables your business to use continuous profiling in production environments to make the software that runs your business as efficient as possible.

John Knoepfle

Improving the Elastic APM UI performance with continuous rollups and service metrics

We made significant improvements to the UI performance in Elastic APM to make it scale with even the most demanding workloads, by pre-aggregating metrics at the service level, and storing the metrics at different levels of granularity.

Felix Barnsteiner

Simplifying log data management: Harness the power of flexible routing with Elastic

The reroute processor, available as of Elasticsearch 8.8, allows customizable rules for routing documents, such as logs, into data streams for better control of processing, retention, and permissions with examples that you can try on your own.

Felix Barnsteiner

How to use Elasticsearch and Time Series Data Streams for observability metrics

With Time Series Data Streams (TSDS), Elasticsearch introduces optimized storage for metrics time series. Check out how we use it for Elastic Observability.

Nicolas Ruflin