Blogs

Developer insights and practical how-to articles from our experts to inspire and empower your search experience.

Filters
How we built PromQL into Elasticsearch
Elasticsearch Labs

How we built PromQL into Elasticsearch

PromQL runs on the same Elasticsearch compute engine as ES|QL, with no plugin and no separate process to operate. Getting there meant changing how the engine evaluates time windows and builds grouping keys.

Sergey Sidorov
Trust, but benchmark: How we let an AI agent optimize Elasticsearch
Elasticsearch Labs

Trust, but benchmark: How we let an AI agent optimize Elasticsearch

We share how we built a harness that automatically identifies and implements optimizations in the Elasticsearch codebase.

Thomas Veasey
Elasticsearch Vector Database: Ship in minutes, scale affordably to hundreds of billions
Elasticsearch Labs

Elasticsearch Vector Database: Ship in minutes, scale affordably to hundreds of billions

The hard parts of hybrid retrieval, already done, with optimized defaults, third party and native Jina AI models, and managed GPU inference all out of the box. Build fast, scalable AI apps, not infrastructure.

Dustin Coates
One field, one copy: How Elasticsearch columnar storage drops the inverted index
Elasticsearch Labs

One field, one copy: How Elasticsearch columnar storage drops the inverted index

Storing each field once means no inverted index, so doc values now read in bulk and skippers let queries skip whole ranges of documents, while new mapping attributes control what each field is allowed to contain.

Martijn van Groningen
Query rewrite rules in Elasticsearch: 2.3x faster wildcard scans
Elasticsearch Labs

Query rewrite rules in Elasticsearch: 2.3x faster wildcard scans

A second rule makes empty-string filters 1.6x faster. It reads string lengths straight from the offset array and never touches the compressed bytes. Both rules came from the same habit of running real queries and hunting for the special case.

Parker Timmins
Backfill time series data in Elasticsearch: Load months of historical metrics through the bulk API
Elasticsearch Labs

Backfill time series data in Elasticsearch: Load months of historical metrics through the bulk API

Elasticsearch works out the time boundaries and creates the past backing indices as the documents land, so a historical data migration runs on your normal ingest path.

Mary Gouseti
Introducing SPARKLINE in ES|QL: Spot trends at a glance
Elasticsearch Labs

Introducing SPARKLINE in ES|QL: Spot trends at a glance

Spot trends across thousands of groups at a glance without leaving your workflow. ES|QL's new SPARKLINE function turns aggregations into trend lines. One array per row, zero effort.

Daniel Rubinstein
No more allocation delays: Decoupling snapshots from shard relocation in stateless Elasticsearch
Elasticsearch Labs

No more allocation delays: Decoupling snapshots from shard relocation in stateless Elasticsearch

Clusters scale out under load without waiting for a snapshot to finish, because snapshots now read straight from the object store and no longer pin shards in place.

David Turner
Avoiding and Correcting Hotspots: How Elasticsearch Serverless Balances Shards
Elasticsearch Labs

Avoiding and Correcting Hotspots: How Elasticsearch Serverless Balances Shards

Elasticsearch Serverless replaces the Elasticsearch node-weight based shard rebalancing algorithm with resource usage aware rebalancing that avoids index shard colocation, OOM events and write load hotspotting

Dianna Hohensee
Dashboard activity logs: Find out which Kibana dashboards get used
Elasticsearch Labs

Dashboard activity logs: Find out which Kibana dashboards get used

Kibana now logs who viewed, edited or deleted each dashboard, how long it took and what failed, so you can catch a broken dashboard before anyone reports it.

Teresa Alvarez Soler
Migrating 1,100 files to Redux Toolkit v2 without freezing the Kibana monorepo
Elasticsearch Labs

Migrating 1,100 files to Redux Toolkit v2 without freezing the Kibana monorepo

Kibana gave Redux Toolkit v2 the default package name and pushed v1 onto an explicit alias, which inverts the usual migration order. Webpack externals, yarn resolutions and an ESLint rule keep React Redux v7 and v9 out of each other's way.

Walter Rafelsberger
Know your facts: How Elasticsearch AI Indices let agents skip the reading and keep the answer
Elasticsearch Labs

Know your facts: How Elasticsearch AI Indices let agents skip the reading and keep the answer

A technical walkthrough of precomputing facts into an Elasticsearch AI Index, so agents answer from a single ES|QL query instead of reading whole documents, with fewer tokens and lower latency.

Kathleen DeRusso