All Articles
Building advanced visualizations with Kibana and Vega
How To

Building advanced visualizations with Kibana and Vega

Have you struggled to build the Kibana visualizations you need using Lens and TSDB? Learn how to create complex visualizations using Kibana and Vega.

Carly Richmond

How to analyze data using Python, Elasticsearch and Kibana
How To

How to analyze data using Python, Elasticsearch and Kibana

Explore data analysis with Elasticsearch, Python & Kibana. Learn about data loading, querying and creating Kibana dashboards with an example.

Jessica Garson

Automatically updating your Elasticsearch index using Node.js and an Azure Function App
How To

Automatically updating your Elasticsearch index using Node.js and an Azure Function App

Learn how to use Node.js to keep your index current using an Azure Function App.

Jessica Garson

Elastic Cloud adds Elasticsearch Vector Database optimized profile to Microsoft Azure
Vector DatabaseGenerative AI

Elastic Cloud adds Elasticsearch Vector Database optimized profile to Microsoft Azure

Elasticsearch adds a new vector search optimized profile to Elastic Cloud on Microsoft Azure.

Serena Chou

Jeff Vestal

Yuvraj Gupta

ChatGPT and Elasticsearch: Creating custom GPTs with Elastic data
Generative AI

ChatGPT and Elasticsearch: Creating custom GPTs with Elastic data

Get started with custom GPTs using ChatGPT and Elasticsearch. Learn how to create custom GPTs that interact seamlessly with your Elasticsearch data.

Sandra Gonzales

ChatGPT and Elasticsearch: OpenAI meets private data
Generative AI

ChatGPT and Elasticsearch: OpenAI meets private data

Integrate Elasticsearch's search relevance with ChatGPT's question-answering capability to enhance your domain-specific knowledge base.

Jeff Vestal

ChatGPT and Elasticsearch: A plugin to use ChatGPT with your Elastic data
Generative AI

ChatGPT and Elasticsearch: A plugin to use ChatGPT with your Elastic data

Learn how to implement a plugin and enable ChatGPT users to extend ChatGPT with any content indexed in Elasticsearch, using the Elastic documentation.

Baha Azarmi

Chunking Large Documents via Ingest pipelines plus nested vectors equals easy passage search
Vector DatabaseHow To

Chunking Large Documents via Ingest pipelines plus nested vectors equals easy passage search

In this post we'll show how to easily ingest large documents and break them up into sentences via an ingest pipeline so that they can be text embedded along with nested vector support for searching large documents semantically. Generated image of a chonker.

Michael Heldebrant

Elasticsearch open inference API adds support for Cohere Embeddings
IntegrationsHow ToVector Database

Elasticsearch open inference API adds support for Cohere Embeddings

Learn more about how to use Cohere embeddings with Elastic built search experiences!

Serena Chou

Jonathan Buttner

Dave Kyle

Elasticsearch open Inference API adds support for Cohere’s Rerank 3 model
IntegrationsHow ToVector DatabaseGenerative AI

Elasticsearch open Inference API adds support for Cohere’s Rerank 3 model

“Elasticsearch integrates semantic reranking with Cohere’s Rerank models, with the inclusion of Rerank into our open Inference API.”

Serena Chou

Max Hniebergall

Using Elasticsearch as a vector database for Azure OpenAI On Your Data
IntegrationsHow ToVector Database

Using Elasticsearch as a vector database for Azure OpenAI On Your Data

Explore how to quickly set up and ingest data into Elasticsearch for use as a vector database with Azure OpenAI On Your Data, enabling you to chat with your private data.

Paul Oremland

Elasticsearch open inference API adds support for Azure OpenAI chat completions
IntegrationsHow ToGenerative AI

Elasticsearch open inference API adds support for Azure OpenAI chat completions

Elasticsearch open inference API adds support for Azure Open AI chat completions, providing full developer access to the Azure AI ecosystem

Tim Grein

Elasticsearch open inference API adds support for OpenAI chat completions
IntegrationsHow ToGenerative AI

Elasticsearch open inference API adds support for OpenAI chat completions

Learn how OpenAI chat completions and Elasticsearch can be used to summarize, translate or perform question & answering on any text.

Tim Grein

Designing for large scale vector search with Elasticsearch
Vector Database

Designing for large scale vector search with Elasticsearch

Part 1: High-fidelity dense vector search in Elasticsearch. Learn how we achieve a 75% memory reduction without impacting search quality.

Jim Ferenczi

Improving information retrieval in the Elastic Stack: Improved inference performance with ELSER v2
ML Research

Improving information retrieval in the Elastic Stack: Improved inference performance with ELSER v2

Learn about the improvements we've made to the inference performance of ELSER v2.

Thomas Veasey

Quentin Herreros

Valeriy Khakhutskyy

Improving information retrieval in the Elastic Stack: Optimizing retrieval with ELSER v2
ML Research

Improving information retrieval in the Elastic Stack: Optimizing retrieval with ELSER v2

Learn about how we're reducing retrieval costs for ELSER v2.

Thomas Veasey

Quentin Herreros

Valeriy Khakhutskyy

From ES|QL to Pandas dataframes in Python
How ToIntegrations

From ES|QL to Pandas dataframes in Python

How to export ES|QL queries as Pandas dataframes in Python

Quentin Pradet

From ES|QL to PHP objects
ES|QLHow ToIntegrations

From ES|QL to PHP objects

Learn how to execute and manage ES|QL queries in PHP. Follow this guide to map ES|QL results to a PHP object or custom class.

Enrico Zimuel

ES|QL queries to Java objects
ES|QLHow ToIntegrations

ES|QL queries to Java objects

Learn how to perform ES|QL queries with the Java client. Follow this guide for step-by-step instructions, including examples.

Laura Trotta

RAG evaluation metrics: A journey through metrics
ML Research

RAG evaluation metrics: A journey through metrics

Explore RAG evaluation metrics like BLEU score, ROUGE score, PPL, BARTScore, and more. Discover how Elastic is evaluating RAG with UniEval.

Quentin Herreros

Thomas Veasey

Thanos Papaoikonomou

How to choose between exact and approximate kNN search in Elasticsearch
How ToVector Database

How to choose between exact and approximate kNN search in Elasticsearch

Learn more about exact and approximate kNN search in Elasticsearch, and when to use each one.

Carlos Delgado

Implementing image search: vector search via image processing in Elasticsaerch
Vector Database

Implementing image search: vector search via image processing in Elasticsaerch

Learn how to implement image search with an example. This blog covers how to use vector search through image processing in Elasticsearch.

Alex Salgado

Elastic Cloud adds Elasticsearch Vector Database optimized instance to Google Cloud
Vector DatabaseGenerative AI

Elastic Cloud adds Elasticsearch Vector Database optimized instance to Google Cloud

Elasticsearch adds a new vector search optimized profile for GCP.

Serena Chou

Jeff Vestal

Yuvraj Gupta

Generative AI using Elastic and Amazon SageMaker JumpStart
Generative AIIntegrations

Generative AI using Elastic and Amazon SageMaker JumpStart

Learn how to build a generative artificial intelligence (GAI) solution with Amazon SageMaker JumpStart, Elastic, and Hugging Face open source LLMs using the sample implementation provided in this post and a data set relevant to your business.

Uday Theepireddy

Ayan Ray

How to deploy NLP: Text Embeddings and Vector Search
Vector Database

How to deploy NLP: Text Embeddings and Vector Search

Taking Text Embeddings and Vector Similarity Search as the example task, this blog describes the process for getting up and running using deep learning models for Natural Language Processing, and demonstrates vector search capability in Elasticsearch

Mayya Sharipova

Scalar Quantization Optimized for Vector Databases
ML Research

Scalar Quantization Optimized for Vector Databases

Optimizing scalar quantization for the vector database use case allows us to achieve significantly better performance for the same retrieval quality at high compression ratios.

Thomas Veasey

Benjamin Trent

Introducing the sparse vector query: Searching sparse vectors with inference or precomputed query vectors
Vector Database

Introducing the sparse vector query: Searching sparse vectors with inference or precomputed query vectors

Introducing the sparse vector query, powering sparse vector search in the future

Kathleen DeRusso

Keeping your Elasticsearch index current with Python and Google Cloud Platform Functions
How To

Keeping your Elasticsearch index current with Python and Google Cloud Platform Functions

Keep your Elasticsearch index updated with Python & Google Cloud Functions. Follow these steps to automatically update an index when new data is present.

Jessica Garson

Introducing kNN Query: An expert way to do kNN search
Vector DatabaseHow To

Introducing kNN Query: An expert way to do kNN search

Explore how the kNN query in Elasticsearch can be used and how it differs from top-level kNN search, including examples.

Mayya Sharipova

Benjamin Trent

Less merging and faster ingestion in Elasticsearch 8.11
Lucene

Less merging and faster ingestion in Elasticsearch 8.11

Elasticsearch 8.11 improves how it manages its indexing buffer, resulting in less segment merging.

Adrien Grand

Exploring vector databases: how to get the best of lexical and AI-powered search with Elastic’s vector database
Vector Database

Exploring vector databases: how to get the best of lexical and AI-powered search with Elastic’s vector database

Learn about the concepts related to vector databases, how they work and how to get the best out of lexical & AI search with Elastic’s vector database.

Bernhard Suhm

Lexical and semantic search with Elasticsearch
Vector Database

Lexical and semantic search with Elasticsearch

In this blog, we'll explore various approaches to retrieving information using Elasticsearch, focusing on lexical and semantic search.

Priscilla Parodi

How to set up LocalAI for GPU-powered text embeddings in air-gapped environments
Generative AIHow ToIntegrations

How to set up LocalAI for GPU-powered text embeddings in air-gapped environments

With LocalAI, you can compute text embeddings in air-gapped systems. GPU support is available. Here's how to set up LocalAI to compute embeddings for your data.

Valeriy Khakhutskyy

Apache Lucene 9.9, the fastest Lucene release ever
Lucene

Apache Lucene 9.9, the fastest Lucene release ever

Lucene 9.9 was released recently and brings major speedups to query evaluation

Adrien Grand

Bringing Maximum-Inner-Product into Lucene
Lucene

Bringing Maximum-Inner-Product into Lucene

How we brought maximum-inner-product into Lucene

Benjamin Trent

Improving information retrieval in the Elastic Stack: Introducing Elastic Learned Sparse Encoder, our new retrieval model
ML Research

Improving information retrieval in the Elastic Stack: Introducing Elastic Learned Sparse Encoder, our new retrieval model

Deep learning has transformed how people retrieve information. We've created a retrieval model that works with a variety of text with streamlined processes to deploy it. Learn about the model's performance, its architecture, and how it was trained.

Thomas Veasey

Quentin Herreros

Accessing machine learning models in Elastic
Integrations

Accessing machine learning models in Elastic

Bring your own transformer models into Elastic to use optimized embedding models and NLP, or integrate with third-party transformer modes such as OpenAI GPT-4 via APIs to leverage more accurate, business-specific content based on private data stores.

Bernhard Suhm

Josh Devins

Introducing Elastic Learned Sparse Encoder: Elastic’s AI model for semantic search
ML Research

Introducing Elastic Learned Sparse Encoder: Elastic’s AI model for semantic search

Elastic Learned Sparse Encoder is an AI model for high relevance semantic search across domains. As a sparse vector model, it expands the query with terms that don't exist in the query itself, delivering superior relevance without domain adaptation.

Aris Papadopoulos

Gilad Gal

More skipping with block-max MAXSCORE
Lucene

More skipping with block-max MAXSCORE

Improve the MAXSCORE algorithm to evaluate disjuntive queries more like a conjunctive query when possible, which helps evaluate even fewer hits

Adrien Grand

Speeding Up Multi-graph Vector Search
Lucene

Speeding Up Multi-graph Vector Search

Sharing information among segment searches in multi-graph vector search allows us to achieve significant search speedups.

Mayya Sharipova

Thomas Veasey

Retrieval of originating information in multi-vector documents
Vector Database

Retrieval of originating information in multi-vector documents

Learn more on how to link original context to a multi-vector document.

Gilad Gal

Multilingual vector search with the E5 embedding model
Vector Database

Multilingual vector search with the E5 embedding model

Here's how multilingual vector search works and how to use Elasticsearch with the multilingual E5 embedding model, including examples.

Josh Devins

Elasticsearch .NET client evolution: From NEST to Elastic.Clients.Elasticsearch
How ToIntegrations

Elasticsearch .NET client evolution: From NEST to Elastic.Clients.Elasticsearch

Learn about the evolution of the Elasticsearch .NET client and the transition from NEST to Elastic.Clients.Elasticsearch.

Florian Bernd

Elasticsearch piped query language, ES|QL, now generally available
ES|QLHow To

Elasticsearch piped query language, ES|QL, now generally available

Elasticsearch Query Language (ES|QL) is GA. Simplify your data investigations with an innovative piped query language powered by a new query engine, all from a single unified UI.

Costin Leau

George Kobar

AI plagiarism: Plagiarism detection with Elasticsearch
Vector DatabaseHow To

AI plagiarism: Plagiarism detection with Elasticsearch

Here's how to check for AI plagiarism using Elasticsearch, focusing on use cases with NLP models and Vector Search.

Priscilla Parodi

Search relevance tuning: Balancing keyword and semantic search
Vector DatabaseHow To

Search relevance tuning: Balancing keyword and semantic search

This blog offers practical strategies for tuning search relevance that can be complementary to semantic search.

Kathleen DeRusso

Semantic Search as Service at a Search Center of Excellence
Vector DatabaseHow To

Semantic Search as Service at a Search Center of Excellence

How to implement and scale semantic search as a service for a search COE using Elastic Learned Sparse EncodeR (ELSER)

Sherry Ger

Stephen Brown

Stateless — your new state of find with Elasticsearch
ML Research

Stateless — your new state of find with Elasticsearch

Discover this future of stateless Elasticsearch. Learn how we’re investing in building a new fully cloud native architecture to push the boundaries of scale and speed.

Leaf Lin

Tim Brooks

Quin Hoxie

Improving text expansion performance using token pruning
Vector DatabaseHow To

Improving text expansion performance using token pruning

Learn about token pruning and how it boosts the performance of text expansion queries by making them more efficient without sacrificing recall.

Kathleen DeRusso

Vector search in Elasticsearch: The rationale behind the design
Vector DatabaseML Research

Vector search in Elasticsearch: The rationale behind the design

In this blog, you'll learn how vector search has been integrated into Elasticsearch and the trade-offs that we made.

Adrien Grand

What happened in Lucene land in 2023?
Lucene

What happened in Lucene land in 2023?

2023 has been another big year for Apache Lucene, this blog reviews major milestones of 2023

Adrien Grand

Generative AI architectures with transformers explained from the ground up
ML ResearchGenerative AI

Generative AI architectures with transformers explained from the ground up

Here's how generative AI works from the ground up, including embeddings, transformer-encoder architecture, training/fine-tuning models & more.

Aris Papadopoulos

Using hybrid search for gopher hunting with Elasticsearch and Go
How ToVector Database

Using hybrid search for gopher hunting with Elasticsearch and Go

Learn how to achieve hybrid search by combining keyword and vector search using Elasticsearch and the Elasticsearch Go client.

Carly Richmond

Laurent Saint-Félix

Perform text queries with the Elasticsearch Go client
How To

Perform text queries with the Elasticsearch Go client

Learn how to perform traditional text queries in Elasticsearch using the Elasticsearch Go client through a practical example.

Carly Richmond

Laurent Saint-Félix

Perform vector search in Elasticsearch with the Elasticsearch Go client
How ToVector Database

Perform vector search in Elasticsearch with the Elasticsearch Go client

Learn how to perform vector search in Elasticsearch using the Elasticsearch Go client through a practical example.

Carly Richmond

Laurent Saint-Félix