In the agentic AI era, an enterprise’s value lies in its context — its data, history, decisions, and institutional knowledge spread across unstructured data. OpenAI’s in-house data agent shows that reliable outcomes depend on bringing together multiple layers of context. Elasticsearch as a context layer gives agents persistent, governed memory to retrieve what matters as well as the ability to retain useful knowledge across interactions and ground every response and action in the enterprise.

The practical challenge in context is a retrieval problem: selecting the right information at the right time with the right permissions. Elasticsearch combines lexical and vector search, semantic reranking, filters, and access controls in one platform. In recent Elastic internal retrieval tests, Elastic was used for organizational memory and delivered 0.89 recall and complete protection of data across users.

Economics matters as much as accuracy. In a constrained experiment using the BrowseComp-Plus dataset, our pre-computed Knowledge Indicators reduced input-token use by up to 75% compared with the experiment's standard retrieval augmented generation (RAG) baseline while answer accuracy increased from 60% to 92%. Results will vary by workload, but the direction is clear: Better retrieval can improve both reliability and cost.

Elastic Agent Builder can be used with OpenAI models and agents for improving context and delivering higher relevance and greater efficiency. Agent Builder tools can be exposed to OpenAI agents over MCP, Skills are available to Codex, and Agent Builder supports GPT models for reasoning and tools.

As models advance, context is what enables enterprises to derive real ROI and maintain unique knowledge and advantage in the world of agentic AI. Together, OpenAI and Elasticsearch give developers a practical foundation for agents that can create, manage, and retrieve context over governed enterprise data.

Context engineering

Vector database

Search powered applications

Logs

Threat protection

Workflows

Elasticsearch

Kibana (Discover, Dashboards)

Elastic Agent Builder

AutoOps

Piped query language

Jina AI search models

Elastic Cloud Serverless

Elastic Cloud Hosted

Self-managed Elasticsearch

Ecommerce search

Customer support search

Search-driven apps

Log analytics

Infrastructure monitoring

Digital experience monitoring

App performance monitoring

AIOps

LLM observability

Next-gen SIEM

Workflows for security

XDR and endpoint security

AI for security

10x your data's value

Cloud providers

Elastic AI Ecosystem

Search AI Partner Program

AV-Comparatives

Forrester Wave™ XDR

Gartner Magic Quadrant Leader

IDC MarketScape

Search

Security

Observability

Get started

Demo gallery

Downloads

Integrations

Docs

Elasticsearch Labs

Elastic Security Labs

Elastic Observability Labs

Blog

Community

Events

Webinars

Discuss

Training

Support

Consulting

Author

Articles by Gregory Tademoto

GVP, Chief of Staff to the CEO and Head of Corporate Development

Elastic and OpenAI collaborate to bring frontier intelligence to unstructured enterprise data

Sign up for Elastic Cloud free trial