Category: LLM Observability

Articles tagged LLM Observability

Filters

Elastic now alerts at 80% OpenAI rate limit usage, before your app gets throttled

OpenAI rate limit monitoring in Elastic maps headroom across every project and model. Compare configured RPM, TPM and IPM limits against real usage and plan capacity before a throttling alert fires.

Daniela Tzvetkova

Stop finding out about your Claude bill on invoice day: Anthropic API monitoring is now in Elastic

Track Anthropic API spend and rate limit headroom across every workspace, model, and service tier, so cost surprises and throttling stop being production-time discoveries.

Ishleen Kaur

ES|QL queries for debugging LLM latency, cost and GPU saturation

Learn how to investigate LLM latency, token cost and GPU saturation using ES|QL against OpenTelemetry traces and get a root cause, not just a symptom.

Jeffrey Rengifo

Elastic Ramen: A CLI harness for SRE investigation and remediation

Exploring Elastic Ramen, a CLI harness that brings Agent Builder conversations, skills, and tools into the terminal so engineers can move from investigation to remediation in a single thread.

Joe Reuter

Automated log parsing in Streams with ML

Learn how a hybrid ML approach achieved 94% log parsing and 91% log partitioning accuracy through automation experiments with log format fingerprinting in Streams.

Nastia Havriushenko

Windows Event Log Monitoring with OpenTelemetry & Elastic Streams

Learn how to enhance Windows Event Log monitoring with OpenTelemetry for standardized ingestion and Elastic Streams for smart partitioning and analysis.

David Hope

Streams Processing: Stop Fighting with Grok. Parse Your Logs in Streams.

Learn how Streams Processing works under the hood and how to use it to build, test, and deploy parsing logic on live data quickly.

Luca Wintergerst

Troubleshooting your Agents and Amazon Bedrock AgentCore with Elastic Observability

Discover how to achieve end-to-end observability for Amazon Bedrock AgentCore: from tracking service health and token costs to debugging complex reasoning loops with distributed tracing.

Daniela Tzvetkova

Elastic Observability: Streams Data Quality and Failure Store Insights

Discover how the Streams a new AI driven Elastic Observability feature help manage data quality with a failure store to help you monitor, troubleshoot, and retain high-quality data.

Elena Stoeva

Reconciliation in Elastic Streams: A Robust Architecture Deep Dive

Learn how Elastic's engineering team refactored Streams using a reconciliation model inspired by Kubernetes & React to build a robust, extensible, and debuggable system.

Milton Hultgren

How Streams in Elastic Observability Simplifies Retention Management

Learn how Streams simplifies retention management in Elasticsearch with a unified view to monitor, visualize, and control data lifecycles using DSL or ILM.

Kevin Lacabane

Live logs and prosper: fixing a fundamental flaw in observability

Stop chasing symptoms. Learn how Streams, in Elastic Observability fixes the fundamental flaw in observability, using AI to proactively find the 'why' in your logs for faster resolution.

Ken Exner