Log Analytics Articles
![Monitor dbt pipelines with Elastic Observability](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fmonitor-dbt-pipelines-with-elastic-observability%2Fmonitoring-dbt-with-elastic.png&w=828&q=75)
Monitor dbt pipelines with Elastic Observability
Learn how to set up a dbt monitoring system with Elastic that proactively alerts on data processing cost spikes, anomalies in rows per table, and data quality test failures
![NGNIX log analytics with GenAI in Elastic](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fnginx-log-analytics-with-genai-elastic%2Fblog-thumb-observability-pattern-color.png&w=828&q=75)
NGNIX log analytics with GenAI in Elastic
Elastic has a set of embedded capabilities such as a GenAI RAG-based AI Assistant and a machine learning platform as part of the product baseline. These make analyzing the vast number of logs you get from NGINX easier.
![Smarter log analytics in Elastic Observability](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fsmarter-log-analytics-in-elastic-observability%2Flog-monitoring.jpeg&w=828&q=75)
Smarter log analytics in Elastic Observability
Discover smarter log handling with Kibana's latest features! The new Data Source Selector lets you easily filter logs by integrations like System Logs and Nginx. Smart Fields enhance log analysis by presenting data more intuitively. Simplify your workflow and uncover deeper insights today!
![AWS VPC Flow log analysis with GenAI in Elastic](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Faws-vpc-flow-log-analysis-with-genai-elastic%2F21-cubes.jpeg&w=828&q=75)
AWS VPC Flow log analysis with GenAI in Elastic
Elastic has a set of embedded capabilities such as a GenAI RAG-based AI Assistant and a machine learning platform as part of the product baseline. These make analyzing the vast number of logs you get from AWS VPC Flows easier.
![Build better Service Level Objectives (SLOs) from logs and metrics](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fservice-level-objectives-slos-logs-metrics%2F139686_-_Elastic_-_Headers_-_V1_3.jpg&w=828&q=75)
Build better Service Level Objectives (SLOs) from logs and metrics
To help manage operations and business metrics, Elastic Observability's SLO (Service Level Objectives) feature was introduced in 8.12. This blog reviews this feature and how you can use it with Elastic's AI Assistant to meet SLOs.
![Collecting OpenShift container logs using Red Hat’s OpenShift Logging Operator](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fopenshift-container-logs-red-hat-logging-operator%2F139687_-_Blog_Header_Banner_V1.jpg&w=828&q=75)
Collecting OpenShift container logs using Red Hat’s OpenShift Logging Operator
Learn how to optimize OpenShift logs collected with Red Hat OpenShift Logging Operator, as well as format and route them efficiently in Elasticsearch.
![Optimizing Observability with ES|QL: Streamlining SRE operations and issue resolution for Kubernetes and OTel](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fopentelemetry-kubernetes-esql%2FES_QL_blog-720x420-05.png&w=828&q=75)
Optimizing Observability with ES|QL: Streamlining SRE operations and issue resolution for Kubernetes and OTel
ES|QL enhances operational efficiency, data analysis, and issue resolution for SREs. This blog covers the advantages of ES|QL in Elastic Observability and how it can apply to managing issues instrumented with OpenTelemetry and running on Kubernetes.
![Migrating 1 billion log lines from OpenSearch to Elasticsearch](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fmigrating-billion-log-lines-opensearch-elasticsearch%2Felastic-blog-header-1-billion-log-lines.png&w=828&q=75)
Migrating 1 billion log lines from OpenSearch to Elasticsearch
Learn how to migrate 1 billion log lines from OpenSearch to Elasticsearch for improved performance and reduced disk usage. Discover the migration strategies, data transfer methods, and optimization techniques used in this guide.
![Customize your data ingestion with Elastic input packages](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fcustomize-data-ingestion-input-packages%2Fcustomize-observability-input-720x420.jpg&w=828&q=75)
Customize your data ingestion with Elastic input packages
In this post, learn about input packages and how they can provide a flexible solution to advanced users for customizing their ingestion experience in Elastic.
![Elastic SQL inputs: A generic solution for database metrics observability](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fsql-inputs-database-metrics-observability%2Fpatterns-midnight-background-no-logo-observability.png&w=828&q=75)
Elastic SQL inputs: A generic solution for database metrics observability
This blog dives into the functionality of generic SQL and provides various use cases for advanced users to ingest custom metrics to Elastic for database observability. We also introduce the fetch from all database new capability released in 8.10.
![The antidote for index mapping exceptions: ignore_malformed](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2Fantidote-index-mapping-exceptions-ignore-malformed%2Fillustration-stack-modernize-solutions-1689x980_(1).png&w=828&q=75)
The antidote for index mapping exceptions: ignore_malformed
How an almost unknown setting called ignore_malformed can make the difference between dropping a document entirely if a single field is malformed or just ignoring that field and ingesting the document anyway.
![3 models for logging with OpenTelemetry and Elastic](/observability-labs/_next/image?url=%2Fobservability-labs%2Fassets%2Fimages%2F3-models-logging-opentelemetry%2Flog_infrastructure_apm_synthetics-monitoring.jpeg&w=828&q=75)
3 models for logging with OpenTelemetry and Elastic
Because OpenTelemetry increases usage of tracing and metrics with developers, logging continues to provide flexible, application-specific, and event-driven data. Explore OpenTelemetry logging and how it provides guidance on the available approaches.