Elastic Observability 7.16: Ad hoc analytics and CI/CD pipeline visibility

blog-thumb-release-observability.png

Elastic Observability 7.16 introduces curated data exploration views for ad hoc analysis and further extends visibility into complex and distributed systems with the general availability (GA) of dozens of prebuilt Elastic Agent data integrations, observability tooling for continuous integration and continuous delivery (CI/CD) pipelines, and a new native data source integration with Amazon Web Services (AWS) FireLens.

These new features allow customers to:

  • Conduct ad hoc investigations to analyze “unknown unknowns” for observability
  • Frictionlessly ingest data from complex, cloud-native environments
  • Build and deploy faster and automate more reliably with visibility into CI/CD pipelines


Elastic Observability 7.16 is available now on Elastic Cloud — the only hosted Elasticsearch offering to include all of the new features in this latest release. You can also download the Elastic Stack and our cloud orchestration products, Elastic Cloud Enterprise and Elastic Cloud for Kubernetes, for a self-managed experience.

Uncover trends, investigate intermittent issues, and accelerate troubleshooting with curated data exploration views

In today's complex and distributed environments, SRE and DevOps teams need the ability to analyze “unknown unknowns” — scenarios where premade dashboards or canned machine learning jobs can’t solve the problems. For instance, they may need to conduct ad hoc investigations or test hypotheses regarding performance optimization and related investments.

The GA of data exploration views for real user monitoring, synthetics, and Mobile APM allows users to identify, visualize, and investigate any problems in the front end, such as unoptimized images and JavaScript errors. These curated views provide powerful ad hoc analytics for visualizing and overlaying multiple dimensions of data — with full control over filtering and how the data is broken down, without the need to know anything about index patterns or field names, removing the cognitive load and complexity of analyzing different time periods, cohorts, and data types.
Elastic Observability 7.16 - Data exploration views

Curated data exploration views provide powerful ad hoc analytics for visualizing and overlaying multiple dimensions of data.

videoImage

Streamline data ingestion with the new agentless AWS FireLens integration

We are also excited to announce the first native integrations with Amazon Web Services (AWS) on Elastic Cloud via AWS FireLens — a container log router for Amazon EC2 and AWS Fargate. Customers can now quickly and easily ingest container logs into Elastic Cloud within seconds using FireLens and Fluent Bit without needing to install and manage standalone data shippers. They also benefit from a simplified data architecture, allowing them to reduce operational complexities.

Get visibility into CI/CD build automation and deployment

Modern agile development processes and CI/CD automation have enabled software development teams to build and ship releases quickly, accelerating innovation and time to market. But without insight into the performance of their build, test, and deployment pipelines, application teams are vulnerable to development outages that can delay release cycles and impact the bottom line.

Elastic Observability provides key pipeline insights for monitoring, alerting, and troubleshooting of issues — such as error-prone jobs, slow builds, or flaky tests — during the entire software development lifecycle (SDLC). With Elastic 7.16, customers can now get even more granular CI/CD pipeline visibility with OpenTelemetry integrations for Ansible and Maven (technical preview), in addition to our existing plugin for Jenkins pipeline observability. These tools are widely used by DevOps, SRE, and development teams for automating the development pipeline: If these tools fail, the pipeline fails.

The new integrations for Ansible and Maven deliver deeper visibility into job execution and deployment errors for troubleshooting, optimization, and documentation purposes, enabling release teams to operate faster and automate more reliably. They provide comprehensive visibility into all Ansible playbooks and Maven builds, generating traces for each run, and performance metrics to help teams understand:

  • Which Ansible tasks or Maven goals are run the most
  • How often they fail
  • How long they take to complete

As part of Elastic’s commitment to all things free and open, we have contributed these open standards-based CI/CD integrations to the Ansible, Jenkins, and OpenTelemetry communities.

Get CI/CD visibility into critical build activities. The visualization of CI/CD pipelines as distributed traces provides documentation and health indicators for all pipelines.

Elastic’s CI/CD observability is easy to implement as pipelines and traditional jobs are instrumented automatically without the need to modify existing scripts. Pipeline executions are intuitively visualized as distributed traces with the capability to analyze pipeline steps across any dimension to assess the nature and impact of the outage. Troubleshooters can further drill into the trace to identify the source of errors and slowdowns.

CI/CD administrators can also view health, errors, and performance metrics by pipeline, and drill down to understand its performance over time. This enables them to quickly assess the impact of issues: from the impact on just one pipeline to much broader outages impacting many pipelines, if not the entire CI/CD platform.

Unify and scale observability with one-click integrations across complex, cloud-native infrastructure

Telemetry from infrastructure, applications, and user devices powers multiple use cases related to the delivery of exceptional and secure customer experience. Elastic Agent enables the collection of logs, metrics, traces, availability, and security data in a seamless and unified way.

With the 7.16 release of Elastic Observability:

  • Customers can now start leveraging the centralized management, scalability, security, and one-click integrations of the unified Elastic Agent across web, datastores, middleware, edge, and cloud-native infrastructure, covering the majority of observability use cases currently supported by Beats, including: Amazon Web Services (AWS), Apache, Docker, Google Cloud Platform (GCP), Kubernetes, MongoDB, MySQL, NATS, Nginx, Nginx Ingress Controller, Postgres, RabbitMQ, Redis, STAN, Tomcat, Traefik, and Zookeeper. Plus many more integrations for security use cases as well, all on a single platform.
  • Customers can collect and store data in indices that are more granular and require fewer fields per index, resulting in better organized data and faster search performance.
  • A new app in Kibana introduces a unified integrations view making it easier to discover all Elastic integrations and onboard data with one click. In addition, customers can reduce wasted storage and improve installation speed by installing only the integration components they need.

The APM Server integration for Elastic Agent and Fleet is now GA, providing an easier way to set up Elastic clusters to support APM use cases. This integration is a step towards better management of all monitoring components using Fleet.

Power collaboration across your workforce with Elastic and ServiceNow

By integrating Elastic Observability with ServiceNow, users can standardize and streamline incident management workflows to facilitate robust collaboration within and across ITOps and DevOps teams.

This is now easier than ever, thanks to newly certified apps on the ServiceNow Store for the ITSM, Security Incident Response (SIR), and ITOM workflow products. Upon connecting with one or more of these apps, Elastic users have two ways to automate the generation of incidents:

  • Case management integration (in technical preview for Observability) enables practitioners to escalate Elastic cases — including case details, data observables, analyst notes, and associated alarms — into ServiceNow incidents with just one click.
  • Alerting integration enables admins to configure forwarding of individual Elastic alerts to ServiceNow and automate the creation of corresponding ServiceNow incidents.

Standardize and streamline incident management workflows with Elastic’s newly certified apps in the ServiceNow store.

  • We're hiring

    Work for a global, distributed team where finding someone like you is just a Zoom meeting away. Flexible work with impact? Development opportunities from the start?