Metrics

오픈 소스 메트릭 분석

드론 센서 데이터부터 CPU 사용량에 이르기까지, Elasticsearch는 사용자들이 선호하는 데이터들과 처음부터 끊임 없는 이야기를 해 왔습니다. 텍스트 검색 기능의 강점을 파악하였고 그 능력을 수치 데이터 분석에 반영 해 왔으며 계속해서 발전하고 있습니다.

Experience metrics analysis with Elastic. Try It Out

나만의 방식으로 수치 데이터 탐험을 떠나보세요

차원, 태그, 카디널리티, 필드들를 자유롭게 탐색하세요. Elastic은 데이터 탐색 방식을 제한하거나 지시하지 않습니다. 그 대신 호스트명, IP 주소, 배포, 색상과 같은 속성을 어떤 규모에서나 원하는 순서대로 연속해서 빠르게 탐색하고, 원하는 방식으로 시각화하여 표시할 수 있습니다.

이토록 숫자를 다루는 데에 뛰어난 검색엔진이 있는 줄 모르셨다고요? 자, 이제 아셨을겁니다.
이후 내용은 건너뛰고 바로 시작하기.

여러분이 원하던 바로 그 속도와 스케일입니다

이 목표를 달성하기 위해 저희는 역 색인(inverted index)을 넘어서야만 했습니다. 저희는 BKD tree를 상속받는 새로운 자료구조를 만들었고, column store 를 추가했습니다. 이 모든 작업들을 통해 매우 효율적인 구조의 데이터를 얻을 수 있었으며, 검색 속도가 향상되고 메모리 및 디스크 사용량을 감소하였습니다. 다시 말하면, 페타바이트 규모의 데이터에서 놀라운 속도로 필드값에 접근이 가능합니다.

시작 해 보세요

이제 최신 버전을 설치하고 바로 시작 해 보세요.
In Elasticsearch install directory:
Ctrl + C to Copy
In Kibana install directory:
Ctrl + C to Copy
In Metricbeat install directory:
Ctrl + C to Copy

To modify defaults, edit modules.d/system.yml.

What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing CPU and memory utilization, and process-level statistics.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

In Elasticsearch install directory:
Ctrl + C to Copy
In Kibana install directory:
Ctrl + C to Copy
In Metricbeat install directory:
Ctrl + C to Copy
Ctrl + C to Copy

To modify defaults, edit modules.d/apache.yml.

What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing connection statistics and HTTP worker details.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

In Elasticsearch install directory:
Ctrl + C to Copy
In Kibana install directory:
Ctrl + C to Copy
In Metricbeat install directory:
Ctrl + C to Copy
Ctrl + C to Copy

To modify defaults, edit modules.d/mongodb.yml.

What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing data statistics, health and status information about your MongoDB deployment.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

In Elasticsearch install directory:
Ctrl + C to Copy
In Kibana install directory:
Ctrl + C to Copy
In Metricbeat install directory:
Ctrl + C to Copy
Ctrl + C to Copy

To modify defaults, edit modules.d/docker.yml.

What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing data statistics, health and status information about your Docker deployment.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

In Elasticsearch install directory:
Ctrl + C to Copy
In Kibana install directory:
Ctrl + C to Copy
In Filebeat install directory:
Ctrl + C to Copy
Ctrl + C to Copy
From your machine or wherever you run kubectl:
  • Download metricbeat-kubernetes.yml
  • Edit metricbeat-kubernetes.yml and specify the host for your Elasticsearch server (If you are connecting back to your host from kubernetes running locally then set ELASTICSEARCH_HOST to host.docker.internal). There is a DaemonSet and a singleton, edit the HOST for both:
  - name: ELASTICSEARCH_HOST
    value: host.docker.internal
			

Optionally, you can enable kube-state-metrics for more detail.

Ctrl + C to Copy
What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can monitor your Kubernetes cluster.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

In Elasticsearch install directory:
Ctrl + C to Copy
In Kibana install directory:
Ctrl + C to Copy
In Heartbeat install directory:
Ctrl + C to Copy
What just happened?

Heartbeat is designed to do distributed uptime checks from each of your hosts to ensure that they can each reach every endpoint they are supposed to. This is amazing for service-oriented architectures. In this case, you've asked Heartbeat to check the uptime for the two local ports corresponding to the Elasticsearch and Kibana defaults. Heartbeat then sends this data to Elasticsearch and you can see the data in the Kibana dashboard.

Didn't work for you?

Heartbeat was set to use the default ports for Elasticsearch and Kibana in this example. See the documentation for configuration options.

  • Register, if you do not already have an account
  • Log into the Elastic Cloud console
To create a cluster, in Elastic Cloud console:
  • Select Create Cluster, leave cluster size slider at 4 GB RAM, and click Create
  • Note the Cloud ID as <cloud.id> and the cluster Password as <password>
  • In Overview >> Endpoints section note Kibana URL as <kibana_url>
  • Wait until cluster plan completes

Download and unpack Metricbeat

In Metricbeat install directory:

Paste in the <password> for the elastic user when prompted

To modify defaults, edit modules.d/system.yml.

Open browser @
<kibana_url> (login: elastic/<password>)
Open dashboard:
"[Metricbeat System] Overview"
What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing CPU and memory utilization, and process-level statistics.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

  • Register, if you do not already have an account
  • Log into the Elastic Cloud console
To create a cluster, in Elastic Cloud console:
  • Select Create Cluster, leave cluster size slider at 4 GB RAM, and click Create
  • Note the Cloud ID as <cloud.id> and the cluster Password as <password>
  • In Overview >> Endpoints section note Kibana URL as <kibana_url>
  • Wait until cluster plan completes

Download and unpack Metricbeat

In Metricbeat install directory:

Paste in the <password> for the elastic user when prompted

To modify defaults, edit modules.d/apache.yml.

Open browser @
<kibana_url> (login: elastic/<password>)
Open dashboard:
"[Metricbeat Apache] Overview"
What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing connection statistics and HTTP worker details.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

  • Register, if you do not already have an account
  • Log into the Elastic Cloud console
To create a cluster, in Elastic Cloud console:
  • Select Create Cluster, leave cluster size slider at 4 GB RAM, and click Create
  • Note the Cloud ID as <cloud.id> and the cluster Password as <password>
  • In Overview >> Endpoints section note Kibana URL as <kibana_url>
  • Wait until cluster plan completes

Download and unpack Metricbeat

In Metricbeat install directory:

Paste in the <password> for the elastic user when prompted

To modify defaults, edit modules.d/mongodb.yml.

Open browser @
<kibana_url> (login: elastic/<password>)
Open dashboard:
"[Metricbeat MongoDB] Overview"
What just happened?

Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing data statistics, health and status information about your MongoDB deployment.

Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

  • Register, if you do not already have an account
  • Log into the Elastic Cloud console
To create a cluster, in Elastic Cloud console:
  • Select Create Cluster, leave cluster size slider at 4 GB RAM, and click Create
  • Note the Cloud ID as <cloud.id> and the cluster Password as <password>
  • In Overview >> Endpoints section note Kibana URL as <kibana_url>
  • Wait until cluster plan completes

Download and unpack Metricbeat

In Metricbeat install directory:

Paste in the <password> for the elastic user when prompted

To modify defaults, edit modules.d/docker.yml.

Open browser @
<kibana_url> (login: elastic/<password>)
Open dashboard:
"[Metricbeat Docker] Overview"
What just happened?
Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can start viewing data statistics, health and status information about your Docker deployment.
Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

  • Register, if you do not already have an account
  • Log into the Elastic Cloud console
To create a cluster, in Elastic Cloud console:
  • Select Create Cluster, leave cluster size slider at 4 GB RAM, and click Create
  • Note the Cloud ID as <cloud.id> and the cluster Password as <password>
  • In Overview >> Endpoints section note Kibana URL as <kibana_url>
  • Wait until cluster plan completes

Download and unpack Metricbeat

In Metricbeat install directory:

Paste in the <password> for the elastic user when prompted

From your machine or wherever you run kubectl:

env:
  - name: ELASTIC_CLOUD_ID
    value: <cloud.id>
  - name: ELASTIC_CLOUD_AUTH
    value: <cloud.auth>
				

Optionally, you can enable kube-state-metrics for more detail.

Open browser @
<kibana_url> (login: elastic/<password>)
Open dashboard:
"[Metricbeat Kubernetes] Overview"
What just happened?
Metricbeat created an index pattern in Kibana with defined fields, searches, visualizations, and dashboards. In a matter of minutes you can monitor your Kubernetes cluster.
Didn't work for you?

Metricbeat modules have defaults and configurations for each system they connect to. See the documentation for supported versions and configuration options.

  • Register, if you do not already have an account
  • Log into the Elastic Cloud console
To create a cluster, in Elastic Cloud console:
  • Select Create Cluster, leave cluster size slider at 4 GB RAM, and click Create
  • Note the Cloud ID as <cloud.id> and the cluster Password as <password>
  • In Overview >> Endpoints section note Kibana URL as <kibana_url>
  • Wait until cluster plan completes

Download and unpack Heartbeat (Beta)

In Heartbeat install directory:

Paste in the <password> for the elastic user when prompted

Open browser @
<kibana_url> (login: elastic/<password>)
Open dashboard:
"[Heartbeat] HTTP Monitoring"
What just happened?

Heartbeat is designed to do distributed uptime checks from each of your hosts to ensure that they can each reach every endpoint they are supposed to. This is amazing for service-oriented architectures. In this case, you've asked Heartbeat to check the uptime for the two local ports corresponding to the Elasticsearch and Kibana defaults. Heartbeat then sends this data to Elasticsearch and you can see the data in the Kibana dashboard.

Didn't work for you?

Heartbeat was set to use the default ports for Elasticsearch and Kibana in this example. See the documentation for configuration options.

이상 징후 탐지를 위해 머신러닝 작업을 가동하세요

데이터의 규모가 커질수록 데이터의 평균, 측정치, 총 합계 등에 대한 정확성을 잃어버리기 쉽습니다. 그리고 시각화 도구만을 사용해서 모든것들을 분석하기란 사실상 불가능합니다. (우리 모두는 단지 사람일 뿐입니다.)

Elastic Stack의 머신러닝 기능은 이상징후의 탐지와 확장을 가능하게 합니다. 여러분의 데이터에서 정상값과 비정상 값을 스스로 구분하여 그것들을 알려줍니다.

슈퍼컴퓨터들 조차도 Elastic을 사용합니다

160GB에 이르는 12억 건의 도큐먼트. 미 국립 에너지 연구 과학 컴퓨팅 센터(NERSC)가 하루에 수집하는 데이터 양입니다. 이 센터는 끊임 없는 과학의 진보를 위해 변전소 전력 소비량 KPI부터 건물의 공기 및 물 온도, 컴퓨터 디스크 및 네트워크 I/O, 시스템 부하까지, 모든 유형의 메트릭을 색인합니다.

Elastic으로 수치 데이터를 다루는 곳은 여기 뿐만이 아닙니다. 더욱 많은 또다른 사례를 확인하세요.

메트릭은 더 큰 여정을 위한 하나의 시작점일 뿐입니다

네트워크 데이터가 있습니까? 인프라 로그를 사용중이신가요? 수많은 텍스트 문서를 처리해야 하나요? 이 모든 것들을 Elastic Stack으로 통합하여 분석을 확장하고, 워크플로우를 간소화하며, 아키텍처를 단순화하세요.

로그분석

빠르고 확장 가능하며 중단되지 않는 실시간 로깅.

더 보기

사이트 검색

손쉽게 만들고 추가하는 사이트 검색의 경험.

더 보기

보안 분석

빠르고 확장 가능한 상호 교환형 정보 수색.

더 보기

APM

애플리케이션 성능에 대한 통찰력 강화.

더 보기

앱 검색

문서, 위치정보 및 그 이상의 검색.

더 보기