IMPORTANT: No additional bug fixes or documentation updates will be released for this version. For the latest information, see the current release documentation.

› › ›

Airflow statsd metricset

edit

Airflow statsd metricset

edit

This functionality is in beta and is subject to change. The design and code is less mature than official GA features and is being provided as-is with no warranties. Beta features are not subject to the support SLA of official GA features.

Statsd Metricset retrieves the Airflow metrics using Statsd.

This is a default metricset. If the host module is unconfigured, this metricset is enabled by default.

Fields

For a description of each field in the metricset, see the exported fields section.

Here is an example document generated by this metricset:

{
    "@timestamp": "2017-10-12T08:05:34.853Z",
    "airflow": {
        "dag_duration": {
            "15m_rate": 0.2,
            "1m_rate": 0.2,
            "5m_rate": 0.2,
            "count": 1,
            "max": 200,
            "mean": 200,
            "mean_rate": 0.2222490946071946,
            "median": 200,
            "min": 200,
            "p75": 200,
            "p95": 200,
            "p99": 200,
            "p99_9": 200,
            "stddev": 0
        },
        "dag_id": "a_dagid",
        "status": "failure"
    },
    "event": {
        "dataset": "statsd",
        "module": "airflow"
    },
    "labels": {
        "k1": "v1",
        "k2": "v2"
    },
    "service": {
        "type": "airflow"
    }
}

« Airflow module Apache module »