Google Cloud Platform storage metricsetedit

This functionality is in beta and is subject to change. The design and code is less mature than official GA features and is being provided as-is with no warranties. Beta features are not subject to the support SLA of official GA features.

Storage metricset fetches metrics from Storage in Google Cloud Platform.

The storage metricset contains all metrics exported from the GCP Storage Monitoring API. The field names have been left untouched for people already familiar with them.

You can specify a single region to fetch metrics like us-central1. Be aware that GCP Storage does not use zones so us-central1-a will return nothing. If no region is specified, it will return metrics from all buckets.

Metricsedit

Here is a list of metrics collected by storage metricset:

  • storage.api.request_count: Delta count of API calls, grouped by the API method name and response code.
  • storage.authz.acl_based_object_access_count: Delta count of requests that result in an object being granted access solely due to object ACLs.
  • storage.authz.acl_operations_count: Usage of ACL operations broken down by type.
  • storage.authz.object_specific_acl_mutation_count: Delta count of changes made to object specific ACLs.
  • storage.network.received_bytes_count: Delta count of bytes received over the network, grouped by the API method name and response code.
  • storage.network.sent_bytes_count: Delta count of bytes sent over the network, grouped by the API method name and response code.
  • storage.storage.object_count: Total number of objects per bucket, grouped by storage class. This value is measured once per day, and the value is repeated at each sampling interval throughout the day.
  • storage.storage.total_byte_seconds: Delta count of bytes received over the network, grouped by the API method name and response code.
  • storage.storage.total_bytes: Total size of all objects in the bucket, grouped by storage class. This value is measured once per day, and the value is repeated at each sampling interval throughout the day.

Fieldsedit

For a description of each field in the metricset, see the exported fields section.

Here is an example document generated by this metricset:

{
    "@timestamp": "2017-10-12T08:05:34.853Z",
    "cloud": {
        "account": {
            "id": "elastic-apm"
        },
        "provider": "gcp"
    },
    "event": {
        "dataset": "gcp.storage",
        "duration": 115000,
        "module": "gcp"
    },
    "gcp": {
        "labels": {
            "metrics": {
                "storage_class": "MULTI_REGIONAL"
            },
            "resource": {
                "bucket_name": "artifacts.elastic-apm.appspot.com",
                "location": "us"
            }
        },
        "storage": {
            "storage": {
                "object_count": {
                    "value": 15
                }
            }
        }
    },
    "metricset": {
        "name": "storage",
        "period": 10000
    },
    "service": {
        "type": "gcp"
    }
}