IMPORTANT: No additional bug fixes or documentation updates will be released for this version. For the latest information, see the current release documentation.
« Google Cloud Platform billing metricset Google Cloud Platform loadbalancing metricset »
Elastic Docs ›Metricbeat Reference [7.12] ›Modules ›Google Cloud Platform module

Google Cloud Platform compute metricset

edit

Google Cloud Platform compute metricset

edit

This functionality is in beta and is subject to change. The design and code is less mature than official GA features and is being provided as-is with no warranties. Beta features are not subject to the support SLA of official GA features.

Compute metricset to fetch metrics from Compute Engine Virtual Machines in Google Cloud Platform. No Monitoring or Logging agent is required in your instances to use this metricset.

The compute metricset contains all metrics exported from the Stackdriver API. The field names have been left untouched for people already familiar with them.

Extra labels and metadata are also extracted using the Compute API. This is enough to get most of the info associated with a metric like Compute labels and metadata and metric specific Labels.

Metrics and labels

edit

Here is a list of metrics collected by compute metricset:

firewall

edit

  • instance.firewall.dropped_bytes_count: Incoming bytes dropped by the firewall.

    • instance_name: The name of the VM instance.

  • instance.firewall.dropped_packets_count: Incoming packets dropped by the firewall.

    • instance_name: The name of the VM instance.

cpu

edit

  • instance.cpu.reserved_cores: Number of cores reserved on the host of the instance.

    • instance_name: The name of the VM instance.

  • instance.cpu.utilization: The fraction of the allocated CPU that is currently in use on the instance.

    • instance_name: The name of the VM instance.

  • instance.cpu.usage_time: Usage for all cores in seconds.

    • instance_name: The name of the VM instance.

disk

edit

  • instance.disk.read_bytes_count: Count of bytes read from disk.

    • instance_name: The name of the VM instance.
    • device_name: The name of the disk device.
    • storage_type: The storage type: pd-standard, pd-ssd, or local-ssd.
    • device_type: The disk type: ephemeral or permanent.

  • instance.disk.read_ops_count: Count of disk read IO operations.

    • instance_name: The name of the VM instance.
    • device_name: The name of the disk device.
    • storage_type: The storage type: pd-standard, pd-ssd, or local-ssd.
    • device_type: The disk type: ephemeral or permanent.

  • instance.disk.write_bytes_count: Count of bytes written to disk

    • instance_name: The name of the VM instance.
    • device_name: The name of the disk device.
    • storage_type: The storage type: pd-standard, pd-ssd, or local-ssd.
    • device_type: The disk type: ephemeral or permanent.

  • instance.disk.write_ops_count: Count of disk write IO operations.

    • instance_name: The name of the VM instance.
    • device_name: The name of the disk device.
    • storage_type: The storage type: pd-standard, pd-ssd, or local-ssd.
    • device_type: The disk type: ephemeral or permanent.

uptime

edit

  • instance.uptime: How long the VM has been running, in seconds

    • instance_name: The name of the VM instance.

network

edit

  • instance.network.received_bytes_count: Count of bytes received from the network

    • instance_name: The name of the VM instance.
    • loadBalanced: Whether traffic was sent from an L3 loadbalanced IP address assigned to the VM. Traffic that is externally routed from the VM’s standard internal or external IP address, such as L7 loadbalanced traffic, is not considered to be loadbalanced in this metric.

  • instance.network.received_packets_count: Count of packets received from the network

    • instance_name: The name of the VM instance.
    • loadBalanced: Whether traffic was sent from an L3 loadbalanced IP address assigned to the VM. Traffic that is externally routed from the VM’s standard internal or external IP address, such as L7 loadbalanced traffic, is not considered to be loadbalanced in this metric.

  • instance.network.sent_bytes_count: Count of bytes sent over the network

    • instance_name: The name of the VM instance.
    • loadBalanced: Whether traffic was sent from an L3 loadbalanced IP address assigned to the VM. Traffic that is externally routed from the VM’s standard internal or external IP address, such as L7 loadbalanced traffic, is not considered to be loadbalanced in this metric.

  • instance.network.sent_packets_count: Count of packets sent over the network

    • instance_name: The name of the VM instance.
    • loadBalanced: Whether traffic was sent from an L3 loadbalanced IP address assigned to the VM. Traffic that is externally routed from the VM’s standard internal or external IP address, such as L7 loadbalanced traffic, is not considered to be loadbalanced in this metric.

memory

edit

  • instance.memory.balloon.ram_size: The total amount of memory in the VM. This metric is only available for VMs that belong to the e2 family.

    • instance_name: The name of the VM instance.

  • instance.memory.balloon.ram_used: Memory currently used in the VM. This metric is only available for VMs that belong to the e2 family.

    • instance_name: The name of the VM instance.

  • instance.memory.balloon.swap_in_bytes_count: The amount of memory read into the guest from its own swap space. This metric is only available for VMs that belong to the e2 family.

    • instance_name: The name of the VM instance.

  • instance.memory.balloon.swap_out_bytes_count: The amount of memory written from the guest to its own swap space. This metric is only available for VMs that belong to the e2 family.

    • instance_name: The name of the VM instance.

This is a default metricset. If the host module is unconfigured, this metricset is enabled by default.

Fields

edit

For a description of each field in the metricset, see the exported fields section.

Here is an example document generated by this metricset:

{
    "@timestamp": "2017-10-12T08:05:34.853Z",
    "cloud": {
        "account": {
            "id": "elastic-observability",
            "name": "elastic-observability"
        },
        "instance": {
            "id": "8358623250631840944",
            "name": "rhodes-spacetime-1"
        },
        "machine": {
            "type": "e2-micro"
        },
        "provider": "gcp"
    },
    "cloud.availability_zone": "us-central1-a",
    "cloud.region": "us-central1",
    "event": {
        "dataset": "gcp.compute",
        "duration": 115000,
        "module": "gcp"
    },
    "gcp": {
        "compute": {
            "instance": {
                "network": {
                    "received_bytes_count": {
                        "value": 49837
                    },
                    "received_packets_count": {
                        "value": 229
                    },
                    "sent_bytes_count": {
                        "value": 1018967
                    },
                    "sent_packets_count": {
                        "value": 752
                    }
                }
            }
        },
        "labels": {
            "metrics": {
                "loadbalanced": "false"
            },
            "user": {
                "created-by": "ks"
            }
        }
    },
    "host": {
        "id": "8358623250631840944",
        "name": "rhodes-spacetime-1",
        "network": {
            "in": {
                "bytes": 1018967,
                "packets": 752
            },
            "out": {
                "bytes": 49837,
                "packets": 229
            }
        }
    },
    "metricset": {
        "name": "compute",
        "period": 10000
    },
    "service": {
        "type": "gcp"
    }
}
« Google Cloud Platform billing metricset Google Cloud Platform loadbalancing metricset »