IMPORTANT: No additional bug fixes or documentation updates
will be released for this version. For the latest information, see the
current release documentation.
Kafka partition metricset
editKafka partition metricset
editThis is the partition metricset of the Kafka module.
Configuration
editAs the partition metricset fetches the data from the complete Kafka cluster, only one connection host has to be defined. Currently if multiple hosts are defined, the data is fetched multiple times. Support for multiple initial connections host is planned to be added in future releases.
Metricset
editThe current implementation of the partition metricset fetches the data for all leader partitions. Data for the replicas is not available yet.
This is a default metricset. If the host module is unconfigured, this metricset is enabled by default.
Fields
editFor a description of each field in the metricset, see the exported fields section.
Here is an example document generated by this metricset:
{
"@timestamp": "2017-10-12T08:05:34.853Z",
"beat": {
"hostname": "host.example.com",
"name": "host.example.com"
},
"kafka": {
"broker": {
"address": "172.18.0.2:9092",
"id": 0
},
"partition": {
"broker": {
"address": "172.18.0.2:9092",
"id": 0
},
"id": 0,
"offset": {
"newest": 0,
"oldest": 0
},
"partition": {
"id": 0,
"insync_replica": true,
"is_leader": true,
"leader": 0,
"replica": 0
},
"topic": {
"name": "foo-1538389014-739473801"
},
"topic_broker_id": "0-foo-1538389014-739473801-0",
"topic_id": "0-foo-1538389014-739473801"
},
"topic": {
"name": "foo-1538389014-739473801"
}
},
"metricset": {
"host": "kafka:9092",
"module": "kafka",
"name": "partition",
"rtt": 115
}
}