File Log OpenTelemetry Input Package
| Version | 0.2.0
|
| Subscription level What's this? |
Basic |
| Developed by What's this? |
Elastic |
| Minimum Kibana version(s) | 9.2.0 |
To use beta integrations, go to the Integrations page in Kibana, scroll down, and toggle on the Display beta integrations option.
The File Log OpenTelemetry Input Package for Elastic enables collection of logs from files through OpenTelemetry protocols using the filelogreceiver.
This package tails and parses logs from files by configuring file glob patterns in the Input Package, which then gets applied to the filelogreceiver present in the EDOT collector, which then forwards the data to Elastic Agent. The Elastic Agent processes and enriches the data before sending it to Elasticsearch for indexing and analysis.
Key fields are stored following Semantic Conventions for logs, among them:
| Field Name | Description |
|---|---|
| message | Collected log line. |
| log.file.name | File name. |
| log.file.path | File path. |
This integration can be used to collect custom log files.
Elastic Agent must be installed. For more details, check the Elastic Agent installation instructions. You can install only one Elastic Agent per host.
Elastic Agent is required to have permissions to read the monitored files.
This integration needs to be configured with the glob patterns of the files to collect. The include parameter is required and specifies the file glob patterns to read.
Once configured, you can find documents with the content of the collected log files.
For the full list of settings exposed for the receiver and examples, refer to the configuration section.
For help with Elastic ingest tools, check Common problems.
For more information on architectures that can be used for scaling this integration, check the Ingest Architectures documentation.
This package uses the File Log Receiver of the OTel Collector.
Changelog
| Version | Details | Minimum Kibana version |
|---|---|---|
| 0.2.0 | Enhancement (View pull request) Add missing filelogreceiver configuration parameters including multiline, encoding, file attributes, and performance settings. |
9.2.0 |
| 0.1.0 | Enhancement (View pull request) Initial version of the package |
9.2.0 |