Amazon Kinesis Data Firehose overviewedit

Elastic Cloud users can ingest logs directly from AWS Kinesis Data Firehose. All Elastic AWS integrations are supported without deploying agents to your AWS account. Logs from AWS Kinesis Data Firehose can be automatically routed to the relevant Elastic integration for popular AWS services with no additional configuration.

AWS Kinesis Data Firehose works with Elastic Stack version 7.17 or greater, running on Elastic Cloud only.

What is Amazon Kinesis Data Firehose?edit

Amazon Kinesis Data Firehose is an extract, transform, and load (ETL) service that reliably captures, transforms, and delivers streaming data to data lakes, data stores, and analytics services.

Using Firehose to send your data to Elastic means you have no agents to deploy, lambdas to configure, or Beats to manage. Pricing is simple, predictable, and typically more cost-effective than other data ingest solutions. Additionally, auto-scaling capability is built in, and the service is designed to handle high-volume use cases.

The overall architecture is shown below.

Diagram showing Amazon Kinesis Data Firehose connected to Elastic Cloud with examples of input data sources