Amazon Kinesis Data Firehose overviewedit

Elastic Cloud users can ingest logs directly from AWS Kinesis Data Firehose.

AWS Kinesis Data Firehose works with Elastic Stack version 7.17 or greater, running on Elastic Cloud only.

What is Amazon Kinesis Data Firehose?edit

Amazon Kinesis Data Firehose is an extract, transform, and load (ETL) service that reliably captures, transforms, and delivers streaming data to data lakes, data stores, and analytics services.

Using Firehose to send your data to Elastic means you have no agents to deploy, lambdas to configure, or Beats to manage. Pricing is simple, predictable, and typically more cost-effective than other data ingest solutions. Additionally, auto-scaling capability is built in, and the service is designed to handle high-volume use cases.

The overall architecture is shown below.

Diagram showing Amazon Kinesis Data Firehose connected to Elastic Cloud with examples of input data sources