Elasticsearch is an industry-leading solution for search and real-time analytics at scale. Apache Spark has shaped into a powerhouse for processing massive data, both in batch and streaming contexts. Elasticsearch for Apache Hadoop (ES-Hadoop) is a two-way connector that provides the tools needed to marry these two together in perfect data harmony.
This talk aims to introduce the audience to the basics of ES-Hadoop’s native Spark Integration, touch upon the other features that the connector brings to the table (including native integrations with Hive, Storm, Pig, Cascading, and MapReduce), shed some light on the internals of how it works, as well as highlight what’s to come.
Senior Software Engineer