With a native integration and a rich query API, ES-Hadoop lets you index data directly into Elasticsearch from Hadoop, query Elasticsearch from Hadoop, and use HDFS as a long-term archive for Elasticsearch.
While Hadoop lets you batch, join, and analyze to your heart’s content, its queries aren’t the quickest. ES-Hadoop changes that by providing a bridge for index your Hadoop data into Elasticsearch, letting you take full advantage of its querying speed and get value from it faster than ever before.
Elasticsearch is a powerful search and analytics engine, fully-loaded with a variety of aggregations. ES-Hadoop is an easy way for you to index your Hadoop data into Elasticsearch and analyze (even visualize!) while you search.
Manage who has access to your data and prevent snooping over the wire to preserve data confidentiality. ES-Hadoop's enhanced security includes basic HTTP authentication, support for SSL/TLS for connections between Elasticsearch and Hadoop clusters, and also works with Kerberos-enabled Hadoop and Shield-enabled Elasticsearch clusters.
We are official partners with Cloudera, Mapr, Hortonworks, Databricks, and Concurrent, so whether you're using vanilla Hadoop or other distributions, we've got you covered. We are certified on Cloudera Enterprise 5 and Certified Technology Partners with Hortonworks.
The Hadoop ecosystem is rich with computing frameworks — ES-Hadoop lets you use Elasticsearch with many of them. We provide a dedicated Input and Output format for vanilla MapReduce, taps for reading and writing data in Cascading, storage handlers for Pig, table extensions for Hive, Spark Resilient Distributed Dataset (RDD) for Java and Scala, and support for Storm’s bolt and spout abstractions so you can access Elasticsearch just as if the data were in HDFS.
Elasticsearch works with Kibana to help you visually explore your big data in real time. With beautifully designed graphs, charts, and maps, Kibana transforms your data into real-time, customizable dashboards that let you see the value in your data.