With a native integration and a rich query API, ES-Hadoop lets you index data directly into Elasticsearch from Hadoop, query Elasticsearch from Hadoop, and use HDFS as a long-term archive for Elasticsearch.
While Hadoop lets you batch, join, and analyze to your heart’s content, its queries aren’t the quickest. ES-Hadoop changes the game by providing a bridge to index your Hadoop data into Elasticsearch, letting you take full advantage of its querying speed, variety of aggregation capabilities, and ability to derive value from it faster than ever.
Hadoop has an expansive ecosystem and ES-Hadoop interacts natively with your favorite components. Leverage ES-Hadoop to enhance your machine learning use cases by harmonizing Elasticsearch with Spark Resilient Distributed Datasets (RDD) and DataFrames, federate queries across Elasticsearch and HDFS with Hive, and connect directly with various other popular systems like Storm, Pig, Cascading, and standard MapReduce.
Elasticsearch works with Kibana to help you visually explore your big data in real time. With beautifully designed graphs, charts, and maps, Kibana transforms your data into real-time, customizable dashboards with deep insights.
Manage who has access to your data and prevent snooping over the wire to preserve data confidentiality. ES-Hadoop's enhanced security includes basic HTTP authentication, support for SSL/TLS for connections between Elasticsearch and Hadoop clusters, and also works with Kerberos-enabled Hadoop and Shield-enabled Elasticsearch clusters.
We are official partners with Cloudera, Mapr, Hortonworks, Databricks, and Concurrent, so whether you're using vanilla Hadoop or other distributions, we've got you covered. We are certified on Cloudera Enterprise 5 and Certified Technology Partners with Hortonworks.