Elasticsearch for Apache Hadoop 2.2.0 rc1


See issues on GitHub

Release Notes

Enhancements

  • Update repository HDFS to ES 2.1 #651
  • Hostname needs to be resolved to an IP #640
  • Improve creation of TrustManagers in SSL configuration #611
  • Allow YARN specific parameters to be specified #520
  • Improve date handling through Java 8/Java.time/Joda #508
  • Compressed snapshot for backing up and restoring #646
  • Upgrade to Spark 1.6 #645
  • how to use elasticsearch-spark to connect to elasticsearch server behind a proxy server #643
  • if nodeIp has '/' and the form /, just return . #641
  • IP Address badly parsed in org.elasticsearch.hadoop.serialization.dto.Node #630
  • Exception in thread "main" org.apache.spark.SparkException: Task not serializable #627
  • Resolve IP Address for spark.es.nodes param #623
  • Not able to process into Elasticsearch Found #622
  • repository-hdfs: elasticsearch 2.1.0 support #620
  • how to achieve a long live connections using spark api #619
  • SELECT * FROM tabletest WHERE col1 IN (0,10,5,27 ) #615
  • Hive loading data into ES error: org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection error (check network and/or proxy settings)- all nodes failed #606
  • [SPARK] SparkContextFunctions.esRDD parameters #604 (issue: #592)
  • Exception org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest with Spark 1.5.1, ES 2.0 and v2.2.0-beta1 #603
  • a question with hive-es issue #601
  • Not specifying containers throws Exception #598
  • Too many requests? #594
  • Issue with Spark 1.5.1: es-hadoop "Connection error (check network and/or proxy settings)- all nodes failed" #591
  • java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException #586
  • ClassNotFoundException: EsHadoopNoNodesLeftException #585
  • Unable to connect to my ElasticSearch server using HTTP Basic Auth #568
  • Expand YARN configuration options #471

Bug fixes

  • Spark: saveToEs can evaluate the RDD twice #631
  • Release of elasticsearch-repository-hdfs plugin for 2.1.0 elastic version #621
  • SimpleHttpConnectionManager problem with elasticsearch-hadoop-2.1.2.jar on Spark #618
  • 2.2.0-beta1 and Elasticsearch 2.0 transport error #614
  • Getting PermGen space issues when building latest master #596
  • es.field.read.as.array.include only works one level deep #589
  • Parsing of argument fails #509

Docs

  • Trouble writing to elasticsearch 2.0, spark 1.5 #610
  • installation instruction does not work #609
  • [DOCS] Possible typo Apache Spark vs. Apache Storm #600
  • ES-HADOOP and ES V2? #597
  • [DOCS] Possible typo Apache Spark vs. Apache Storm #588