Elasticsearch for Apache Hadoop 2.2.0 m1


See issues on GitHub

Release Notes

Breaking changes

  • Remove Elasticsearch 0.90 support #525

New features

  • Elasticsearch 2.x compatibility #524

Enhancements

  • Close scroll queries #537
  • Override RDD count #526
  • Fix failing tests in JdkTypeToJsonTest #511 (issue: #494)
  • Improve node switching behaviour #505
  • Verify if multiple elasticsearch connector jars are available in the classpath #501
  • Fixing NPE on close in RestRepository #488 (issue: #487)
  • Upgrade to Gradle 2.6 #486

Bug fixes

  • Serialization of arrays fails in Scala #522
  • Support serializing arrays of primitives #521
  • Array support for Scala serialization #510
  • Update index.adoc #503
  • Load error from elasticsearch using Pig and the elasticsearch connector #499
  • ISO8601 dates with timezone offset considered invalid on SQL FILTER CLAUSE #495

Docs

  • Clarify compress option in configuration properties #535
  • auth.path instead of auth.pass and grammar #533
  • Change configuration order #523
  • HDSF backup restore no progress info #516
  • auth.path instead of auth.pass and grammar #490

Questions

  • Change field index to not analyzed #539
  • Check for getIndexAutoCreate on initSingleIndex #536
  • Pig-ES Integration for Nested objects #534
  • Writing data into elastic search through hive partition #532
  • build issue with Gradle 2.5 #531
  • Pig-Joda-Date Format Error #519
  • java.lang.ClassCastException: scala.coll ection.Iterator$$anon$11 cannot be cast to scala.Tuple2 #518
  • Mapping hive field to elastic geo_shape type #517
  • Indexing logs with elasticsearch #514
  • java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation when starting spark #506
  • es.mapping.pig.tuple.use.field.names ignored #500
  • sc.esRDD(...) how to specific ElasticSearch IP address? #496
  • Unable to insert data into ES from Hive - Cannot determine write shards #467
  • Hive cannot read @timestamp from ES which format is unix time #452
  • Spark --packages problem regarding dependencies #447
  • Java Error - java.io.IOException LongWritable #444