This Week in Elasticsearch - January 22, 2014

Welcome to  This week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.

Elasticsearch core

  • The Elasticsearch 1.0 branch has been cut and will be used for the upcoming 1.0 release and related enhancements. The 1.x branch has been added as well for future development, still related the 1.x major versions. The next major version of Elasticsearch (2.0) will be developed on master. No changes have been made to the 0.90 branch.
  • Added ability to setup custom _all fields (#4520, master, 1.x and 1.0)
  • Added the ability to retrieve fields from the field data cache (#4492, master, 1.x and 1.0)
  • Added local flag support to all the cluster state read operations that get executed on the master node (#3345, master, 1.x and 1.0)
  • Tribe nodes automatically execute cluster state read operations locally (commit, master, 1.x and 1.0)
  • Optimized histogram aggregations through a finer-grained values rounding (#4800, master and 1.x)
  • Terms aggregations returns now all terms by setting its size to <code>0 (#4837, master and 1.x)
  • DateHistogramBuilder supports now setting a value for <code>min_doc_count (#4848, master, 1.x and 1.0)
  • Deprecated partial_fields in favor of source filtering (#4118, master, 1.x and 1.0)
  • Added ability to configure circuit breaker with a percentage (#4616, master, 1.x and 1.0)
  • Many commits relate to the REST spec and tests: the test coverage for the REST layer has been remarkably improved, and those same test suites are used to test all our official clients too (e.g. commit 1 and commit 2)
  • Improved detection of hot threads (#4775, master, 1.x, 1.0 and 0.90)
  • Removed omit_term_freq_and_positions for new indices, deprecated since 0.20 (#4722, master, 1.x and 1.0)
  • Fixed timestamp column regression in cat api (#4782, master, 1.x and 1.0)
  • Made sure that filters that wrap parent/child filters are never cached (#4757, master, 1.x, 1.0 and 0.90)
  • Made sure that filters that use the now date math expression are never cached (#4846, master, 1.x, 1.0 and 0.90)
  • Fixed a bug that caused a scroll search to return no hits on 2nd or consecutive requests when using has_child or has_parent filters (#4703, master, 1.x, 1.0 and 0.90)
  • Fixed IndexOutOfBoundsException while indexing empty JSON document (#4771, master, 1.x, 1.0 and 0.90)
  • The master_timeout parameter is now taken into account when calling the cluster pending tasks api through the REST layer (#4806, master, 1.x and 1.0)
  • Made sure that the same boolean values are accepted by all RestRequest methods (#4808, master, 1.x, 1.0 and 0.90)
  • Fixed logging on immediate exit on start (#4805, master, 1.x, 1.0 and 0.90)
  • No results are now returned instead of an error when executing an empty query_string (#3952, master, 1.x, 1.0 and 0.90)
  • Made sure a merge mapping conflict gets returned when trying to enable or disable norms (#4761, master, 1.x and 1.0)
  • Added page tracking to MockPageCacheRecycler (#4814, master, 1.x and 1.0)
  • Fixed inconsistency between how the omit_norms option is parsed and serialized (#4760, master, 1.x and 1.0)
  • Fixed a bug that prevented rivers from getting started when using index templates that match the _river index (#4577, master, 1.x, 1.0 and 0.90)
  • Unified RestRequest <code>paramAsBoolean and paramAsBooleanOptional methods (#4817, master, 1.x and 1.0)
  • Added search_type randomization to <code>ElasticsearchIntegrationTest, to make sure DFS_QUERY_THEN_FETCH is tested too (#4793, master, 1.x and 1.0)
  • Upgraded to guava 16.0 (commit, master, 1.x, 1.0 and 0.90)
  • Improved error handling when trying to allocate a shard on a non-data node (#4833, master, 1.x, 1.0 and 0.90)

Elasticsearch Ecosystem

Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, and news about Logstash and Kibana.

Slides & Videos


Jordan Sissel's slides from the Inaugural Elasticsearch Los Angeles Meetup

Zachary Tong's presentation on Query Optimization from the Inaugural Elasticsearch Atlanta Meetup

Where to find Us

We'd love to feature all the great Elasticsearch presentations happening worldwide in this section. If you're speaking on Elasticsearch, let our Community Manager know!

Belgium

  • Honza Kral will be speaking on What's New in Elasticsearch 1.0 with Aggregations at the Benelux Elasticsearch Meetup in Brussels on Friday, January 31st. Doors open at 6 PM.
  • Leslie Hawthorn and Honza Kral will be attending FOSDEM 2014 on February 1st and 2nd. Stop by the Elasticsearch table to say hello! We'll be in Building K on the 2nd Floor.
  • Leslie Hawthorn will be speaking at the Infrastructure.Next Conference on DevOps: For Happier, More Productive People. Infrastructure.Next takes place on February 5th in Ghent, following Config Management Camp.
  • Czech Republic

    Honza Kral will give two presentations at DevConf.cz: Design for Cloud with Elasticsearch and Centralized Logging with Logstash. Honza's presentations take place on Friday, February 7th, and the conference runs from the 7th through the 9th.

    France

    Germany

    Japan

    Thanks to Jun Ohtani, the 3rd Elasticsearch Meetup will be held in Tokyo on February 7th starting at 7 PM. Please remember to register for the meetup.

    Sweden

    The 4th Stockholm Elasticsearch Meetup has just been scheduled for February 5th. Further details are forthcoming, but you can look forward to presentations from Karel Minařík and Honza Král.

    United Kingdom

    Elasticsearch will have two sessions at QCon London, which takes place March 3-7th. You can join Mark Harwood for a tutorial on Using Elasticsearch for Anomaly Detection plus see Shay Banon and Graham Tackley co-present on How Elasticsearch Powers The Guardian's Newsroom. Make sure to stop by our booth to say hello!

    United States

    Where to Find You

    Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.

    Oh yeah, we're also  hiring. If you'd like us to find you for employment purposes, just drop us a note.  We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.

    Trainings

    If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: