This Week in Elasticsearch - June 11, 2014

Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.

Elasticsearch core

  • Core: Use new ConcurrentHashMap implementation coming in Java 8 (#6400, master and 1.3)
  • Scripting: exposed _uid , _id and _type fields as stored fields (_fields notation) (#6406, master, 1.3 and 1.2)
  • FileSystem: Use XNativeFSLockFactory instead of the buggy Lucene 4.8.1 version (#6424, master, 1.3 and 1.2)
  • Compilation: Don't warn about using Sun proprietary APIs (#6423, master and 1.3)
  • PUT Index Template API: unified PUT/POST behaviour in relation to create parameter (#6429, master and 1.3)
  • Aggregations: Optimization for memory usage. Added changes to core Aggregator class to support a new mode of deferred collection (#6128, master and 1.3)
  • Bulk API: A request which fails to create multiple indices may never return (#6436, master and 1.3)
  • Settings: auto_expand_replicas explodes with a value of all (#5752, master and 1.3)
  • Aggregations: Change the top_hits to be a metric aggregation instead of a bucket aggregation (which can't have an sub aggs) (#6395, master and 1.3)
  • Fielddata: EmptyOrdinals#getMaxOrd() should return 0 instead of 1, since ordinals are zero based (#5871, master and 1.3)
  • Aggregations: Cardinality aggregation fails in case of empty doc values field (#6413, master, 1.3 and 1.2)
  • TransportClient: Improve logging, fix minor issue (#6376, master and 1.3)
  • Stats: Bugfixes and enhancements to indices stats API (#6390, master and 1.3)

Elasticsearch Ecosystem

Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.

Slides & Videos

Costin Leau's slides from last week's Hadoop Summit. Video Coming Soon!

Clinton Gormley at Berlin Buzzwords 2014: Elasticsearch's Query Domain Specific Language (DSL) - Not Just for Wizards!

Martijn van Groningen on Elasticsearch's Percolator at Berlin Buzzwords 2014

Robert Muir on Apache Lucene 4 from Berlin Buzzwords 2014

Where to find Us

We'd love to feature all the great Elasticsearch, Logstash, and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!


The Elasticsearch Vienna Meetup Group has scheduled their first meetup for Thursday, June 12th. Please join us at 7 PM to hear from Alexander Reelsen on What's New in Elasticsearch.


If you're a fan of Drupal and Elasticsearch, please join David Pilato on June 18th at the Paris Drupal Meetup. Doors open at 6:45 PM.


The IGT Cloud Meetup Group is hosting a workshop on Applied Cloud Computing with Google Cloud Platform at Google Tel Aviv. Topics will include BigQuery with Logstash as Application Log Analysis Platform. The workshop runs from 9:30-13:30 on July 7th.

The Netherlands

We've got not one but two awesome conferences going on in Amsterdam the week of June 16th:

  • DevOps Days Amsterdam: Join us June 19-21st for an Elasticsearch workshop, a little on DevOps for Happier Humans and all the news you can use at the Elasticsearch table. Swing by to say hello to Leslie Hawthorn and Kurt Hurtado! Lee Hinman will also join us for the workshop. Yay Lee!
  • GOTO Amsterdam: Our CTO, Shay Banon, will treat the crowd to a deep dive on Elasticsearch's APIs, plus we'll have lots of knowledge and swag on offer at our booth. See you there!

Plus, we're hosting Friday drinks on June 27th at 6:00 PM in Amsterdam. You'll have the chance to meet tons of our core developers, as the whole company will be visiting our EU HQ that week for our annual all hands gathering.


Costin Leau will speak at Topconf Bucharest 2014 on Big data real time search and analytics. Topconf Bucharest runs from June 10-13th and Costin will speak at 3:20 PM on June 12th.

United Kingdom

  • David Pilato will take the stage at DevoxxUK to discuss Advanced Search for Your Legacy Application DevoxxUK takes place June 12-13th in London, and David will speak on June 12th at 4 PM in Room 1.
  • Elasticsearch will be out in force at London Technology Week. Join us June 17-19th to celebrate all that is fashionable in the UK tech scene, especially at the Networking Bar. Even cooler, on June 17th, Mark Harwood will be telling you all about how to Make sense of your (big) data and analyze in real-time like you have never done before! Mark's talk is at 4 PM. Last but not least, we'll have a London meetup on June 18th starting at 5 PM.

United States

  • Aaron Mildenstein will be speaking at Texas Linux Fest this weekend, presenting an Introduction to Logstash. TLF runs June 12-13th in Austin, and Aaron will present at 10:15 AM on Saturday.
  • The Philadelphia Elasticsearch Meetup group will be getting together for their second meetup on June 26th. Details are still in the works, but sign up now so you know where to go for ELK treats on the 26th.
  • The SYN/(st)ACK NYC User Group will convene on June 30th at 6:30 PM. Squarespace is hosting the festivities, and Franklin Angulo, one of their Software Engineers, will be presenting. Franklin will cover building a scalable monitoring and alerting system using Graphite, Grafana, Collectd, Nagios, Logstash, Elasticsearch, and Kibana, among others.

Where to Find You

Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.

Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note.  We care more about your skill set and passion for Elasticearch, Kibana, and Logstash than where you rest your head.


If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:

  • Paris - July 08, 2014 (core Elasticsearch training)
  • Cologne - July 09, 2014 (core Elasticsearch training)
  • Seoul - July 10, 2014 (core Elasticsearch training)
  • London - July 14, 2014 (core Elasticsearch training)
  • Tokyo - July 14, 2014 (core Elasticsearch training)
  • Berlin - July 15, 2014 (ELK workshop)
  • Milan - July 16, 2014 (core Elasticsearch training)
  • We're hiring

    Work for a global, distributed team where finding someone like you is just a Zoom meeting away. Flexible work with impact? Development opportunities from the start?