This Week in Elasticsearch - April 17, 2014

Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.

Elasticsearch core

  • A new Benchmark API has been added (#5406, master, 1.x)
  • REST Clear Scroll API: Now accepts the scroll id as part of the body (#5726, master, 1.x, 1.1 and 1.0)
  • Function score: Generation of random numbers was weak (#5578, master, 1.x)
  • Internal: Releasable now extends AutoCloseable (#5689, master, 1.x)
  • Lucene: Upgrade to 4.7.2 (commit, master, 1.x)
  • Allocation: Fix format string for DiskThresholdDecider reroute explanation (#5749, master, 1.x, 1.1)
  • Aggregations: Fixed bounds of a nested nested aggregation (#5728, master, 1.x, 1.1 and 1.0)
  • Internal: Replaced InternalSearchResponse#EMPTY with InternalSearchResponse#empty() to prevent state changes (#5775, master, 1.x, 1.1 and 1.0)
  • Field data: AppendingDeltaPackedLongBuffer based storage format to single value field data (#5706, master, 1.x)
  • Internal: Ensure pending merges are updated on segment flushes (#5779, master, 1.x, 1.1)
  • Internal: Improved SearchContext.addReleasable to make sure pages are always released by introducing a lifecycle (#5703, master, 1.x)
  • Internal: Prevent fsync from creating 0-byte files (#5746, master, 1.x)
  • Snapshot/Restore: Fix snapshot status with empty repository (#5790, master, 1.x, 1.1)
  • Mapping: Ensure that TTL clean up thread does not recreate deleted indices (#5766, master, 1.x, 1.1 and 1.0)
  • Internal: Remove jsr166y due to being on Java 7, cleanup jsr166e to used classes (commit, master, 1.x)
  • Internal: Cleanup FileSystemUtils and remove scary methods (#5806, master, 1.x)
  • Cluster State: Propagate percolate mapping changes to cluster state (#5776, master, 1.x, 1.1 and 1.0)
  • Merging: Switch back to ConcurrentMergeScheduler (#5817, master, 1.x, 1.1)
  • Scroll API: Improvied handling of invalid scroll ids (#5738, master, 1.x, 1.1 and 1.0)

Elasticsearch Ecosystem

Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.

Slides & Videos


Jordan Sissel's slides from OSDC 2014


David Pilato on Making Sense of Your (Big) Data at Cloud Conference 2014 (Turin, Italy)


Jordan Sissel's slides from PuppetCamp Berlin 2014

Where to find Us

We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!

Austria

The Elasticsearch Vienna Meetup Group just formed! Join the group now to get updates on their first meeting.

Brasil

Elasticsearch is very excited to send our first speaker from the company to Brasil! Leslie Hawthorn, our Community Manager, will be returning to FISL once again to speak on Community 2.0: Beyond Using Software Livre. Leslie will speak on May 7th and FISL 15 runs from May 7-10th in Porto Alegre. Her talk will be in English but most of the talks on the program are given in BR-PT. Leslie will also be on hand to answer questions you may have about Elasticsearch, Logstash and Kibana.

Canada

Honza Kral will be attending PyCon North America and the accompanying Django sprints. Make sure to stop by and hear more from him during his poster session Collect and Analyze your logs with Logstash, Elasticsearch and Kibana.

France

Germany

  • Boaz Leskes will be speak at NoSQL Matters Cologne on Elasticsearch: Deep dive into analytics using Aggregations. The conference runs from April 29-30th.
  • Our friends at XING have created the Hamburg Elasticsearch User Group and will welcome Alexander Reelsen at the first meeting on Wednesday, May 7th. Alex will cover Using ElasticSearch, Logstash & Kibana to create realtime dashboards. Doors open at 6:30 PM.

Japan

The 4th Elasticsearch study session has been scheduled by Jun Ohtani. Please plan to join the meeting at 7 PM on April 21st.

Spain

Clinton Gormley has been invited to speak at the Barcelona on Rails Meetup on May 15th. Join him for a presentation on Elasticsearch's Query DSL: Not just for wizards! Doors open at 7 PM, and thanks to the fine folks at XING for hosting us!

Tunisia

David Pilato will speak at the Esprit JUG Days in Ariana. Further details of the conference schedule are forthcoming, but mark your calendar for May 7th and 8th. In the meantime, you may want to visit the conference's Facebook page.

United Kingdom

United States

  • Kevin Kluge will present ELK: How Elasticsearch, Logstash, and Kibana provide real-time data enlightenment at the DevNation Conference. Kevin's talk will take place on Thursday, April 17th at 9:45 AM. DevNation, co-located with Red Hat Summit, runs April 13-17 2014 at Moscone Center in San Francisco. Elasticsearch will be participating in the Partner Pavilion at Red Hat Summit, so if you are attending either conference we hope you will stop by our booth to say hello!
  • Rashid Khan will be presenting at Monitorama. The conference runs from May 5-7, 2014 in Portland, Oregon.
  • The Miami JVM Group will convene on May 13th and discuss an Introduction to Elasticsearch. Doors open at 7 PM.

Where to Find You

Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.

Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note.  We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.

Trainings

If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:

  • San Francisco - Apr 25, 2014 (ELK Workshop)
  • Copenhagen - May 13, 2014 (core Elasticsearch training)
  • Paris - May 15, 2014 (core Elasticsearch training)
  • Atlanta - May 20, 2014 (core Elasticsearch training)