This Week in Elasticsearch - April 17, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
- A new Benchmark API has been added (#5406, master, 1.x)
- REST Clear Scroll API: Now accepts the scroll id as part of the body
(#5726, master, 1.x, 1.1 and 1.0)
- Function score: Generation of random numbers was weak (#5578, master, 1.x)
AutoCloseable(#5689, master, 1.x)
- Lucene: Upgrade to 4.7.2 (commit, master, 1.x)
- Allocation: Fix format string for
DiskThresholdDeciderreroute explanation (#5749, master, 1.x, 1.1)
- Aggregations: Fixed bounds of a nested
nestedaggregation (#5728, master, 1.x, 1.1 and 1.0)
- Internal: Replaced
InternalSearchResponse#empty()to prevent state changes (#5775, master, 1.x, 1.1 and 1.0)
- Field data:
AppendingDeltaPackedLongBufferbased storage format to single value field data (#5706, master, 1.x)
- Internal: Ensure pending merges are updated on segment flushes (#5779, master, 1.x, 1.1)
- Internal: Improved
SearchContext.addReleasableto make sure pages are always released by introducing a lifecycle (#5703, master, 1.x)
- Internal: Prevent fsync from creating 0-byte files (#5746, master, 1.x)
- Snapshot/Restore: Fix snapshot status with empty repository (#5790, master, 1.x, 1.1)
- Mapping: Ensure that TTL clean up thread does not recreate deleted indices (#5766, master, 1.x, 1.1 and 1.0)
- Internal: Remove jsr166y due to being on Java 7, cleanup jsr166e to used classes (commit, master, 1.x)
- Internal: Cleanup
FileSystemUtilsand remove scary methods (#5806, master, 1.x)
- Cluster State: Propagate percolate mapping changes to cluster state (#5776, master, 1.x, 1.1 and 1.0)
- Merging: Switch back to
ConcurrentMergeScheduler(#5817, master, 1.x, 1.1)
- Scroll API: Improvied handling of invalid scroll ids (#5738, master, 1.x, 1.1 and 1.0)
Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.
- You may have already seen the blog post about the new significant terms aggregation. You may also enjoy watching Mark Harwood's presentation on this topic from QCon London.
- The Elasticsearch .NET and NEST client are now official clients for Elasticsearch. Both are in beta, so keep that feedback coming!
- Plugin releases: The GCE plugin has been updated
- New versions of the
elasticsearch-railsRubygems have been released, with minor improvements and fixes, you can check the diff
- Leslie Hawthorn and Kurt Hurtado visited Red Hat Summit this week and recorded a podcast on the ELK Stack.
- Nik Everett from Wikipedia is working on an experimental highlighter plugin.
- The Clojure client, Elastisch, released version 2.0.0beta4.
- A great tutorial how to build a recipe search site with Angular and Elasticsearch.
- A quick tutorial how to use scrolling with Elasticsearch using node and promises.
- The Humanitarian API of ReliefWeb is simply a thin layer on top Elasticsearch, read more about how it works.
- Nuxeo blogged about their use of Elasticsearch.
- Kunihiko Kido wrote several short articles on Elasticsearch (日本語).
- Seigo Uchida shared a how to on building an Elasticsearch cluster on EC2 using Chef. (日本語)
Slides & Videos
David Pilato on Making Sense of Your (Big) Data at Cloud Conference 2014 (Turin, Italy)
- David Pilato's slides from his Code Motion Roma 2014 presentation.
- Clinton Gormley gave a great presentation at ScaleConf about scaling real-time search and analytics.
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
The Elasticsearch Vienna Meetup Group just formed! Join the group now to get updates on their first meeting.
Elasticsearch is very excited to send our first speaker from the company to Brasil! Leslie Hawthorn, our Community Manager, will be returning to FISL once again to speak on Community 2.0: Beyond Using Software Livre. Leslie will speak on May 7th and FISL 15 runs from May 7-10th in Porto Alegre. Her talk will be in English but most of the talks on the program are given in BR-PT. Leslie will also be on hand to answer questions you may have about Elasticsearch, Logstash and Kibana.
Honza Kral will be attending PyCon North America and the accompanying Django sprints. Make sure to stop by and hear more from him during his poster session Collect and Analyze your logs with Logstash, Elasticsearch and Kibana.
- David Pilato and Adrien Grand will both be at Devoxx France 2014, where they will co-present the Hands on Elasticsearch workshop. Devoxx France runs April 16-18th in Paris.
- Honza Kral will be speaking at DjangoConEU on From __icontains to search. The conference takes place May 13-17th on the Île des Embiez in France.
- The sixth Elasticsearch France Meetup will take place on May 14th at Nuxeo's offices in Paris. Doors open at 7:30 PM on May 14th.
- David Pilato will be attending dotSCale on May 19th in Paris. Don't miss his dotScale workshop, Elasticsearch Overview, on May 17th!
- Boaz Leskes will be speak at NoSQL Matters Cologne on Elasticsearch: Deep dive into analytics using Aggregations. The conference runs from April 29-30th.
- Our friends at XING have created the Hamburg Elasticsearch User Group and will welcome Alexander Reelsen at the first meeting on Wednesday, May 7th. Alex will cover Using ElasticSearch, Logstash & Kibana to create realtime dashboards. Doors open at 6:30 PM.
The 4th Elasticsearch study session has been scheduled by Jun Ohtani. Please plan to join the meeting at 7 PM on April 21st.
Clinton Gormley has been invited to speak at the Barcelona on Rails Meetup on May 15th. Join him for a presentation on Elasticsearch's Query DSL: Not just for wizards! Doors open at 7 PM, and thanks to the fine folks at XING for hosting us!
David Pilato will speak at the Esprit JUG Days in Ariana. Further details of the conference schedule are forthcoming, but mark your calendar for May 7th and 8th. In the meantime, you may want to visit the conference's Facebook page.
- Mark Harwood will be sharing his analysis of using Elasticsearch to find the "uncommonly common" results in searches - think fraud or anomaly detection - at the Financial Engineers and & Quants London Meetup. Join Mark on Thursday, April 24th at 6:30 PM at SkillsMatter. The organizers ask that you kindly register on both meetup.com and SkillsMatter website. A link to the registration form for SkillsMatter is include on the meetup.com invitation to the event. Attendance is free of charge.
- David Pilato will take the stage at DevoxxUK to discuss Advanced Search for Your Legacy Application DevoxxUK takes place June 12-13th in London, and David will speak on June 12th at 4 PM in Room 1.
- Kevin Kluge will present ELK: How Elasticsearch, Logstash, and Kibana provide real-time data enlightenment at the DevNation Conference. Kevin's talk will take place on Thursday, April 17th at 9:45 AM. DevNation, co-located with Red Hat Summit, runs April 13-17 2014 at Moscone Center in San Francisco. Elasticsearch will be participating in the Partner Pavilion at Red Hat Summit, so if you are attending either conference we hope you will stop by our booth to say hello!
- Rashid Khan will be presenting at Monitorama. The conference runs from May 5-7, 2014 in Portland, Oregon.
- The Miami JVM Group will convene on May 13th and discuss an Introduction to Elasticsearch. Doors open at 7 PM.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: