This Week in Elasticsearch - April 23, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
- Cluster State: Unified updates on mapping change (#5798, master and 1.x)
- Configuration: Removed leading spaces on commented config key lines in
elasticsearch.yml(#5842, master and 1.x)
- Allocation: Fail replica shards locally upon document replication failures (#5847, master and 1.x)
- Scripting: Updated to mvel 2.2.0.Final (#5877, master, 1.x, 1.1 and 1.0)
- Build: Updated forbidden-apis to 1.5.1 (#5863, master and 1.x)
- Internal: Searcher might not be closed if store handle can't be obtained (#5884, master and 1.x)
- Network: Use loopback address when localhost is not resolved (#5719, master and 1.x)
- Benchmark API: Client hangs if benchmark is submitted without any benchmark nodes (#5755, master and 1.x)
- Recovery API: Empty HTTP body returned on empty cluster (#5743, master and 1.x)
- Cluster State: Introduced a new cluster state status abstraction to keep track of the different cluster state processing stages (#5741, master and 1.x)
- Internal: Switched flush threshold from
unlimitednumber of operations, time and size thresholds stayed the same (#5900, master and 1.x)
- Internal: Improved bloom filter hashing (#5901, master and 1.x)
- Query DSL: Parse
has_childquery/filter after child type has been parsed (#5783, master, 1.x, 1.1 and 1.0)
- Merging: Increased default merge throttling from 20 to 50 megabytes per second (#5902, master and 1.x)
- Recovery: Increased default recovery throttling from 20 to 50 megabytes per second (#5913, master and 1.x)
- Lucene: Changed default numeric
precision_step(#5905, master and 1.x)
ConcurrentMergeSchedulerProvidershould use Lucene's default settings (#5882, master and 1.x)
- Docs: Added Getting started section
Photo courtesy of Robyn Bergeron
Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.
- In case you missed it, we released Elasticsearch v 1.1.1 and 1.0.3 last week. We've got some great bug fixes in this latest release, so make sure to check out the blog post for full details.
- Clinton Gormley released the first version of the async Elasticsearch Perl client.
- Clinton also treated us to a deep dive on multi-field search, an improved feature in 1.1.
- Mike McCandless and Robert Muir treated us to a blog post on why Java 1.7.u55 is now safe for use with Elasticsearch. You may also be interested in our warm welcome post on Mike and Robert joining Elasticsearch Inc and our commitment to further augmenting and hardening Apache Lucene.
- Zachary Tong authored a blog post on the new percentiles metric aggregation in 1.1. Why is this awesome? Percentiles tell you the value at which a certain percentage of your data is included. Read on to learn more.
- Markus Lachinger published a great article on How to pre-process logs with logstash.
- Anders Aarvik shared a great soup to nuts tutorial on setting up the ELK stack.
- Tikitu de Jager shared a useful blog post deep diving into the the significant terms aggregation feature from 1.1. In case you missed it, you may enjoy Mark Harwood's recent post on the same topic, discussing finding the uncommonly common with Elasticsearch.
- Arie Prasetyo authored a great introductory article on Getting started with the Python Elasticsearch client.
- If you use the Ghost blogging platform, you may be interested in this three part series on integrating Elasticsearch with your self-hosted blog.
Slides & Videos
Kevin Kluge's slides from the first ever DevNation 2014 Conference
You may also be interested in our round up blog post about all the talks and other awesome from Elasticsearch folks last week at DevNation, co-located with Red Hat Summit.
An oldie but a goodie: Costin Leau on at SpringOneGX: Your data, your search: Elasticsearch
Elasticsearch at Wantedly (日本語)
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
The Elasticsearch Vienna Meetup Group just formed! Join the group now to get updates on their first meeting.
Elasticsearch is very excited to send our first speaker from the company to Brasil! Leslie Hawthorn, our Community Manager, will be returning to FISL once again to speak on Community 2.0: Beyond Using Software Livre. Leslie will speak on May 7th and FISL 15 runs from May 7-10th in Porto Alegre. Her talk will be in English but most of the talks on the program are given in BR-PT. Leslie will also be on hand to answer questions you may have about Elasticsearch, Logstash and Kibana.
- Honza Kral will be speaking at DjangoConEU on From __icontains to search. The conference takes place May 13-17th on the Île des Embiez in France.
- The sixth Elasticsearch France Meetup will take place on May 14th at Nuxeo's offices in Paris. Doors open at 7:30 PM on May 14th.
- David Pilato will be attending dotSCale on May 19th in Paris. Don't miss his dotScale workshop, Elasticsearch Overview, on May 17th!
- David Pilato will host an Elasticsearch workshop at the Solutions Linux Conference on May 20th. The conference runs from May 20-21st in Paris. If you don't have time to attend David's workshop, make sure to stop by the Elasticsearch booth to say hello!
- David Pilato will run a workshop on Elasticsearch and Kibana at the Breizhcamp 2014. The event runs from May 21-23rd in Rennes.
- Boaz Leskes will be speak at NoSQL Matters Cologne on Elasticsearch: Deep dive into analytics using Aggregations. The conference runs from April 29-30th.
- Our friends at XING have created the Hamburg Elasticsearch User Group and will welcome Alexander Reelsen at the first meeting on Wednesday, May 7th. Alex will cover Using Elasticsearch, Logstash & Kibana to create realtime dashboards. Doors open at 6:30 PM.
- The Elasticsearch team will be at Berlin Buzzwords. (When we say the team, we mean most of our folks in the EU and several of our employees from the US. :)) We have many talks on the program and look forward to hosting you in the developer chill area, as well. Even better, the Berlin Elasticsearch User Group will convene a hackathon on Wednesday, May 28th. Please join us!
Clinton Gormley has been invited to speak at the Barcelona on Rails Meetup on May 15th. Join him for a presentation on Elasticsearch's Query DSL: Not just for wizards! Doors open at 7 PM, and thanks to the fine folks at XING for hosting us!
David Pilato will speak at the Esprit JUG Days in Ariana. Further details of the conference schedule are forthcoming, but mark your calendar for May 7th and 8th. In the meantime, you may want to visit the conference's Facebook page.
- Mark Harwood will be sharing his analysis of using Elasticsearch to find the "uncommonly common" results in searches - think fraud or anomaly detection - at the Financial Engineers and & Quants London Meetup. Join Mark on Thursday, April 24th at 6:30 PM at SkillsMatter. The organizers ask that you kindly register on both meetup.com and SkillsMatter website. A link to the registration form for SkillsMatter is included on the meetup.com invitation to the event. Attendance is free of charge.
- David Pilato will take the stage at DevoxxUK to discuss Advanced Search for Your Legacy Application DevoxxUK takes place June 12-13th in London, and David will speak on June 12th at 4 PM in Room 1.
- Juan Thomassie will be attending the Boucoup OpenVis Conference in Boston on April 24th and 25th. Say hello to him in the hallway track!
- Aaron Mildenstein will be at DevOps Days Austin on May 5th and 6th. Make sure to stop by the Elasticsearch booth to say hello!
- Rashid Khan will be presenting at Monitorama. The conference runs from May 5-7, 2014 in Portland, Oregon.
- The Elasticsearch Boston Meetup group will be getting together on May 6th at 6:00 PM. You'll hear from Igor Motov on Improving Elasticsearch Resiliency and from the Yieldbot team on their use of Elasticsearch.
- The Miami JVM Group will convene on May 13th and discuss an Introduction to Elasticsearch. Doors open at 7 PM.
- Jordan Sissel will be speaking at Gluecon 2014! Make sure to catch his talk and visit the Elasticsearch booth. The conference runs from May 21-22nd in Bloomfield, Colorado.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- San Francisco - Apr 25, 2014 (ELK Workshop)
- Paris - May 15, 2014 (core Elasticsearch training)
- Seattle - June 3, 2014 (core Elasticsearch training)
- New York - June 4, 2014 (core Elasticsearch training)
- London - June 4, 2014 (core Elasticsearch training)
- Zurich - June 5, 2014 (core Elasticsearch training)