This Week in Elasticsearch - February 05, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
- Elasticsearch 0.90.11 and 1.0.0.RC2 have been released earlier this week
- REST APIs: Fixed potential
NullPointerException
when usingsource
parameter (#4924, master, 1.x, 1.0 and 0.90) - cat API: Added dedicated
thread_pool
endpoint (#4907, master, 1.x, 1.0) - Scroll REST API: Support
source
parameter (#4941, master, 1.x, 1.0 and 0.90) - Snapshot/Restore API: Add throttling to snapshot and restore operations (#4855, master, 1.x, 1.0)
- Aggregations: Sorting terms agg by sub-aggregation did not respect sorting when executed on a single shard (#4951, master, 1.x, 1.0)
- REST Get Field Mapping API: Fix possible
NullPointerException
caused by a non existing field (#4953, master, 1.x, 1.0) - Plugins: Add version information (#2784, master, 1.x, 1.0)
- Query API: Cache date range filters that use
now
with rounding (#4947, master, 1.x, 1.0 and 0.90) - Snapshot/Restore API: Unify handling of booleans (#4949, master, 1.x, 1.0)
- Query API: Filtered query parses
_name
incorrectly (#4960, master, 1.x, 1.0 and 0.90) - Mapping: Binary fields are not stored by default anymore (#4957, master, 1.x, 1.0)
- Allocation: Add explanation for allocation deciders (#4934, master, 1.x, 1.0 and 0.90)
- Mapping:
copy_to
doesn't support boosting anymore, as it was not reliable (#4972, master, 1.x, 1.0) - Completion Suggest: Prevent possible
NullPointerException
(#4970, #4788, master, 1.x, 1.0 and 0.90) - Lucene
RamUsageEstimator
: Remove and prevent usage of the estimator due to performance (commit, commit, master, 1.x, 1.0 and 0.90) - Mapping: Add
fields
support togeo_point
andcompletion
types to properly supportmulti_field
upgrades from 0.90.x (#4963, master, 1.x, 1.0) - Query API: Make parent/child queries work with non-default similarity (#4979, master, 1.x, 1.0 and 0.90)
- Query API:
multi_match
query parsing has been improved (#4964, master, 1.x, 1.0 and 0.90) - Lucene: Removed the in memory buffer Lucene store/directory (#4994, master, 1.x)
- Aggregations:
ScriptBytesValues.currentValueHash
is wrong (#5004, master, 1.x, 1.0) - Aggregations:
value_count
aggregations supports now scripts (#5001, master, 1.x)
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, and news about Logstash and Kibana.
- David Pilato released an Azure cloud plugin for Elasticsearch.
- A new Slackware package for Elasticsearch has been released.
- Kundera, a Java-based object mapping library also supporting Elasticsearch, has been released in version 2.10.
- rawes, an Elasticsearch driver for Python that provides a small level of abstraction above the requests library, has been released.
- relateit, a simple and easy way application to relate one item to several others, has been released. Relateit is built atop Elasticsearch and Disruptor.
- Ben Hagan shared a highly detailed how to on installing and setting up Elasticsearch on AWS.
- Sloan Ahrens published the first in a series of blog posts on different ways of approaching autocomplete in Elasticsearch.
- Deni Bertović shared a how to on using Docker & Logstash to provide smarter log management to for your containers.
- Christopher Vigg authored a post on using Elasticsearch to index SQL data bases the easy way.
- Andriy Redko shared an introduction to using Logstash and Elasticsearch.
- You may enjoy this tutorial on building a centralized log server with Logstash.
- Andrew Westgarth published an overview on using the Elasticsearch Azure Plugin with Windows Virtual Machines.
- Joe Miller treated us to a how to on using Heroku log drains to ship logs from a Heroku app to Logstash.
- Devashish Meena shared some 101 on Logstash and Docker.
- Benjamin Chadwick authored a tutorial on Parsing Amazon CloudTrail with JSON Logs with a Customized Logstash build.
- Phil Whelan wrote an article on Log streaming at Hootsuite using Logstash.
Slides & Videos
Honza Kral's presentation from FOSDEM 2014. Video will be published in a forthcoming This Week in Elasticsearch.
- There's a ton of great presentations on offer in Elasticsearch's Speakerdeck account. Check them out and let us know which ones were most helpful.
- Got slides or videos we should be sharing in This Week in Elasticsearch, let our Community Manager,Leslie Hawthorn, know.
Maggie Nelson on how Findery uses Elasticsearch to solve their unique geo challenges
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Czech Republic
Honza Kral will give two presentations at DevConf.cz: Design for Cloud with Elasticsearch and Centralized Logging with Logstash. Honza's presentations take place on Friday, February 7th, and the conference runs from the 7th through the 9th.
France
- David Pilato will present Elasticsearch: Make sense of your (BIG) data at the Paris JUG on February 11th. Doors open at 7:15 PM.
- The fifth Elasticsearch Paris Meetup will start at 7 PM on February 12th. The audience will be treated to a deep dive on Elasticsearch Marvel by Boaz Leskes.
- David will speak on Elasticsearch: Make sense of your (BIG) data on Azure! at Microsoft Tech Days in Paris. David's presentation is scheduled for February 13th at 4:30 PM.
Germany
- Britta Weber will present on Customizing Your Scoring Using function_score at the Munich Search Meetup on February 5th. Sebastian Paetzold from ysura will speak on Permission Management with Elasticsearch. Doors open at 7 PM.
- Elasticsearch will have a booth at the OOP Konferenz in Munich Feb. 4-6th.
- Alexander Reelsen will discuss Using Elasticsearch, Logstash & Kibana to Create Real-Time Dashboards at the Lightweight Java Users Group Munich meeting on February 11th. Doors open at 7 PM.
Japan
Thanks to Jun Ohtani, the 3rd Elasticsearch Meetup will be held in Tokyo on February 7th starting at 7 PM. Please remember to register for the meetup.
Sweden
The 4th Stockholm Elasticsearch Meetup has just been scheduled for February 5th. Karel Minařík will cover Elasticsearch and Chef, and Honza Král will discuss What's New in 1.0 with Aggregations.
United Kingdom
- Elasticsearch will have two sessions at QCon London, which takes place March 3-7th. You can join Mark Harwood for a tutorial on Using Elasticsearch for Anomaly Detection plus see Shay Banon and Graham Tackley co-present on How Elasticsearch Powers The Guardian's Newsroom. Make sure to stop by our booth to say hello!
- The Enterprise Search Cambridge UK Meetup will feature a presentation on how Rangespan uses Elasticsearch. The meetup convenes on March 5th and doors open at 7 PM>
United States
- The Elasticsearch DC Meetup will get together tonight, February 5th at 6:30 PM. Attendees will be treated to an in depth look at how NGP VAN uses Elasticsearch.
- The next Elasticsearch Boston Meetup will take place on February 6th. Attendees will be treated to an open Q&A from Elasticsearch creator Shay Banon, plus a series of lightning talks. Doors open at 6 PM.
- The Search and Machine Learning Seattle Meetup group will welcome Steve Mayzak on February 6th. Steve will present on Elasticsearch, Logstash and Kibana. Doors open at 7 PM.
- Several folks from Elasticsearch will be attending the Strata Conference from February 11-13th in Santa Clara, California. Stop by our booth to say hello!
- The Boston Azure User Group will convene on February 20th at 6 PM. Chris Morley will present on Elasticsearch Running on Linux in Azure.
- Leslie Hawthorn, Kevin Kluge and Jordan Sissel will all be presenting at the 12th Annual Southern California Linux Expo, a.k.a. SCALE 12x. If you can't catch the talks, make sure to stop by our table to say hello. SCALE runs from February 21st-23rd.
- The second Los Angeles Elasticsearch Meetup will be held on Friday, February 21st at SCALE 12x. Join us for casual discussion and refreshments. You don't have to be attending SCALE to come to the meetup, but the organizers have offered a generous discount on conference passes to meetup attendees. We'll get together at starting at 7 PM.
- The Elasticsearch Denver Meetup group will be getting together on February 24th to hear about Automattic's use of Elasticsearch. Doors open at 6:30 PM and Elasticsearch core developer Lee Hinman will also be on hand for Q&A.
- The Elasticsearch San Francisco Meetup group will focus on Benchmarking, Autoscaling and Deployment Automation at their next meetup. Elasticsearch core developers Uri Boness and Andrew Selden will be on hand for Q&A following the presentations. Doors open at 6:30 PM on February 27th.
- We've set the date for the first ever Elasticsearch Portlandia Meetup on March 4th. Steve Mayzak will cover Elasticsearch 1.0 - Whats new and how are people using it?Our community manager, Leslie Hawthorn, will also be visiting from Europe. She's looking forward to hearing from everyone about what could be done to make your lives as Elasticsearch users better.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
Trainings
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: