This Week in Elasticsearch - February 26, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
- Elasticsearch 1.0.1 and 0.90.12 were released yesterday
- Query API: Make
_exists_/_missing_
inquery_string
query behave consistently withexists/missing
(#5142, master, 1.x, 1.0) - Query API: Allow for executing queries based on pre-defined templates (#4879, master, 1.x)
- Aggregations: Changed the caching of FieldDataSource in aggs to be based on field name + required value source type as a combinated key (#5190, master, 1.x, 1.0)
- Lucene: Disable RAM usage estimation on Lucene 3.x segments (#5201, master, 1.x, 1.0 and 0.90)
- Query API:
query_string
andsimple_query_string
queries now allow for locale selection (#5128, master, 1.x) - Fix
yamlBuilder()
to return YAML builder instead of SMILE (#5185, master, 1.x, 1.0) - Aggregations: Fixed an issue where an
IndexOutOfBoundsException
was thrown when a date_/histogram aggregation ran against an empty index (#5179, master, 1.x, 1.0) - Highlighting:
forceSource
highlighting field option doesn't have any effect when set using the Java API (#5220, master, 1.x, 1.0) - Highlighting: Highlighting on a wildcard field name causes the wildcard expression to be returned rather than the actual field name (#5221, master, 1.x, 1.0 and 0.90)
- Highlighting: Fix multi-term queries with postings highlighter (#5127, master, 1.x, 1.0 and 0.90)
- Snapshot/Restore API: Restoring an existing index doesn't restore mappings and settings if index already exists (#5210, master, 1.x, 1.0)
- Snapshot/Restore API: Restoring an existing index using rename doesn't completely open the index after restore (#5212, master, 1.x, 1.0)
- Plugins: Loading plugins now is more resilient on wrong/bad permissions (#5195, master, 1.x)
- Get Field Mapping API: Ensure data is returned even if the index is not hosted on the node executing the request (#5177, master, 1.x, 1.0 and 0.90)
- Recycler: better lifecycle control for pooled instances (#5214, master and 1.0)
- Recycler: Removed
thread_local
recycler (commit, master, 1.x) - Highlighting: Highlighting on a wildcard field name uses the same highlighter for all fields that match (#5175, master, 1.x, 1.0 and 0.90)
- Highlighting: MultiMatchQuery fails to highlight with new cross field mode (#5246, master, 1.x)
- Delete by query doesn't return failure reasons (#5093, master, 1.x)
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, and news about Logstash and Kibana.
- The Elasticsearch puppet module and Logstash puppet module have been updated to work with Puppet Enterprise.
- A small description to get up and running with Angular js and the elasticsearch-js client
- PHP: Implementing a simple search with Elasticsearch and Symfony
- Security: Another approach for controlling access to Elasticsearch with filtered aliases, Nginx and tokens
- Some hints about parsing IIS logs with Logstash
- If you are using Drupal, you may want to check out the Elasticsearch 1.0 compatible connector
- The Raygun blog features a nice article on how they used Elasticsearch to improve their search functionality.
- If you are interested in health and in the UK, you might want to read and engage at NHS hackdays, which we sponsored as well.
- The Bigdesk plugin has been released, and now supports Elasticsearch 1.0 as well
- The folks from FacetFlow created an example .net web application on Azure using Elasticsearch
- Japanese: The Wantedly engineering blog features a nice blog post about getting started with Elasticsearch
- Russian: A small blog post about using Elastisearch aggregations for analytics
- Russian: 2GIS, a russian electronic maps provider describes their use of Elasticsearch in the company
Slides & Videos
Honza Kral on Centralized Logging with Logstash at DevConf.cz 2014
- Jordan Sissel's slides from SCALE12x about fpm - love packaging are available
- Kevin Kluge gave a nice introduction into the ELK stack at SCALE12x
- Honza Kral was interviewed at FOSDEM 2013 about Elasticsearch
- Chris Morley talked last week about Elasticsearch at the Boston Azure User Group, he collected some notes and his presentation
- Japanese: Slides and notes about the talk at the third Elasticsearch Tokyo meetup about elasticsearch used in a push notifcation system
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Australia
Britta Weber and Lee Hinman will head Down Under to teach training courses in Melbourne and Sydney. On the 13th of March you can join us for the Melbourne meetup, or come by the Sydney Meetup on March 17th.
Austria
Karel Minařík will speak at the Ruby User Group Linz on March 12th.
Canada
- Steve Mayzak will present on Elasticsearch in the Real World plus What's New in 1.0 at the upcoming Polyglot Vancouver Meetup. The meetup will take place on March 5th starting at 6 PM.
- The Elasticsearch Montreal Meetup group has scheduled their first meeting for March 12th at 7 PM.
Czech Republic
Karel Minařík will be speaking at the Prague.rb user group on March 5th. Doors open at 7 PM.
Germany
- Shay Banon will be on center stage at CeBIT 2014 on March 14th, discussing the impact of data harvesting on tomorrow's business insights. CeBIT runs March 10-14th in Hannover.
- Alexander Reelsen and Honza Kral will share the stage at GOTO Berlin night on March 18th. They'll be talking all about Elasticsearch 1.0 and how to use the ELK stack (that's Elasticsearch + Logstash + Kibana) to create real-time dashboards. Doors open at 7 PM and registration is required via the GOTO Berlin site.
- Alexander Reelsen will be attending DevCamp Karlsruhe on March 21-23rd. Say hello when you pass him in the hallway track.
- The first ever Stuttgart Elasticsearch Meetup will take place on March 25th at 7 PM. Alexander Reelsen will be covering What's New in Elasticsearch 1.0.
- Patrick Peschlow will talk about talk about Elasticsearch and his experiences at JavaLand 2014. His presentation is scheduled for March 25th in Brühl.
- Alexander Reelsen will be at the Berlin Expert Days Conference (BED-Con) on April 3rd and 4th. He will present Creating realtime dashboards using Elasticsearch, Logstash and Kibana.
- Jordan Sissel will speak at the Open Source Data Center Conference in Berlin, discussing how to Find Happiness in Your Logs. The conference will run from April 8-10th.
Italy
David Pilato will present Make sense of your (BIG) data! at the Italian Cloud Conference The conference takes place in Torino on April 3rd, and David will speak at 10:30 AM.
Japan
The 4th Elasticsearch study session has been scheduled by Jun Ohtani. Please plan to join the meeting at 7 PM on April 21st.
Slovakia
Honza Kral will speak at the Rubyslava International MiniConference on February 27th. The conference takes place in Bratislava.
South Africa
Clinton Gormley will take the stage at ScaleConf to talk Scaling real time search and analytics with Elasticsearch. The conference runs April 10th and 11th in Cape Town.
United Kingdom
- Shay Banon and Graham Tackley from The Guardian will share the stage at QCon London, discussing How Elasticsearch Powers The Guardian's Newsroom. Several folks from the Elasticsearch team will also be on hand in Booth 12 to answer questions. Stop by and say hello! QCon runs March 3-7th.
- The Enterprise Search Cambridge UK Meetup will feature a presentation on how Rangespan uses Elasticsearch. The meetup convenes on March 5th and doors open at 7 PM
United States
- The Elasticsearch San Francisco Meetup group will focus on Benchmarking, Autoscaling and Deployment Automation at their next meetup. Elasticsearch core developers Uri Boness and Andrew Selden will be on hand for Q&A following the presentations. Doors open at 6:30 PM on February 27th.
- We've set the date for the first ever Elasticsearch Portlandia Meetup on March 4th. Steve Mayzak will cover Elasticsearch 1.0 - Whats new and how are people using it? Our community manager, Leslie Hawthorn, will also be visiting from Europe. She's looking forward to hearing from everyone about what could be done to make your lives as Elasticsearch users better.
- Safe and sound following the recent Portlandia Snowpocalypse, Steve Mayzak's presentation to the Seattle Search and Machine Learning meetup group has been rescheduled for March 6th. Please join Steve starting at 7 PM to hear all about Elasticsearch 1.0.
- The Philadelphia Elasticsearch Meetup group has just been set up, and the organizers are figuring out the first meeting date. Join the meetup group to get regular updates.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
Trainings
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- Sydney - March 17, 2014
- Los Angeles - March 24, 2014
- Palo Alto - March 27, 2014