Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
- Blocking writes on a tribe node creates a
blockstribe (#5389, master, 1.x, 1.0)
- The throttle type setting is not respected upon updates (#5392, master, 1.x, 1.0 and 0.90)
- Aggregations: Invoke
postCollectionon aggregation collectors (#5387, master, 1.x, 1.0)
- Unicast discovery should favour ping response with master over a ping response without master (#5413, master, 1.x, 1.0 and 0.90)
- Suggestions: The completion suggester now supports a context that allows for filtering of suggestions (#4044, master, 1.x)
- Fuzzy queries: Allow edit distances > 2 on
FuzzyLikeThisQuery(#5292, master, 1.x, 1.0)
- Aggregations: Replace
CacheRecyclerwith page based recycler (#4929, master, 1.x)
- Aggregations: A new cardinality aggregation has been added (#5426, master, 1.x)
- Percolator: Disabled query size estimation in percolator, because this is too expensive cpu wise (#5372, master, 1.x, 1.0)
- Aggregations: New
significant_termsaggregations (#5146, master, 1.x)
- Testing: upgrade randomized-testing to 2.1.1 (commit, master, 1.x, 1.0 and 0.90)
- Aggregations: Scripts in aggs could not return more than 4 values (#5414, master, 1.x, 1.0)
- Multicast: Allow to share multicast socket within jvm (#5410, master, 1.x)
- Mappers: Support
externalValue()in mappers (#4986, master, 1.x)
- Optimize: Force single-segment merges (#5243, master, 1.x)
match_phrase_prefixsupports slop again (#5437, master, 1.x)
BulkProcessorprocess every n+1 docs instead of n (#4265, master, 1.x)
- cat API: Add
_cat/pluginsendpoint (#4824, master, 1.x)
- Packaging: Move systemd files from
/usr/lib(#, master, 1.x, 1.0 and 0.90)
- MulticastChannel returned wrong channel in shared mode (#5441, master, 1.x)
- Count latch down if sendsPing throws exception (#5440, master, 1.x, 1.0 and 0.90)
- Snapshot/Restore API: Add stats for running snapshots (#4946, master, 1.x)
- BytesReference usage to properly work when
hasArrayis not available (#5455, master, 1.x)
- Geo Point Fieldmapper: Allow distance for
geohash_precision(#5448, master, 1.x, 1.0 and 0.90)
- Merging: use serial merge schedule by default (#5447, master, 1.x)
- Use BytesReference to write to translog files (#5463, master, 1.x)
Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.
- Kibana 3.0.0 has been released. The announcement post contains a couple of useful how to videos on using version 3.0.0. You may also be interested in attending our webinar on Kibana 3.0.0, which will air on April 9th.
- Elasticsearch Marvel version 1.1.0 was released last Thursday.
- The team at CenturyLink have released ElasticLINQ, a tool to query Elasticsearch using LINQ. Brad Wilson has full details.
- The team at TaskRabbit have released Waistband, a Ruby Gem to load up config files and provide you with some quality-of-life methods and classes when using Elasticsearch.
- Andreas Chatzakis wrote up a how to on Deploying Elasticsearch using AWSOpsworks.
- Damien Bod authored a how to on Semantic Logging with Elasticsearch for .Net users.
- Daedel, a Ruby gem that makes it easier to create queries in Elasticsearch, has just had a new release, version 0.0.9.
- Aggregations support has just been added to Goes,a Go library for Elasticsearch.
- Dan Radez shared a post on using the ELK stack along with OpenStack.
- Olivier Bourgain wrote an overview of Elasticsearch 1.0.0 and 1.0.1. (en français)
- Grégory Quatannens authored an article on using Elasticsearch and Symfony to export data from Elasticsearch into spreadsheet programs. (en français)
- The team at Smile wrote up a how to on using Elasticsearch, Kibana and Talend to analyze geographic data. (en français)
Slides & Videos
Jordan Sissel and Rashid Khan talk the ELK stack and Elasticsearch Marvel on Hangops
- Britta Weber shared her slides Scoring for Human Beings, on Elasticsearch's Function Score Query.
- Lee Hinman posted his slides Logstash by Example and the accompanying examples, an introduction to Logstash through the lens of use cases.
- Log and Event Management with Logstash (auf Deutsch)
- Shay Banon shared the slides from his CeBIT 2014 Keynote: Make Sense of Your Data.
Interview with Shay Banon from CeBIT 2014
Where to Find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Honza Kral will be attending PyCon North America and the accompanying Django sprints. Make sure to stop by and hear more from him during his poster session Collect and Analyze your logs with Logstash, Elasticsearch and Kibana.
- Alexander Reelsen will be attending DevCamp Karlsruhe on March 21-23rd. Say hello when you pass him in the hallway track.
- The first ever Stuttgart Elasticsearch Meetup will take place on March 25th at 7 PM. Alexander Reelsen will be covering What's New in Elasticsearch 1.0.
- Patrick Peschlow will talk about talk about Elasticsearch and his experiences at JavaLand 2014. His presentation is scheduled for March 25th in Brühl.
- Alexander Reelsen will be speaking at the Munich NoSQL Meetup on Thursday, March 27th. His topic will be building and running a performant distributed search engine using Elasticsearch.
- Alexander Reelsen will be at the Berlin Expert Days Conference (BED-Con) on April 3rd and 4th. He will present Creating realtime dashboards using Elasticsearch, Logstash and Kibana.
- Jordan Sissel will speak at the Open Source Data Center Conference in Berlin, discussing how to Find Happiness in Your Logs. The conference will run from April 8-10th.
- Boaz Leskes will be speak at NoSQL Matters Cologne on Elasticsearch: Deep dive into analytics using Aggregations. The conference runs from April 29-30th.
- David Pilato will present Make sense of your (BIG) data! at the Italian Cloud Conference The conference takes place in Torino on April 3rd, and David will speak at 10:30 AM.
- David Pilato will present Make sense of your (BIG) data! at the Codemotion Roma Conference The conference takes place in Rome on April 11-12th, and David will speak at 2:10 PM on the 12th.
The 4th Elasticsearch study session has been scheduled by Jun Ohtani. Please plan to join the meeting at 7 PM on April 21st.
The Elasticsearch Netherlands Meetup group will convene on Thursday, April 3rd at 6:30 PM at Elasticsearch's EU HQ in Amsterdam. Attendees will be treated to a deep dive on new features in Elasticsearch 1.0 by Luca Cavanna and a demo of Elasticsearch Marvel by Boaz Leskes.
The Ellerslie .Net User Group will talk all things Elasticsearch on Tuesday, March 25th. Doors open at 6 PM.
The April Oslo Elasticsearch Meetup has been scheduled for April 3rd at 6 PM. Details on the presentations are forthcoming, but you can register to attend now.
Clinton Gormley will take the stage at ScaleConf to talk Scaling real time search and analytics with Elasticsearch. The conference runs April 10th and 11th in Cape Town.
- New: Triangle DevOps Meetup: Tonight, Wednesday March 18th, this group will gather in Durham, North Carolina at 7 PM. The group will discuss how Wikipedia uses Elasticsearch. Registration is still open.
- The Elasticsearch New York March Meetup has been scheduled for Thursday, March 20th from 6:30-8:30 PM. Attendees will hear from Bloomberg and Shopwiki on their use of the ELK stack (Elasticsearch, Logstash and Kibana).
- The Elasticsearch Los Angeles March Meetup will take place on Tuesday, March 25th. Presenters will cover various topics including Elasticsearch at high scale, plus Uri Boness will address What's New in Elasticsearch 1.0. Andrew Selden will accompany Uri for the Q&A portion. Doors open at 7 PM.
- The Philadelphia Elasticsearch Meetup group will meet on Thursday, March 27th, covering an Introduction to Elasticsearch.
- We're still putting the finishing touches on the next Elasticsearch Austin Meetup, but looks like we're getting together on April 9th. Plan to hear from Zachary Tong on Elasticsearch & Query Optimization, and from Aaron Mildenstein on Logstash.
- Kevin Kluge will present ELK: How Elasticsearch, Logstash, and Kibana provide real-time data enlightenment at the DevNation Conference. Kevin's talk will take place on Thursday, April 17th at 9:45 AM. DevNation, co-located with Red Hat Summit, runs April 13-17 2014 at Moscone Center in San Francisco.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- Amsterdam - April 08, 2014 (core Elasticsearch training)
- Austin - April 09, 2014 (core Elasticsearch training)
- New York - April 23, 2014 (core Elasticsearch training)
- San Francisco - April 23, 2014 (core Elasticsearch training)
- Washington DC - April 28, 2014 (core Elasticsearch training)
- London - April 29, 2014 (core Elasticsearch training)