This Week in Elasticsearch - March 26, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
- Aggregations: Significant_terms agg only creates term frequency cache when necessary and uses new TermsEnum wrapper to cache frequencies (#5459, master, 1.1)
- Mapping: Improved
geo_pointparsing (#4711, master, 1.x)
- cat API: Added segments endpoint (#5118, master, 1.x, 1.1)
- Aggregations: Fix cardinality memory-usage considerations (#5452, master, 1.x, 1.1)
- Java API: Allow iteration over
MultiGetRequest#Iteminstances (#3061, master, 1.x, 1.1)
- Aliases: Creating an alias accepts a numeric routing value (#5471, master, 1.x, 1.0 and 0.90)
- Dependencies: Upgrade to Spatial4j 0.4.1 and JTS 1.13 (#5279, master, 1.x)
- Java API: Add
BoolFilterBuilder#hasClausesto be consistent with
BoolQueryBuilder(#5472, master, 1.x)
- Aggregations: Changed the DateHistogram.Bucket to return the date key in UTC timezone (#5477, master, 1.x, 1.0)
- Aggregations: Added extended_bounds support for
date_/histogramaggs (#5224, master, 1.x)
- Query Templates: Added dedicated
/_search/templateendpoint (#5353, master, 1.x)
- Recovery: Added recovery API to find out about current recoveries (#4637, master, 1.x)
- Query template: Mustache templates now escape JSON, not HTML (#6473, master, 1.x)
- Scroll API: Improved regular scroll api by using
IndexSearch#searchAfter()instead of regular search methods which rely on
from` for pagination (#, master, 1.2)
- Dependencies: Update to forbidden-apis 1.4.1 (#5492, master, 1.x)
- Discovery: The minimum master nodes setting could possibly not update correctly after changing it dynamically (#5494, master, 1.x, 1.0 and 0.90)
- Discovery: A master node operation can timeout in a rare race condition when a master has a connection issue which is quickly restored (#5499, master, 1.x)
- Mapping: Merge
geo_pointspecific settings on update (#5505, master, 1.x)
- Java API: Wrong
XContentParserwas returned (#5510, master, 1.x, 1.0 and 0.90)
- Mapping: Fix
include_in_allfor multi field (#5522, master, 1.x)
- Circuit breaker: Fix possible discrepancy in circuit breaker in parent/child (#5526, master, 1.x, 1.1)
- Mapping: Allow norms disabling on existing fields (#4813, master, 1.x)
- Aggregations: Internally manipulate the terms execution hint as an enum instead of a string (#5530, master, 1.x)
- Analysis: Added uppercase token filter (#5539, master, 1.x)
Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.
- We released Logstash 1.4 last week. You can read all about the enhanced features and the brand new Getting Started documentation in our release blog post. You may be also interested in reading the coverage of the announcement from InfoWorld.
- We are beyond excited to share Elasticsearch: The Definitive Guide with the community. We have been promising new documentation which provides a narrative approach to learning Elasticsearch, and we're proud of what we've delivered. The guide is meant to be accessible to new and experienced users alike. We welcome and encourage your feedback to improve it.
- Elasticsearch 1.1.0, 1.0.2 and 0.90.13 were released yesterday. You can learn all about the changes from the release blog post.
- Rashid Khan will host a live webcast on Kibana on Wednesday, April 9th at 8 AM Pacific / 11 AM Eastern / 4 PM UK / 5 PM CET. Registration is open now for the webcast.
- We've released several official Elasticsearch plugin updates: RabbitMQ 2.0.0, Mapper Attachment 2.0.0, Kuromoji 2.1.0, Phonetic 2.1.0
- The latest version of elastic.js has been released, including brand new support for aggregations.
- The Elasticsearch image plugin has been released as version 1.2.0
- The Clojure client Elastisch has been released in version 2.0.0-beta2
- Julio Antequera Galiano shared a post on how CookiesHQ, a boutique web agency, uses Elasticsearch to power their clients' Ruby based websites.
- Adam Bard shared a set of examples of how to get started using Elasticsearch and Ruby.
- The team at Camptocamp shared a blog post on using the ELK stack to make sense of geospatial data. You can read the post en français or in English.
- Olivier Balais wrote a post on using Elasticsearch with aliases and filters. (en français)
- JongMin Kim, the community organizer of the Elasticsearch Korea user group, posted his story of the community's first meetup. (한국어)
Slides & Videos
Elasticsearch New York City Meetup March 2014: Featuring speakers from Bloomberg and Shopwiki discussing their use cases for Elasticsearch, Logstash, and Kibana
David Pilato presents Elasticsearch sur Azure: Make sense of your (BIG) data at Microsoft Tech Days Paris 2014
Where to Find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Elasticsearch is very excited to send our first speaker from the company to Brasil! Leslie Hawthorn, our Community Manager, will be returning to FISL once again to speak on Community 2.0: Beyond Using Software Livre. Leslie will speak on May 7th and FISL 15 runs from May 7-10th in Porto Alegre. Her talk will be in English but most of the talks on the program are given in BR-PT. Leslie will also be on hand to answer questions you may have about Elasticsearch, Logstash and Kibana.
Honza Kral will be attending PyCon North America and the accompanying Django sprints. Make sure to stop by and hear more from him during his poster session Collect and Analyze your logs with Logstash, Elasticsearch and Kibana.
- Alexander Reelsen will be speaking at the Munich NoSQL Meetup on Thursday, March 27th. His topic will be building and running a performant distributed search engine using Elasticsearch.
- Alexander Reelsen will be at the Berlin Expert Days Conference (BED-Con) on April 3rd and 4th. He will present Creating realtime dashboards using Elasticsearch, Logstash and Kibana.
- Jordan Sissel will speak at the Open Source Data Center Conference in Berlin, discussing how to Find Happiness in Your Logs. The conference will run from April 8-10th. He will also be speaking at PuppetCamp Berlin, directly following the Open Source Data Center Conference in Berlin on April 11th. Please plan to stop by the Elasticsearch table at PuppetCamp Berlin to say hello to Jordan and Leslie!
- Boaz Leskes will be speak at NoSQL Matters Cologne on Elasticsearch: Deep dive into analytics using Aggregations. The conference runs from April 29-30th.
- David Pilato will present Make sense of your (BIG) data! at the Italian Cloud Conference The conference takes place in Torino on April 3rd, and David will speak at 10:30 AM.
- David Pilato will present Make sense of your (BIG) data! at the Codemotion Roma Conference The conference takes place in Rome on April 11-12th, and David will speak at 2:10 PM on the 12th.
The 4th Elasticsearch study session has been scheduled by Jun Ohtani. Please plan to join the meeting at 7 PM on April 21st.
The Elasticsearch Netherlands Meetup group will convene on Thursday, April 3rd at 6:30 PM at Elasticsearch's EU HQ in Amsterdam. Attendees will be treated to a deep dive on new features in Elasticsearch 1.0 by Luca Cavanna and a demo of Elasticsearch Marvel by Boaz Leskes.
The April Oslo Elasticsearch Meetup has been scheduled for April 3rd at 6 PM. Details on the presentations are forthcoming, but you can register to attend now.
Clinton Gormley will take the stage at ScaleConf to talk Scaling real time search and analytics with Elasticsearch. The conference runs April 10th and 11th in Cape Town.
Mark Harwood will be sharing his analysis of using Elasticsearch to find the "uncommonly common" results in searches - think fraud or anomaly detection - at the Financial Engineers and & Quants London Meetup. Join Mark on Thursday, April 24th at 6:30 PM at SkillsMatter. The organizers ask that you kindly register on both meetup.com and SkillsMatter website. A link to the registration form for SkillsMatter is include on the meetup.com invitation to the event. Attendance is free of charge.
- The Philadelphia Elasticsearch Meetup group will meet on Thursday, March 27th, covering an Introduction to Elasticsearch.
- Aaron Mildenstein will be speaking at the Bazaarvoice Tech Conference and Hackathon in Austin. The conference runs from April 2nd-4th and registration is required, but free of charge.
- Join us for the Elasticsearch Austin Meetup, on April 9th. Attendees will hear from from Zachary Tong on Elasticsearch & Query Optimization, and from Aaron Mildenstein on Logstash.
- For folks in Washington, DC, the Elasticsearch Meetup group will convene on April 10th at LivingSocial's offices. Their engineering team will present their Elasticsearch use case.
- Kevin Kluge will present ELK: How Elasticsearch, Logstash, and Kibana provide real-time data enlightenment at the DevNation Conference. Kevin's talk will take place on Thursday, April 17th at 9:45 AM. DevNation, co-located with Red Hat Summit, runs April 13-17 2014 at Moscone Center in San Francisco. Elasticsearch will be participating in the Partner Pavilion at Red Hat Summit, so if you are attending either conference we hope you will stop by our booth to say hello!
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: