Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
- Packaging: Don't remove ancestors on deb removal (#7078, master and 1.4)
- Term Vectors API: generate all possible TVs of a document (#7061, master and 1.4)
- Bulk API: Cluster block with auto create index bulk action can cause bulk execution to not return (#7109, master, 1.4 and 1.3)
- Sorting: Allow many to many geo point in geo distance sorting (#3926, master and 1.4)
- Mapping: Generate timestamp when path is
null
(#7036, master and 1.4) - Search Exists API: Checks if any matching documents exist for a given query (#6995, master and 1.4)
- Mappings: Fix
copy_to
behavior on nested documents (#7079, master and 1.4) - Aggregations: Fix infinite loop in the histogram reduce logic (#7022, master and 1.4)
- Sort: Make
ignore_unmapped
work for cross-index queries (#7039, master and 1.4) - Aggregations: Added
filters
aggregation (#6118, master and 1.4) - Suggestions:
CompletionMapper
throws misleading error on null value (#6399, master and 1.4) - Reroute API: Fix serialization bug (#7135, master, 1.4 and 1.3)
- Netty: Support defaults for
tcpNoDelay
andtcpKeepAlive
(#7136, master and 1.4) - CLI: Added a cli infrastructure (#7094, master and 1.4)
- Aggregations: Add Google normalized distance and chi square to significant terms (#6858, master and 1.4)
- Get API: Add parameter to GET for checking if generated fields can be retrieved (#6676, master and 1.4)
- Percolator: Cache index field data instances (#7081, master, 1.4 and 1.3)
- Mapping: add new
default
option for timestamp field (#7036, master and 1.4)
You too can start a six node ElasticSearch cluster in under 10 minutes!
— Megabyte Mike (@megabytemike) August 5, 2014
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.
- Thanks to the work of our own Aaron Mildenstein, we just released the newest version of Elasticsearch Curator - that's 1.2.0 for those counting along at home.Curator 1.2.0 was released
- We released an update to our elasticsearch-python client.
- This past Monday, we announced our partnership with Concurrent - and their Cascading development framework - to help accelerate big data application deployment.
- In case you haven't yet brushed up on your scripting knowledge lately, here's the link one more time to a very helpful blog post from our team when it comes to Scripting and Security.
- Community member Idan Fridman faced a project that had him working on the manipulation of 100,000 requests per day of raw data from multiple client devices. See how he used Elasticseach NodeJS and ExpressJS to help him meet the needs of his project.
- If you've ever wondered how Serendip.me's social music service gives you the music you want to hear or that is recommended for you based on your listening habits, we've got the presentation for you.
- In case you have yet to fulfill your weekly use case fix, our partner Comperio brings you the story of SharePoint ULS log analysis using ELK.
- And because good things come in threes, here's one more partner blog this time from Found on Getting Started with LIRE and Elasticsearch.
Total #ipv4s plotted in #kibana/#elasticsearch. US has 5x more than closest rival. pic2 by Top 10 Country Population. pic.twitter.com/7r41PJQjE0
— Bhaskar Karambelkar (@bhaskar_vk) August 5, 2014
Slides & Videos
For those of you who want to get your hands dirty with the ES-PHP client, here's a nice intro tutorial for you to sing along with.
Were you at OSCON a few weeks back? The Elasticsearch team was and there were some great talks from our merry band of humans - including this one from our intrepid community manager Leslie Hawthorn.
And lest we forget, there were also a few great OSCON presentations from our amazing Elasticsearch community members, including this presentation from our friends at Mozilla.
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash, and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Germany
If you're heading to FrOSCON on August 23rd & 24th, we're happy to bring you bouncy castle love this year. And make sure to see Isabel Drost-Fromm on Your Search Doesn't Work.
Poland
The Warsaw Java Users Group is holding a Microservices Hackathon on August 9th from 10 AM to 10 PM. You can spend those twelve hours hacking on the ELK stack and a variety of other tools. Register now to attend.
United States
Heading to Chicago for LinuxCon and Cloud Open North America? Say hello to Leslie Hawthorn, and check out her panel Empowering Your Corporate Open Source Software Developers.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note.  We care more about your skill set and passion for Elasticsearch, Kibana, and Logstash than where you rest your head.
Training
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- Sao Paulo - August 14, 2014 (core Elasticsearch training)
- Rio de Janeiro - August 18, 2014 (core Elasticsearch training)
- Boston - August 27, 2014 (core Elasticsearch training)
- New York - August 27, 2014 (ELK workshop)
- San Francisco - August 28, 2014 (ELK workshop)
- London - September 2, 2014 (core Elasticsearch training)
- London - September 4, 2014 (ELK workshop)
- Paris - September 9, 2014 (core Elasticsearch training)
- San Francisco - September 9, 2014 (core Elasticsearch training)
- Boulder - September 16, 2014 (core Elasticsearch training)
- Berlin - September 17, 2014 (core Elasticsearch training)
- Austin - September 18, 2014 (ELK workshop)
- Paris - September 25, 2014 (ELK workshop)