This week in Elasticsearch - August 20, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
- Java client API:
CreateIndexRequestBuilder.addMapping
throwsIllegalStateException
if you add same type more than once (#7231, master and 1.4) - Core: Store index creation time in index metadata (#7119, master and 1.4)
- Geo: Fix computation of geohash neighbours (#7226, master, 1.4 and 1.3)
- Query API: Remove
numeric_range
filter (#7108, master) - Update API & Indices stats: fixed version checks for no-op updates which got in after 1.3 was released (#6822, master and 1.4)
- Netty: A content decompressor that throws a human readable message when compression is disabled and the user sends compressed content (#7241, master and 1.4)
- Scripting: Add
groovy.util.GroovyCollections
to the defaultreceiver_whitelist
(#7089, master and 1.4) - Metadata: Forbid index names over 100 characters in length (#4417, master and 1.4)
- Internal: Adjusted
BroadcastShardOperationResponse
subclasses visibility (#7255, master and 1.4) - Plugins: Add executable flag to every file in
bin/
after install (7177#, master and 1.4) - Geo: Improved error handling in
geo_distance
filter (#7260, master and 1.4) - REST API: Allows all options for
expand_wildcards
parameter (#7258, master and 1.4) - Dependencies: Update forbidden-apis to 1.6.1 (#7158, master and 1.4)
- Aggregations: Make the list of buckets for terms and histogram returned as a
java.util.List
(#7275, master and 1.4) - Mapping: Fixes using nested doc array with strict mapping (#7304, master and 1.4)
- Geo: Added support for GeoJSON
GeometryCollection
(#2796, master and 1.4) - function_score: remove explanation of query score from functions (#7245, master and 1.4)
- Core: switch to fixed thread pool by default for management threads (#7318, master, 1.4 and 1.3)
- Cli: parsing multiple times throws
AlreadySelectedException
(#7282, master and 1.4) - Aggregations: Add
children
bucket aggregator that is able to map buckets between parent types and child types (#6936, master and 1.4) - Internal: get request while percolating existing documents to keep around headers (#7333, master and 1.4)
- Core:
DistributorDirectory
shouldn't search for directory when reading existing file (#7306, master, 1.4 and 1.3) - Aggregations: Merge
LongTermsAggregator
andDoubleTermsAggregator
(#7279, master and 1.4) - Internal: made it possible to disable the main transport handler in
TransportShardSingleOperationAction
(#7285, master and 1.4) - Internal: auto create index to keep around headers and context of the request that caused it (#7331, master and 1.4)
- Transport: Refactor guice startup code (#7289, master and 1.4)
- Dependencies: Upgrade to Netty 3.9.3.Final (#7328, master and 1.4)
- Dependencies: Upgrade to Jackson Smile 2.4.1.1 (#7327, master and 1.4)
- Snapshot/Restore API: Fix NPE in
SnapshotsService
on node shutdown (#6506, master, 1.4 and 1.3) - Snapshot/Restore API: Added snapshot checksum verification (#5593, master and 1.4)
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.
- We've released Elasticsearch Hadoop 2.0.1 and 2.1.beta1.
- Our partner firm, Comperio, brings you the ELK stack in one (Vagrant) box. Thanks folks!
- The fine folks at Yelp are celebrating their 10th anniversary, and to celebrate they've shared all about how they use Elasticsearch to visualize trends in reviews. Cool stuff. And happy anniversary, Yelp!
- It's good to be loved. Lots of big companies like Yelp use Elasticsearch, but it's great to see that start ups think we're awesome, too.
- Jon Ingle with Lithum tells us all about how he tried to break Elasticsearch to save some IT budget. Great article on stress testing and tuning Elasticsearch for your use case. Spoiler alert: Jon did not break Elasticsearch, but did save money. Win-wins FTW!
- Speaking of FTW!, Jay Conway thinks Logstash and Redis are all about winning. Check out his post, which includes some nice use case details. (PS- Jay, we bet you're full of win, too!)
- Alex Brastevik shared some Elasticsearch search optimization tips, bringing you simple suggestions for speedier searches.
- Kiyoto Tamura wrote a detailed tutorial on using Elasticsearch, Kibana and Fluentd for log search and visualization.
- Our partner firm, Exensio, has authored an article on using Elasticsearch's aggregations along with D3.js to visualize data from IoT devices. (auf Deutsch)
Slides & Videos
Jeffrey Sogolov on the ELK Stack (and how it can save you millions of dollars!)
Our very own Alex Ksikes on multimedia search, matching procedures and a little bit of Apache Lucene on the side
Luca Cavanna gives you all the news you can use on the latest features in Elasticsearch
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash, and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Germany
If you're heading to FrOSCON on August 23rd & 24th, we're happy to bring you bouncy castle & ball pool love this year. And make sure to see Isabel Drost-Fromm on Your Search Doesn't Work.
United Kingdom
Please join the folks from the Enterprise Search Cambridge group for a full day Elasticsearch hackathon! You can register now to attend.
United States
- New meetup on TONIGHT: Join us in Chicago to hear from Andrew Selden, Drew Raines and our hosts, kCura. Register now - we still have a bit of room!
- Heading to Chicago for LinuxCon and Cloud Open North America? Say hello to Leslie Hawthorn, and check out her panel "Empowering Your Corporate Open Source Software Developers" on August 21st.
- If you're attending the Heartland Developers Conference in Las Vegas, make sure to check out Andrew Oschner's talk on the ELK stack. Andrew will teach you all about troubleshooting logging in production, and he'll have some cool Elasticsearch swag to hand out to session participants. Andrew speaks on September 4th, and the conference runs the 3rd-5th.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticsearch, Kibana, and Logstash than where you rest your head.
Trainings
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- New York - August 27, 2014 (ELK workshop)
- London - September 2, 2014 (core Elasticsearch training)
- London - September 4, 2014 (ELK workshop)
- Paris - September 9, 2014 (core Elasticsearch training)
- Berlin - September 17, 2014 (core Elasticsearch training)
- Austin - September 18, 2014 (ELK workshop)
- Paris - September 25, 2014 (ELK workshop)