This Week in Elasticsearch - February 12, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
- Aggregations: Support camel-case style in options (#5009, master, 1.x, and 1.0)
- Query API: Added
cross_fields
mode to multi_match query (#5005, master and 1.x) - Query API: Add fuzzy/slop support to
simple_query_string
(#4985, master and 1.x) - Lucene: Added
IndexReader
reference counting methods to forbidden APIs (commit, master, 1.x, 1.0 and 0.90) - Lucene: Use patched version of ReferenceManager to prevent infinite loop in
ReferenceManager#acquire()
(commit, master, 1.x, 1.0 and 0.90) - Aggregations: Fix
BytesRef
owning issue in string terms aggregations (#5021, master, 1.x, and 1.0) - Aggregations: Geo-hash grid aggregations: make
size==0
return all hashes (#4875, master and 1.x) - Aggregations: Fixed parsing time zones as numeric value in
DateHistogramParser
(#5057, master, 1.x and 1.0) - Lucene: Log error if
IndexSearcher
is tried to be released a second time (commit, master, 1.x, 1.0 and 0.90) - Logging: Fixed trace logging hidden by check for
isDebugEnabled
(commit, master, 1.x, 1.0 and 0.90) - Plugins: Upgrading analysis plugins failed (#5030, master, 1.x, 1.0 and 0.90)
- Shard state: Bulk process of shard started/failed should not execute on already processed events (#5061, master, 1.x, 1.0 and 0.90)
- Cluster State: Added
version
andmaster_node
flags to cluster state (commit, master, 1.x, 1.0 and 0.90) - Lucene internals: Prevent possibly undefined behaviour in
SearchContext
due to the initial state of aDocSetIterator
(#5049, master, 1.x, 1.0 and 0.90) - Custom scoring: Remove
custom_score
andcustom_boost_factor
queries (#5076, master, 1.x) - Zen discovery: Allow to dynamically change
discovery.zen.publish_timeout
using cluster update settings (#5063, master, 1.x) - Migrating NodesInfo API to use plugins instead of singular word plugin to be more consistent (#5072, master, 1.x)
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, and news about Logstash and Kibana.
- Shelby Sturgis treated us to a how to on using Elasticsearch 1.0's Aggregations feature along with D3 to produce some pretty nifty data visualizations.
- Costin Leau has released Elasticsearch for Apache Hadoop, version 1.3 M2.
- Two new releases of the thrift plugin supporting 0.90 and 1.0 have been released
- Lee Hinman wrote an Elasticsearch mode for Emacs
- Troy Harris tells you all about why Kibana is as close as you'll get to Batman's utility belt on The Guardian's Developer Blog.
- John Stanford shared a walk through of migrating from using facets to aggregations in the 1.0 branch.
- Gert Leenders wrote a tutorial on using Logstash to with Glassfish server logs.
- Curator is now available as a PyPI package.
- Greg Brown published Part 2 of his blog series scaling on Elasticsearch, with this second post focused on Indexing.
- Dave Fauth continued his blog series on extracting data from the United States' Federal Business Opportunities portal, with his latest offering covering using Elasticsearch with Mortar.
- Peter Tribble authored a post on efficiently using Logstash with Solaris zones.
- Dennis Probst shared a concise introduction into Elasticsearch.
- Florian Hopf wrote about running Elasticsearch distributed, and what to keep in mind when scoring comes into play in a distributed system.
- Xiao Yu released a new plugin called Whatson for visualizing nodes, indices and shards within an Elasticsearch cluster.
- Christian Rieck created a how to on doing dynamic search ranking using Elasticsearch, Neo4j and Piwik.
- Spring Data Elasticsearch 1.0M1 has been released
- Masahiro Nakagawa authored a post on analyzing event logs using Elasticsearch and Fluentd.
- Jun Ohtani shared a write up on the 3rd Elasticsearch Tokyo Meetup. (日本語)
Slides & Videos
Craig Lebowitz presents Adding Elasticsearch To An Existing .NET / SQL Server Application at February's Washington DC Meetup
- Britta Weber presented last week at Search Meetup Munich about Scoring for human beings
- Alexander Reelsen presented yesterday at Lightweight Java User Group Munich about Using Elasticsearch, logstash & kibana to create custom dashboards
- Ben Hundley presented at last week's Boston Meetup on using Elasticsearch to score images by color.
- Timon Vonk shared his slides from the recent Utrecht Ruby Meetup, which provide a great overview of Elasticsearch and why you should use it.
- Got slides or videos we should be sharing in This Week in Elasticsearch? Let our Community Manager, Leslie Hawthorn, know.
Alexander Reelsen provides an in-depth look at the ELK stack, from last week's OOP Konferenz.
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Australia
Britta Weber and Lee Hinman will headed Down Under to teach training courses in Melbourne and Sydney, and we're working to schedule meetups during their visit. We hope to have full details by next week's edition of This Week in Elasticsearch, but for now you can save the date. We're targeting March 13th for the Melbourne Meetup and March 24th for Sydney.
Canada
- Steve Mayzak will present on Elasticsearch in the Real World plus What's New in 1.0 at the upcoming Polyglot Vancouver Meetup. The meetup will take place on March 5th starting at 6 PM.
- The Elasticsearch Montreal Meetup group has scheduled their first meeting for March 12th at 7 PM.
France
David will speak on Elasticsearch: Make sense of your (BIG) data on Azure! at Microsoft Tech Days in Paris. David's presentation is scheduled for February 13th at 4:30 PM.
Slovakia
Honza Kral will speak at the Rubyslava International MiniConference on February 27th. The conference takes place in Bratislava.
United Kingdom
- Shay Banon and Graham Tackley from The Guardian will share the stage at QCon London, discussing How Elasticsearch Powers The Guardian's Newsroom. Several folks from the Elasticsearch team will also be on hand in Booth 12 to answer questions. Stop by and say hello! QCon runs March 3-7th.
- The Enterprise Search Cambridge UK Meetup will feature a presentation on how Rangespan uses Elasticsearch. The meetup convenes on March 5th and doors open at 7 PM
United States
- Several folks from Elasticsearch will be attending the Strata Conference from February 11-13th in Santa Clara, California. Stop by our booth to say hello!
- The Boston Azure User Group will convene on February 20th at 6 PM. Chris Morley will present on Elasticsearch Running on Linux in Azure.
- Leslie Hawthorn, Kevin Kluge and Jordan Sissel will all be presenting at the 12th Annual Southern California Linux Expo, a.k.a. SCALE 12x. If you can't catch the talks, make sure to stop by our table to say hello. SCALE runs from February 21st-23rd.
- The second Los Angeles Elasticsearch Meetup will be held on Friday, February 21st at SCALE 12x. Join us for casual discussion and refreshments. You don't have to be attending SCALE to come to the meetup, but the organizers have offered a generous discount on conference passes to meetup attendees. We'll get together at starting at 7 PM.
- The Elasticsearch Denver Meetup group will be getting together on February 24th to hear about Automattic's use of Elasticsearch. Doors open at 6:30 PM and Elasticsearch core developer Lee Hinman will also be on hand for Q&A.
- The Elasticsearch San Francisco Meetup group will focus on Benchmarking, Autoscaling and Deployment Automation at their next meetup. Elasticsearch core developers Uri Boness and Andrew Selden will be on hand for Q&A following the presentations. Doors open at 6:30 PM on February 27th.
- We've set the date for the first ever Elasticsearch Portlandia Meetup on March 4th. Steve Mayzak will cover Elasticsearch 1.0 - Whats new and how are people using it? Our community manager, Leslie Hawthorn, will also be visiting from Europe. She's looking forward to hearing from everyone about what could be done to make your lives as Elasticsearch users better.
- Safe and sound following the recent Portlandia Snowpocalypse, Steve Mayzak's presentation to the Seattle Search and Machine Learning meetup group has been rescheduled for March 6th. Please join Steve starting at 7 PM to hear all about Elasticsearch 1.0.
- The Philadelphia Elasticsearch Meetup group has just been set up, and the organizers are figuring out the first meeting date. Join the meetup group to get regular updates.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
Trainings
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: