This Week in Elasticsearch - November 21, 2013
Welcome to This week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
multi_match
query now also accepts a string for thefields
in addition to an array (#4164, 0.90 & master)- Indices query/filter now skips parsing for irrelevant indices when possible (#2416, 0.90 & master)
- Added support for
_name
parameter in indices filter (#4166, 0.90 & master) - Indices aliases api uses the new generic ack mechanism (#4114, 0.90 & master)
- The cat API got documentation and a help (commit 1, 2, master only)
- Native scripts can set script values to primitive arrays (#4175, 0.90 & master)
- A deep pagination with only a few results could lead to overallocation of an array (#4156, 0.90 & master)
- The FilterBuilder interface now is consistent with the QueryBuilder
interface ( commit, 0.90 & master) - The
date_format
inside of the date mapper can now be updated at runtime (#3727, 0.90 & master) - A
SearchRequest
in anyPutWarmerRequest
is now mandatory and properly validated (#4196, 0.90 & master) - A field data based
TermsFilter
has been added (#4209, 0.90 & master) - Running the node stats api while a shard is moving onto the node, now does not log an exception anymore (#4203, 0.90 & master)
- Listing plugins on a directory with wrong permissions could lead to a
NullPointerException
(#4186, 0.90 & master) - Refactored open/close API to use the newly introduced generic ack mechanism (#4169, 0.90 & master)
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, as well as news about Logstash and Kibana.
- Barnaby Gray has written a blog post describing how to use Elasticsearch and Spark.
- Eve-elastic is a data layer using Elasticsearch for the python-based Eve framework, which allows building REST APIs easily.
- The creators of ArangoDB released an ArangoDB river to make data searchable via Elasticsearch.
- The Elasticsearch Puppet Module has been majorly updated and partly rewritten.
- The Extended Analyze Plugin, which adds some more information into the analyze API, has been released for version 0.6.0.
- Spring Elasticsearch 0.3 has been released
- Version 1.1.0 of the Baseform Analysis Plugin has been released
- Costin Leau, the driving force behind the Elasticsearch-Hadoop integration, was interviewed about Elasticsearch, BigData and Hadoop on infoq
- Hendrik Saly has updated his Windows MSI Installer for Elasticsearch, which now installs EA 0.90.7 (with Oracle JRE 7 Update 45).
- Several developers from Endgame have authored a post on BinaryPig: Scalable Static Binary Analysis Over Hadoop, which includes information on their use of Elasticsearch
- Jurriaan Persyn has written an Introduction to Elasticsearch based on presentations he has given at two events. The post includes links to the talk videos and slides.
- Thomas Ardal shared his experiences Implementing Date Histogram Facets with Elasticsearch and NEST.
- Michael Bouvy penned an article on how to Collect & visualize your logs with Logstash, Elasticsearch & Redis.
- Jason Wilder has written up an article comparing Logstash and Fluentd.
- Smile Open Source Solutions have authored an article Elasticsearch Overshadows Solr (en français)
- Hugo Lassiege has authored an article comparing different tools for log and storage analysis, including Elasticsearch (en français)
- Antoine Rey authored a post on Elastifying a MusicBrainz database on OpenShift (en français)
Slides
- You can watch Honza Kral's talk from PyCon Poland 2013: Explore Your Data with Elasticsearch
- Andrew Clegg, Head Data Geek at Pearson Technology, presented at last week's Elasticsearch London Meetup about Tuning Elasticsearch for Multi-Terabyte Analytics.
- Zuhaib Siddique, Infrastructure Engineer at Atlassian, posted his slides from last week's Elasticsearch San Francisco Meetup. The presentation covers how HipChat uses Elasticsearch in its infrastructure to provide near real-time search and chat history to the hundreds of thousands of active chatters using HipChat, scaling to over 1 billion messages.
- Sharif Olorin, Developer with Anchor Systems, has shared his slides from his presentation at the first Sydney Elasticsearch Meetup, Monitoring Elasticsearch for Fun, Profit and Not Getting Woken Up at 3am.
- Aaron Mildenstein presented an Introduction to Logstash - Or: How to wring useful data from those files just lying around using disk space at the Elasticsearch Austin Meetup.
- David Pilato's presentations from Devoxx 2013 are both available; check out Elastify Your Application: from SQL to NoSQL in Less than One Hour, presented with Tugdual Grall, and Make Sense of Your (BIG) Data.
- Xebia France created a presentation on Open XKE - Making the most of your data with ElasticSearch (en français)
Where to find Us
France
David Pilato will speak at Drupagora on December 5th, covering search solutions for Drupal using Elasticsearch. David's talk will begin at 3 PM.
Netherlands
- Elasticsearch will be at the CloudStack Collaboration Conference EU on November 20-22nd in Amsterdam. Stop by our table to say hello.
- Shay Banon will present Why We Built Elasticsearch at the Open Source Conference in Amsterdam on December 6th. Shay's talk will start at 4:05 PM.
Norway
Boaz Leskes and Karel Minarik will speak at the Elasticsearch Oslo Meetup on November 26th. Full details on their talks and other presentations by community members in Oslo will be published next week.
Spain
Clinton Gormley will speak at the NoSQL matters conference in Barcelona on Getting Down and Dirty with Elasticsearch. Clinton's talk takes place on Saturday, November 30th at 10:30 AM, and the conference runs November 29-30th.
United Kingdom
- Simon Willnauer will present Elasticsearch: With a Hammer in Your Hand at the NOSQL eXchange in London on November 28th. Simon's presentation begins at 1 PM.
- Simon will also speak at the CodeMesh conference from the 4th to the 5th of December.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
Trainings
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- New York - December 02, 2013
- Paris - December 05, 2013
- London - December 12, 2013
- Los Angeles - December 16, 2013