Welcome to This week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
- Aggregations have landed in master! (#3300, master)
- Update to Lucene 4.6.0 (#4241, 0.90 & master)
- Importing and running the elasticsearch code base into eclipse is now easier
(commit, 0.90 & master) - Library upgrades: forbiddenapis 1.4, randomized test runner maven plugin (commits 1, 2, 0.90 & master)
- Snapshot/Restore: Prevent modification or deletion of repositories during snapshot
(commit, master) - Added
mlockallsetting to process info output (#4233, 0.90 & master) - During node startup local primaries are now preferred to relocating primaries (#4237, 0.90 & master)
RobinEngine.acquireSearcher()should fail with state failure when not set/closed (#4232, 0.90 & master)- Bulk requests support shard timeout like the index api (#4220, 0.90 & master)
- Deprecate
numeric_rangefilter, add a field data execution option to range filter (#4034, 0.90 & master) - Ongoing effort to reduce excessive object allocation due to copying maps around by switching to
ImmutableOpenMap(commits 1, 2, 0.90 & master) - Allow to parse directly the compressed mapping (commit, 0.90 & master)
- The completion suggester code has been updated to the current lucene release (commit, 0.90 & master)
- Cat API: Add
hparameter to apis, allowing to return columns and descriptions for them (#4262, master only) - MultiTermVector API and TermVector API were unified (commit, master only)
- Multi term vector request never returned if shards for all requested documents were non existent. (#3989, master)
- Fixed file-based template loading via
config/templates(#4235, 0.90 & master only)
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, as well as news about Logstash and Kibana.
- Lisa Sensmeier with Hortonworks, a partner of Elasticsearch Inc, penned a post on Fast Search and Analytics on Hadoop with Elasticsearch.
- Ben Hundley with StackSearch, also an Elasticsearch partner, shared a blog post Launching and Scaling Elasticsearch.
- Daniel Guo and other volunteers in China have created new resources for users who speak Chinese, including the start of translations of the Elasticsearch website and a wiki for users to help each other use Elasticsearch. You can find out more on the Elasticsearch community page.
- Sarath Pillai created a tutorial on Logstash.
- Florian Hopf shared a how to artcile on Reindexing Content in Elasticsearch.
- Doug McClure shared his experiences performing event analysis using Logstash and SCALA.
- Vojtěch Hýža released a plugin for the JLemmaGen project on github, which supports dictionary based lemmatization for 15 languages.
- Terry Patterson wrote up his experiences using Elasticsearch, Logstash and Kibana in conjunction with his Blackboard installation.
- The metrics-elasticsearch-reporter, which reports data generated by the metrics library, has been released as version 1.0 to maven central.
- Martijn van Groningen wrote about the new distributed percolator coming in elasticsearch 1.0 - which you can already test with the current beta version.
- Jelle Smet created a how to on submitting Elasticsearch metrics to Graphite.
- Alex Brasetvik with Found shared more information on Play as service that allows users to test drive features of Elasticsearch.
- Rossi Oddet wrote up a great summary of David Pilato's presentation, Elasticsearch: From SQL to NoSQL in Less than an Hour, at the November Nantes JUG meeting. (in french)
- The AWS cloud plugin was released in version 1.16.0.
- The wikipedia river was released in version 1.3.0.
Slides
- Tomas Jansson shared the slides from his presentation Getting Started with Elasticsearch on Windows and .Net with NEST.
- Gérald Croes and Julien Salleyron posted the slides from their presentation Look no further than Elasticsearch as presented at the Forum PHP Paris 2013 conference. (in french)
Where to find Us
France
David Pilato will speak at Drupagora on December 5th, covering search solutions for Drupal using Elasticsearch. David's talk will begin at 3 PM.
Netherlands
Shay Banon will present Why We Built Elasticsearch at the Open Source Conference in Amsterdam on December 6th. Shay's talk will start at 4:05 PM.
Spain
Clinton Gormley will speak at the NoSQL matters conference in Barcelona on Getting Down and Dirty with Elasticsearch. Clinton's talk takes place on Saturday, November 30th at 10:30 AM, and the conference runs November 29-30th.
United Kingdom
- Simon Willnauer will present Elasticsearch: With a Hammer in Your Hand at the NOSQL eXchange in London on November 28th. Simon's presentation begins at 1 PM.
- Simon will also speak at the CodeMesh conference from the 4th to the 5th of December.
United States
- Lee Hinman will discuss all the elasticsearch 1.0 features at the Denver meetup on December 3rd
- The December Elasticsearch Boston Meetup will take place on Wednesday the 4th in Cambridge, Massachusetts. Speakers will cover how Elasticsearch is used at GetHuman and Swoop. Doors open at 6 PM.
- The December Elasticsearch Washington, D.C. Meetup will take place on Tuesday the 10th at NGP VAN's offices. We'll be sharing more talk details soon, but a draft agenda is available now and registration is open. The meeting will begin at 6:30 PM.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note.  We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
Trainings
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: