This Week in Elasticsearch - October 30, 2013
Welcome to This week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
- We upgraded to Lucene 4.5.1 (commit, 0.90 & master)
- The Transport mechanism now has a separate channel for recovery, so it wont collide with bulk requests (#3954, 0.90 & master)
- Fielddata was refactored, simplified and therefore now is a bit faster (commit, 0.90 & master)
- The windows service script now detects JREs, supports a stop timeout and a startup mode (#3938, #3962, #3928, 0.90 & master)
- Highlighting can return excerpt with no highlights (#1171, 0.90 & master)
- Fixed a
multi_matchquery when using
lenientand field weight (#3797, 0.90 & master)
- A new highlighter implementation called
PostingsHighlighteris now supported (#3704, 0.90 & master)
- CompletionFieldMapper returns an error if weight is no integer (#3977, 0.90 & master)
has_childquery could cause an infinite loop (100% CPU) when used in bool query (#3955, 0.90 & master)
- Rename and document
index.mapping.date.parse_upper_inclusivesetting for date fields (#3914, 0.90 & master)
- PreBuilt analyzers are now versioned on index creation (#3790, 0.90 & master)
- mget API supports global routing parameter (#3996, 0.90 & master)
- The cat API got a recovery information endpoint (#3969, master only)
- Nodes stats: Path, dev and mount fields can now be retrieved using the Java API (#4004, 0.90 & master)
- When a node completes recovering a shard, a message is sent to master. If the master is not available, it now is ensured to be sent again (#4009, 0.90 & master)
Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, as well as news about Logstash and Kibana.
- Featured blog post on elasticsearch.org: Using Elasticsearch for Rapid Development
- Florian Hopf wrote a summary about how Kiln and GitHub are using elasticsearch
- The Scala client elastic4s has been released as version 0.90.5.0, which is compatible with elasticsearch 0.90.5
- Eric LeBlond did a write up on using Logstash and Suricata.
- The Typo3 content management system project has begun adding Elasticsearch support to their redesigned CMS offering, Neos
- Alexander Cherednichenko created sample application using Node.js, Elasticsearch, MongoDB and ext.js all running on Heroku.
- You can watch the video of Itamar Syn-hershko's recent presentation on Full-Text Search with Lucene and Elasticsearch.
- Bogdan Dumitrescu wrote a blog post on How to Avoid the Split-Brain Problem in Elasticsearch.
- The Chef cookbook has been updated: Most important changes include improving documentation and adding the `skip_restart` option.
- Joel Abrahamsson has written an article on Grouping in Elasticsearch Using Child Documents.
- Pablo Godel has released logstash-pusher a CLI tool to send data to Logstash through Redis.
- Murhaf Feras created a how-to on Instant Search with AngularJS and Elasticsearch
- David Fauth wrote an excellent article on Creating an Elasticsearch index of United States' Congress Bills Using Pig.
- John Gifford from Loggly shares his Confessions of a Search and Logging Addict about Loggly's use of Elasticsearch in their 2nd generation product.
- Hendrik Saly released a set of scripts to build an MSI installer for installing Elasticsearch as a Windows service.
Honza Kral will be presenting The "What" and "Why" About Python in Elasticsearch on October 31st. You can watch live at 9 AM Pacific Time, 5 PM in the UK or 6 PM CET, followed by real-time Q&A with Honza and other members of the Elasticsearch core developer team. For those who are not able to join the broadcast, it will be archived for later playback. Registration is required.
- Britta Weber shared her slides on the Elasticsearch function_score as presented at last night's Elasticsearch Berlin User Group meeting.
- David Pilato has shared his slides from last week's presentation at SoftShake.ch on Making Sense of your (BIG) Data
- We also have a Speaker Deck account for all presentations given by Elasticsearch's employees that may be a useful reference resource for you.
- Valentino Gagliardi posted a presentation on Open Source Log Analysis with Logstash, Elasticsearch and Kibana (Italian)
Where to find Us
We're working on scheduling meetups in Sydney on November 18th and Melbourne on November 21st to coincide with our Elasticsearch training courses. We'll update everyone once all details are confirmed.
If you're heading to Devoxx Belgium 2013, be sure to check out David Pilato on Elastify Your App: From SQL to NoSQL in Less than One Hour. David will speak on Wednesday, November 13th at 3:10 PM in Room 6. David will also give a lightning talk, Make Sense of Your (BIG) Data on Thursday, November 14th at 1:10 PM in Room 9. Devoxx Belgium runs from November 11-15 at the Metropolis Business Center in Antwerp.
Elasticsearch community members in Brasil have created a Brasilian Portugese mailing list for folks to discuss Elasticsearch in their native tongue. You can join the mailing list now and we will have an update on their first meetup coming soon.
- David Pilato will present Elastify your app at the Nantes Java User Group meeting on November 4th. The meeting begins at 7:00 PM.
- You can also see David speak on Advanced Elasticsearch and Kibana at Zenika's Night Class on November 7th. The class begins at 7:00 PM.
- Several Elasticsearchers will be attending the W-JAX Conference in Munich from November 4th to the 8th. You can stop by our booth to visit with Alexander Reelsen and Britta Weber, and make sure to catch Alex's talk on Elasticsearch: Beyond full-text search on Wednesday, November 6th at 10:15 AM.
- From W-JAX, Alex and Britta will head to Hamburg for Developer-Conference.eu on Thursday and Friday, November 7th and 8th. Alex will once again present on Elasticsearch: Beyond full-text search on Thursday at 1 PM in the Cinema Three room.
- Alex also organizes the Munich Search Meetup group, and will be hosting a meetup on November 20th. The meetup begins at 6:45 PM.
The Elasticsearch User Group in Japan will meet for a study session on November 12th in Tokyo. The meeting begins at 7 PM.
Elasticsearch will be at the CloudStack Collaboration Conference EU on November 20-22nd in Amsterdam. Stop by our table to say hello!
- We'll be out in force at Strata London from November 11-13th, with both Shay Banon and Costin Leau attending the conference. You can stop by the Elasticsearch booth to meet with both of them during the conference. Shay will present at the Big Data London Meetup, taking place on the first evening of Strata London.
- Shay and Costin will also be attending the London Elasticsearch Meetup on November 11th, where they'll be available for audience Q&A following presentations from Graham Tackley with The Guardian and Andrew Clegg with Pearson. The meetup will start at 6:30 PM at Red Badger's offices.
- Drew Raines and Igor Motov will both present at the Elasticsearch Boston Meetup on November 4th. Drew will discuss Elasticsearch and Consistency, and Igor will address What's New in Elasticsearch 1.0. Our Community Manager, Leslie Hawthorn, will also join the meetup. Doors open at 6:00 PM at Workbar in Cambridge, Massachusetts.
- Martijn van Groningen will cover Document Relations with Elasticsearch at the Basis Open Source Search Conference in Chantilly, Virginia on Wednesday, November 6th. Martijn's presentation starts at 10:35 AM.
- Martijn will also present at a Lunch and Learn session on New Features in Elasticsearch 1.0 at Verizon's offices in Ashburn, Virginia on Thursday, November 7th. OUr hosts, Verizon, will also treat the audience to information on their use of Elasticsearch. Doors open at 11:30 AM; please arrive early to give yourself plenty of time to check in at reception.
- Kevin Kluge will be speaking at the San Francisco Ruby Meetup on November 7th. Doors open at 7:00.
- Rashid Khan will be attending Desert Code Camp in Phoenix, Arizona on Saturday, November 9th. If you'll also be there, have a chat with him on all things Kibana.
- You can learn all about how Atlassian uses Elasticsearch for Heavy lifting in HipChat at the San Francisco Bay Area meetup on Monday, November 18th. Atlassian will be hosting the meetup at their offices and doors open at 6:30 PM.
- Uri Boness and Zachary Tong will be presenting at the Chicago Elasticsearch Meetup on November 18th. Further details coming soon!
Call for Speakers and Community Organizers
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Where to Find You
Are you hosting an Elasticsearch meetup or giving a talk about Elasticsearch? We would love to know so we can feature that information in future editions of This Week in Elasticsearch. Just let our Community Manager know what you're up to and we're happy to help promote your efforts.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: