2014年04月2日

This Week in Elasticsearch - April 02, 2014

By Alexander Reelsen

Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.

Elasticsearch Core

  • Delete by query: Capture and set start time to support queries/filters with now (#5540, master and 1.x)
  • Query API: Fix match_phrase_prefix query by using prefix query (#5551, master, 1.x, 1,1)
  • Gateways: Remove deprecated gateways (#5422, master and 1.x)
  • Field data: Fixed eager field data loading (#5557, master, 1.x, 1.1)
  • Forbidden APIs: Added Math.abs() (#5562, master and 1.x)
  • Search Internal: IndexShardRoutingTable shard randomization could throw out-of-bounds excpetions (#5559, master, 1.x, 1.1 and 0.90)
  • Tribe node: Index level blocks, index conflict settings to help with conflict detection (#5501, master and 1.x)
  • Cluster info: Be less verbose when logging ClusterInfoUpdateJob failures (#5222, master and 1.x)
  • Function score: Added field_value_factor function (#5519, master and 1.x)
  • Data format: Added support for CBOR data format (#4860, master and 1.x)
  • Stats API: Added suggest stats (#4032, master and 1.x)
  • Stats API: Added human readable start_time and refresh_interval (#5280, master and 1.x)
  • Template API: Fix dynamic_type in dynamic_template (#5256, master, 1.x and 1.1)
  • Highlighting: Fixed inconsistencies between REST and Java API (#5281, master and 1.x)
  • Discovery: Improved unicast discovery to ping nodes which a ping was received from (#5508, master and 1.x)
  • Search templates: Support source parameter (#5596, master, 1.x and 1.1)
  • Mapping: Setting a binary field to stored should throw an error (#5474, master, 1.x and 1.1)
  • Master node communication: Ensure better checks during master change and dedicated master node requests (#5548, master and 1.x)
  • Bulk API: Ensure that specific item failures do not affect the whole bulk request (#4987, master, 1.x and 1.1)
  • Transaction log: Fix visibility in buffered translog (#5609, master and 1.x)
  • Context suggester: Adding more tests to fix minor bugs (#5525, master and 1.x)
  • REST API: Clean up rest response (#5612, master and 1.x)
  • Testing: Allow to simulate network failures (#5631, master and 1.x)
  • Cluster state: Add name to cluster state and use it for identification (#5622, master, 1.x and 1.1)
  • Internal Search API: Do not propagate errors from onResult to onFailure (#5629, master and 1.x)
  • Internal: Replace usage of StringBuffer with StringBuilder (#5605, master and 1.x)
  • Cluster state: Ignore index if it is not in the cluster state and it is to be dropped (#5643)
  • Internal engine: Fail engine/shard when refresh failed (#5633, master and 1.x)
  • Geo point parsing: Allow double in strings to be valid lat/lon pairs and coerce them (#5626, master and 1.x)
  • Lucene: Upgrade to 4.7.1 (#5635, master and 1.x)
  • Circuit breaker: Percolator doesn't reduce CircuitBreaker stats in every case (#5588, master, 1.x and 1.1)

Elasticsearch Ecosystem

Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.

Slides & Videos


Alexander Reelsen's recent presentation on new features in Elasticsearch 1.1

Elasticsearch at Shopwiki: Rob Stewart's Slides from the March NYC Elasticsearch Meetup
Alexander Reelsen explains better known and less well known things you should be aware of when maintaining performance in a distributed system

How Mairdumont Switched to Elasticsearch, as presented at the recent Big Data Stuttgart Meetup (auf Deutsch)
  • The Ellerslie .Net User Group in New Zealand shared the slides from their latest meetup.

photo (1)
The Philly Elasticsearch Meetup group welcomed 20+ folks for their first meeting

Where to Find Us

We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!

Brasil

Elasticsearch is very excited to send our first speaker from the company to Brasil! Leslie Hawthorn, our Community Manager, will be returning to FISL once again to speak on Community 2.0: Beyond Using Software Livre. Leslie will speak on May 7th and FISL 15 runs from May 7-10th in Porto Alegre. Her talk will be in English but most of the talks on the program are given in BR-PT. Leslie will also be on hand to answer questions you may have about Elasticsearch, Logstash and Kibana.

Canada

Honza Kral will be attending PyCon North America and the accompanying Django sprints. Make sure to stop by and hear more from him during his poster session Collect and Analyze your logs with Logstash, Elasticsearch and Kibana.

France

David Pilato and Adrien Grand will both be at Devoxx France 2014, where they will co-present the Hands on Elasticsearch workshop. Devoxx France runs April 16-18th in Paris.

Germany

Italy

  • David Pilato will present Make sense of your (BIG) data! at the Italian Cloud Conference The conference takes place in Torino on April 3rd, and David will speak at 10:30 AM.
  • David Pilato will present Make sense of your (BIG) data! at the Codemotion Roma Conference The conference takes place in Rome on April 11-12th, and David will speak at 2:10 PM on the 12th.

Japan

The 4th Elasticsearch study session has been scheduled by Jun Ohtani. Please plan to join the meeting at 7 PM on April 21st.

The Netherlands

The Elasticsearch Netherlands Meetup group will convene on Thursday, April 3rd at 6:30 PM at Elasticsearch's EU HQ in Amsterdam. Attendees will be treated to a deep dive on new features in Elasticsearch 1.0 by Luca Cavanna and a demo of Elasticsearch Marvel by Boaz Leskes.

Norway

The April Oslo Elasticsearch Meetup has been scheduled for April 3rd at 6 PM. Shay Banon will be speaking at the meetup.

South Africa

Clinton Gormley will take the stage at ScaleConf to talk Scaling real time search and analytics with Elasticsearch. The conference runs April 10th and 11th in Cape Town.

United Kingdom

Mark Harwood will be sharing his analysis of using Elasticsearch to find the "uncommonly common" results in searches - think fraud or anomaly detection - at the Financial Engineers and & Quants London Meetup. Join Mark on Thursday, April 24th at 6:30 PM at SkillsMatter. The organizers ask that you kindly register on both meetup.com and SkillsMatter website. A link to the registration form for SkillsMatter is include on the meetup.com invitation to the event. Attendance is free of charge.

United States

  • Aaron Mildenstein will be speaking at the Bazaarvoice Tech Conference and Hackathon in Austin. The conference runs from April 2nd-4th and registration is required, but free of charge.
  • The Elasticsearch Portlandia Meetup will get together for the second time on April 8th. iovation will present on their use of Aggregations in Elasticsearch.
  • Join us for the Elasticsearch Austin Meetup, on April 9th. Attendees will hear from from Zachary Tong on Elasticsearch & Query Optimization, and from Aaron Mildenstein on Logstash.
  • For folks in Washington, DC, the Elasticsearch Meetup group will convene on April 10th at LivingSocial's offices. Their engineering team will present their Elasticsearch use case.
  • Cameron Lane will be talk Elasticsearch and Python clients at the Python Atlanta Meetup on April 10th.
  • Kevin Kluge will present ELK: How Elasticsearch, Logstash, and Kibana provide real-time data enlightenment at the DevNation Conference. Kevin's talk will take place on Thursday, April 17th at 9:45 AM. DevNation, co-located with Red Hat Summit, runs April 13-17 2014 at Moscone Center in San Francisco. Elasticsearch will be participating in the Partner Pavilion at Red Hat Summit, so if you are attending either conference we hope you will stop by our booth to say hello!

Where to Find You

Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.

Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note.  We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.

Trainings

If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:

  • Copenhagen - May 13, 2014 (core Elasticsearch training)
  • Paris - May 15, 2014 (core Elasticsearch training)
  • San Francisco - May 19, 2014 (core Elasticsearch training)
  • Atlanta - May 20, 2014 (core Elasticsearch training)