This week in Elasticsearch - September 10, 2014
Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
Elasticsearch core
- Packaging: Add default oracle jdk 7 (x64) path in debian init script (#7132, master and 1.4)
- Java api: change base class for
GetIndexedScriptRequest
and improve its javadocs (#7553, master and 1.4) - Mapping: Fix
index
setting in_boost
field (#7557, master, 1.4, 1.3 and 1.2) - Aggregations: Fixes resize bug in Geo bounds Aggregator (#7556, master, 1.4 and 1.3)
- Core: Remove unused class
DocSetCache
(#7582, master) - Internal: deduplicate useful headers that get copied from REST to transport requests (#7590, master and 1.4)
- Indexed scripts: make sure headers are handed over to internal requests and streamline versioning support (#7569, master and 1.4)
- Dependencies: Upgrade Guava to 18.0 (#7593, master and 1.4)
- Term Vectors: Support for artificial documents (#7530, master and 1.4)
- TransportClient: Mark transport client as such when instantiating (#7552, master and 1.4)
- Dependencies: Upgrade to Lucene 4.10 (#7584, master and 1.4)
- Internal: Simplify reading / writing from and to
BlobContainer
(#7551, master and 1.4) - REST API: Add explicit error when PUT mapping API is given an empty request body (#7618, master and 1.4)
- Internal: Change
LZFCompressedStreamOutput
to use buffer recycler when allocating encoder (#7613, master and 1.4) - REST API: Change validation exceptions to respond with 400 status instead of 500
(#7619, master and 1.4)
- Core: remove built-in support for Lucene's experimental codecs (#7604, master, 1.4 and 1.3)
- Search API: Execute search reduce phase on the search threadpool (#, master, 1.4 and 1.3)
- Mapping API: Enable mapper properties merging for
_timestamp
field (#7614, master and 1.4) - Packaging: Make
.zip
and.tar.gz
release artifacts contain same files (#2793, master and 1.4) - Stats: Update action returns before updating stats for
NONE
operations (#7639, master and 1.4) - Snapshot/Restore: Write Snapshots directly to the blobstore stream (#7637, master and 1.4)
- HTTP: Disable CORS by default (#7151, master and 1.4)
- Internal: Fix ordering of
Regex.simpleMatch()
parameters (#7651, master and 1.4) - Internal: Ensure the request context is always copied from REST to transport layer (#7610, master and 1.4)
- Transaction Log: Clean up translog interface (#7564, master and 1.4)
- ThreadPool: Use
DirectExecutor
instead of deprecated API (#7636, master and 1.4)
awesome #logstash #kibana #elasticsearch presentation with real life use case demo by @webmat at @devopsmontreal pic.twitter.com/sGkK8x7TEs
— Colin Surprenant (@colinsurprenant)
September 9, 2014
Elasticsearch Ecosystem
Here's some more information about what is happening in the ecosystem we are maintaining around the ELK stack - that's Elasticsearch plus Logstash and Kibana - including plugin and driver releases.
- Mike McCandless authored an in-depth tutorial on Performance Considerations for Elasticsearch Indexing.
- Our Developer Advocate in Japan, Jun Ohtani, has graciously translated Mike's performance tutorial into Japanese.
- If you love Ansible, the ELK stack and Juju, Jorge Castro's deployment tutorial will make your day. (Jorge is also looking for folks to test their Juju Elasticsearch for Apache Hadoop bundle.)
- Jeff Potts authored the second article in his series on Elasticsearch and Apache JMeter, this time focusing on using the ELK stack to visualize JMeter test results.
- Sander van Thillo blogged all about combining MariaDB and Elasticsearch to have fun with geometry data and geocoding.
- Xavier Mertens penned a walk through of how he uses ownCloud and the ELK stack to manage his log files.
All set for the @DevOpsIreland meetup tonight #elasticsearch #logstash #kibana pic.twitter.com/vj6qTquxMz
— Boaz Leskes (@bleskes)
September 4, 2014
Slides & Videos
At last night's Elasticsearch Boston Meetup, EverTrue shared their use case
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash, and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
Thursday, September 11th from 10:00 - 17:00 CEST
Can't make tomorrow's @findwise #FindabilityDay2014 in CPH? Watch @elasticmarx on #Elasticsearch via the livestream http://t.co/civbt1Z1Ip
— Leslie Hawthorn (@lhawthorn)
September 10, 2014
Austria
The Vienna Elasticsearch User Group will convene on October 2nd at 7 PM. This next meetup will focus on Elasticsearch use cases. You can register now for the meetup.
Denmark
- Dmitri Marx will be presenting at Findability Day in Copenhagen on Thursday, Sept. 11th. Dmitri will teach you all about how Elasticsearch can provide you with actionable insights into your data. Dmitri's talk begins 14:30.
- Yann Cluchey, the awesome human who organizes the Elasticsearch London User Group, will take the stage at GOTO Aarhus on Tuesday, September 30th to share his company's Elasticsearch use case. Join Yann at 1:20 PM to hear all about Cogenta - Making Enterprise Data Available in Real Time with Elasticsearch. GOTO Aarhus runs September 29-30th.
France
- Heading to JUG SummerCamp 2014? Great! So is our wonderful Developer Advocate, David Pilato. David will cover Advanced Search for Your Legacy Application, and JUG SummerCamp is on September 19th.
- The next Elasticsearch France Meetup will take place September 25th in Paris. We have limited space for this meetup, so registration will only be open for a short time. You can register to attend starting tomorrow on Meetup.com.
Germany
The code.talks conference is back in Hamburg this year on October 9th and 10th, though with a new name. (We had a great time there last year when this conference was known simply as Developer Conference EU.) Alexander Reelsen will be speaking once again, along with Isabel Drost-Fromm.
Here's all the Elasticsearch and ELK stack information on offer at code.talks:
- Patrick Peschlow from our partner firm codecentric AG will walk you through Elasticsearch: Lessons Learned. (Thursday, Oct. 9th at 10 AM)
- Isabel will tell you all about how to properly architect search for your website. (Friday, Oct. 10th at 10 AM)
- Alexander will give you an introduction to the ELK stack, including using it to build real-time analytics dashboards. (Friday, Oct. 10th at 2:00 PM)
Japan
参加募集を開始しました。/ 第6回elasticsearch勉強会 #elasticsearch #elasticsearchjp - elasticsearch勉強会 | Doorkeeper - http://t.co/vJk89DnXQ2
— Jun Ohtani (@johtani)
August 29, 2014
The Netherlands
The next Elasticsearch NL meetup will be hosted at Utrecht HQ of @bol_com, talking about their ELK stack.C u Sep 22! http://t.co/c66D6rfIlm
— Boaz Leskes (@bleskes)
August 25, 2014
We're also super excited that this year's DrupalCon EU will be in our hometown of Amsterdam on Sept. 29th - Oct. 3rd. Leslie Hawthorn will be out and about in the hallway track, so make sure to say hello to her! There are also some great talks on all things Elasticsearch and the ELK stack on offer from these Drupalistas:
- Steven Merill of Phase2 Technology will teach you all about using open source logging and monitoring tools. The best part? He'll share all about how the ELK stack powers log management for Drupal.org (think billions of logs). Steve speaks on Wednesday at 2:15 PM.
- Nikolay Ignatov and Welin Welchev from Propeople will present on Elasticsearch, the New School Search Engine for Drupal. Join them on Thursday at 10:45 AM to learn all about the Elasticsearch Connector module!
New Zealand
New Meetup: The Auckland Continuous Delivery Meetup will be hosting a series of Lightning Talks on Tuesday, September 16th. You'll be treated to fast but awesome explorations of Elasticsearch and Logstash, as well as Docker, AWS, Azure, and DevOps. Doors open at 6:00 PM. Register now to attend!
Norway
The next Elasticsearch Oslo Meetup is on for October 7th at 6 PM. Register now to save your seat. We'll get back to you with more details as soon as the meeting agenda is finalized.
Serbia
Patrick Peschlow from our partner firm codecentric AG will take the stage at the 2nd Annual Coding Serbia Conference on September 25th. Join him at 8:00 PM to learn how you can go from Elasticsearch Novice to Expert in just 90 minutes.
Spain
The first ever Elasticsearch Meetup in Madrid has been scheduled! The meetup will take place on September 29th from 7:00 - 8:30 PM,and the agenda is still being finalized. You can register now to save your place.
Sweden
The fifth Elasticsearch Stockholm Meetup is on for October 1st at 5:30 PM. The agenda will be posted shortly, but in the meantime register now to ensure there's a seat for you.
United Kingdom
Please join the folks from the Enterprise Search Cambridge group for a full day Elasticsearch hackathon on September 26th! You can register now to attend.
Installing + Scaling #Elasticsearch for Search + Analytics: @kurtado & @suyograo coming to @apiworld on Sept. 15th! http://t.co/0IScVCA92p
— Leslie Hawthorn (@lhawthorn)
September 4, 2014
United States
- New Meetup: Join us for the latest and greatest Elasticsearch Austin Meetup on Thursday, September 18th from 6-8 PM. Agenda is still being finalized, but you can register now!
- Attending the first ever FOSSETCON this week? Join our very own Jordan Sissel for a Keynote Address on Open Source is More than Code. You can also see another of our stalwart Logstash developers, Aaron Mildenstein, on an introduction to the ELK stack. FOSSETCON runs September 11-13th in Orlando.
- Join several of our core developers for the latest Denver Meetup on September 15th. We're still finalizing the agenda, but our hosts, Sendgrid, will be discussing their Elasticsearch use case. Register now for updates on timing and location.
- PuppetConf is around the corner! If you find yourself in the San Francisco area join us in listening to Jordan Sissel's talk on Got Logs? Get answers with Elasticsearch ELK, Wednesday 24th, 5:10 PM. The conference runs September 20-24th.
- In or around Bellevue, WA on October 2nd? Cool, so are we! Please join Steve Mayzak to learn all about the ELK stack: what it is, what you can do with it and how it can provide actionable insights into your data. You can register now to attend the CloudTalk Meetup, and many thanks to these fine folks for hosting us!
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticsearch, Kibana, and Logstash than where you rest your head.
Trainings
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- Paris - September 25, 2014 (Getting started with Elasticsearch & the ELK stack)
- Stockholm - October 7, 2014 (core Elasticsearch training)
- Madrid - October 7, 2014 (core Elasticsearch training)
- Amsterdam - October 14, 2014 (core Elasticsearch training)
- Los Angeles - October 21, 2014 (core Elasticsearch training)