Welcome to This Week in Elasticsearch. In this roundup, we try to inform you about the latest and greatest changes in Elasticsearch. We cover what happened in the GitHub repositories, as well as many Elasticsearch events happening worldwide, and give you a small peek into the future of the project.
- In case you missed it last week, we released Elasticsearch 1.0.0. You can read more about the release from InfoWorld or IT Business Edge.
- Percolation: Added support for highlighting (#5090, master and 1.x)
- Query API: Added support specifying fields in using the dot-notation in
simple_query_stringquery (#5110, master and 1.x, 1.0 and 0.90)
- Query API: Added support for
simple_query_stringquery (#5126, master and 1.x)
- A new
DistanceUnitfor nautical miles was added (#5085, master and 1.x)
- Percolation: Added support for nested documents (#5082, master and 1.x)
- Mapping: Add
preserve_originaltoken option to ASCIIFolding filter (#5115, master and 1.x)
- Cluster state: Optimize multiple cluster state processing on receiving nodes (#5139, master, 1.x, 1.0 and 0.90)
- Create Index API: Support for aliases on index creation (#4920, master and 1.x)
- Get API: Source filtering with wildcards broken when given multiple patterns (#5133, master and 1.x)
- Packaging: Set permissions in debian postinst script correctly (#3820, master, 1.x, 1.0 and 0.90)
SearchContextfrom being closed prematurely (#5165, master, 1.x, 1.0 and 0.90)
Here's some more information about what is happening in the ecosystem we are maintaining around Elasticsearch, including plugin and driver releases, and news about Logstash and Kibana.
- Logstash 1.4.0 beta has just been released. Get it while it's hot!
- A new version of the Elasticsearch Azure plugin has been released.
- The Elasticsearch PHP client version 1.0.1 and version 0.4.4 has been released
- The Ruby client for Elasticsearch will now automatically use a high performance HTTP library such as Patron or Typhoeus, when it's required. Most importantly, these clients will use persistent HTTP connections to Elasticsearch, boosting performance and reducing load on the engine. For more details, see the commit message
- David Pilato has released Spring factories for Elasticsearch 1.0 as well as the RSS river for Elasticsearch 1.0.
- Aaron Mildenstein released Curator 0.6.2 yesterday. Check out Aaron's blog post to get started with Curator for managing time based data in Elasticsearch.
- The scala client elastic4s has been released, with support for Elasticsearch 1.0.
- Pablo Musa has released an updated Elasticsearch jetty client.
- Ciara Byrne with Fast Company published an article all about Ophan, The Guardian's content analytics suite built on Elasticsearch.
- Jettro Conradie treats us to his tale of getting Elasticsearch Marvel up and running on the Raspberry Pi.
- Eric VanBergen shared a step by step guide to Getting Started on Centralized Logging with Logstash, Elasticsearch and Kibana.
- Bryeten Ernsting published a tutorial on Modeling a Spreadsheet in Elasticsearch.
- If you're a fan of Docker, Elasticsearch is now available as a Dockerfile from Docker's trusted build system.
- Lots of us at Elasticsearch Inc run OSX. Maybe you do, too. If yes, check out Ali Al Dalla's instructions for automatically running Elasticsearch on OSX startup.
- Ben shared tips for securing Elasticsearch and Kibana using Nginx.
- Cain Ullah shared a use case story about using Elasticsearch and other tools to build the World Risk Review website.
- Smile authored a white paper on Big Data, including discussion of Elasticsearch and Kibana. They also published a handy overview guide to Elasticsearch 1.0's features. (en français)
- Les Castcodeurs Episode 95 featured Elasticsearch, Kibana and Elasticsearch Marvel. The whole show is great; Elasticsearch content starts at 34:00. (en français)
- Diego Rabotone authored a tutorial on using the Twitter API, Elasticsearch and Kibana to analyze social network traffic. (Em Português Brasileiro)
Slides & Videos
David Pilato's slides from last week's Microsoft Tech Days: Making Sense of Your (BIG) Data on Azure (en français)
Alex Reelsen's slides from last week's Lightweight Java Users Group Munich meetup
David Pilato presents Make Sense of Your (BIG) Data at Human Talks Angers (en français)
Where to Find Us
We'd love to feature all the great Elasticsearch, Logstash and Kibana presentations and meetups happening worldwide in this section. If you're speaking or hosting a meetup, let our Community Manager, Leslie Hawthorn, know!
- The Melbourne Search Users Group will once again welcome folks from Elasticsearch on March 13th. Please join to hear from Britta Weber on Custom Scoring Functions in Elasticsearch and Lee Hinman's Introduction to Logstash. Doors open at 6 PM. Many thanks to these folks for inviting us to join them once again!
- The fine folks at Atlassian have graciously offered to host the second Sydney Elasticsearch meetup, featuring the aforementioned talks from Britta and Lee. Doors open at 6:30 PM. Many thanks to Atlassian for sponsoring the venue and attendee refreshments.
- Steve Mayzak will present on Elasticsearch in the Real World plus What's New in 1.0 at the upcoming Polyglot Vancouver Meetup. The meetup will take place on March 5th starting at 6 PM.
- The Elasticsearch Montreal Meetup group has scheduled their first meeting for March 12th at 7 PM.
- Honza Kral will be heading to Montreal PyCon North America 2014. Honza will be attending the conference & sprints, plus hosting a poster a session: Collect and Analyze your logs with Logstash, Elasticsearch and Kibana. Including sprints, tutorials and all conference sessions, PyCon North America runs April 9-17th.
Karel Minařík will be speaking at the Prague.rb user group on March 5th. Doors open at 7 PM.
- Shay Banon will be on center stage at CeBIT 2014 on March 14th, discussing the impact of data harvesting on tomorrow's business insights. CeBIT runs March 10-14th in Hannover.
- Alex Reelsen and Honza Kral will share the stage at GOTO Berlin night on March 18th. They'll be talking all about Elasticsearch 1.0 and how to use the ELK stack (that's Elasticsearch + Logstash + Kibana) to create real-time dashboards. Doors open at 7 PM and registration is required via the GOTO Berlin site.
- Alex Reelsen will be attending DevCamp Karlsruhe on March 21-23rd. Say hello when you pass him in the hallway track.
- The first ever Stuttgart Elasticsearch Meetup will take place on March 25th at 7 PM. Alex Reelsen will be covering What's New in Elasticsearch 1.0.
- Patrick Peschlow will talk about talk about Elasticsearch and his experiences at JavaLand 2014. His presentation is scheduled for March 25th in Brühl.
- Alex Reelsen will be at the Berlin Expert Days Conference (BED-Con) on April 3rd and 4th. He will present Creating realtime dashboards using Elasticsearch, Logstash and Kibana.
- Jordan Sissel will speak at the Open Source Data Center Conference in Berlin, discussing how to Find Happiness in Your Logs. The conference will run from April 8-10th.
David Pilato will present Make sense of your (BIG) data! at the Italian Cloud Conference The conference takes place in Torino on April 3rd, and David will speak at 10:30 AM.bed
The 4th Elasticsearch study session has been scheduled by Jun Ohtani. Please plan to join the meeting at 7 PM on April 21st.
Clinton Gormley will take the stage at ScaleConf to talk Scaling real time search and analytics with Elasticsearch. The conference runs April 10th and 11th in Cape Town.
- Shay Banon and Graham Tackley from The Guardian will share the stage at QCon London, discussing How Elasticsearch Powers The Guardian's Newsroom. Several folks from the Elasticsearch team will also be on hand in Booth 12 to answer questions. Stop by and say hello! QCon runs March 3-7th.
- The Enterprise Search Cambridge UK Meetup will feature a presentation on how Rangespan uses Elasticsearch. The meetup convenes on March 5th and doors open at 7 PM
- The Boston Azure User Group will convene on February 20th at 6 PM. Chris Morley will present on Elasticsearch Running on Linux in Azure.
- Leslie Hawthorn, Kevin Kluge and Jordan Sissel will all be presenting at the 12th Annual Southern California Linux Expo, a.k.a. SCALE 12x. If you can't catch the talks, make sure to stop by our table to say hello. SCALE runs from February 21st-23rd.
- The second Los Angeles Elasticsearch Meetup will be held on Friday, February 21st at SCALE 12x. Join us for casual discussion and refreshments. You don't have to be attending SCALE to come to the meetup, but the organizers have offered a generous discount on conference passes to meetup attendees. We'll get together at starting at 7 PM.
- The Elasticsearch Denver Meetup group will be getting together on February 24th to hear about Automattic's use of Elasticsearch. Doors open at 6:30 PM and Elasticsearch core developer Lee Hinman will also be on hand for Q&A.
- The Elasticsearch San Francisco Meetup group will focus on Benchmarking, Autoscaling and Deployment Automation at their next meetup. Elasticsearch core developers Uri Boness and Andrew Selden will be on hand for Q&A following the presentations. Doors open at 6:30 PM on February 27th.
- We've set the date for the first ever Elasticsearch Portlandia Meetup on March 4th. Steve Mayzak will cover Elasticsearch 1.0 - Whats new and how are people using it? Our community manager, Leslie Hawthorn, will also be visiting from Europe. She's looking forward to hearing from everyone about what could be done to make your lives as Elasticsearch users better.
- Safe and sound following the recent Portlandia Snowpocalypse, Steve Mayzak's presentation to the Seattle Search and Machine Learning meetup group has been rescheduled for March 6th. Please join Steve starting at 7 PM to hear all about Elasticsearch 1.0.
- The Philadelphia Elasticsearch Meetup group has just been set up, and the organizers are figuring out the first meeting date. Join the meetup group to get regular updates.
Where to Find You
Our Community Manager, Leslie Hawthorn, is hard at work to help folks create more Elasticsearch meetup groups and to help meetup organizers find more speakers. If you are interested in either effort, take a moment to let her know.
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticearch, Kibana and Logstash than where you rest your head.
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in: