Welcome to This Week in Elastic! In this weekly round up post, we bring you news on all aspects of the ELK Stack, including updates on Elasticsearch, Logstash and Kibana development, tips and tricks and upcoming events.
Always wanted to ask our devs (almost anything)? Join our Dev Hangouts Series! @robynbergeron brings you the scoop https://t.co/5hg6KEUNgc
— elastic (@elastic) June 3, 2015
Useful blog posts, how tos, tutorials and articles from the wide world of all the ELK stack ecosystem.
- We have officially moved all of our community discussions over to our new discussion forums. Fear not, you can still totally interact with the forum like it's a mailing list after creating a user profile. Our blog post has all the information you need to get started.
- Check out our weekly deep dive into the latest developments in Elasticsearch and Apache Lucene. Within you'll also discover how the Sunlight Foundation uses Elasticsearch & Haystack to improve their inventory of US criminal justice data.
- We've also got the The Logstash Lines, our weekly Logstash update, including a knowledge drop from the Chartbeat engineering team on scaling your favorite logging solution!
- You want some heat maps? We've got 'em, and a whole lot more. Check out this week's Kurrently in Kibana for all things version 4.1.
- Elastic <3s Norway for many reasons, not the least of which is our family at Found. Read on to learn how we're making sure that everyone in Norway has a better experience with the postal service after Elasticsearch displaced FAST on the system backend.
- From the How Did We Miss this Files: Rob Hudson from the Mozilla Engineering team shares how he used Celery's Canvas to decrease Elasticsearch's indexing time for the Firefox Marketplace database backend.
- Hernan Vivani with the AWS Big Data Support Team brings us tips for using Cascading and Elasticsearch to index common crawl data on Amazon EMR.
- Doug Turnbull treats us to a deep dive into Elasticsearch's cross field search. We know you'll find the blog post useful, but you just have to click on this one for the homage to the original Ghostbusters Movie. Robert Muir would be so proud!
- Mitchell Anicas over at Digital Ocean is at it again, this time with a tutorial on using the ELK stack for centralized logging in web applications. Mitchell, if you are reading this, we love your work and would love to send you a hoodie or buy you a $BEVERAGE.
- Ryan Brink teaches us how to visualize productivity with the ELK stack byanalyzing and visualizing all his keystrokes over 30 minute periods. A great project for learning and, we suspect, a bit of fun procrastination. After all, you're being productive, right?
Couldn’t catch our live #Shield and Beyond webinar yesterday? Catch @smayzak & @antoinegirbal now on demand! http://t.co/6Nlbj8Zohy
— elastic (@elastic) May 29, 2015
Slides and Videos
Pssst! We visited CERN last week to learn about all the ways they're using the ELK stack and for our team to tell the scientists there who didn't know us more about our technology. Check out the video, featuring the ever amazing Alan Hardy and Pere Urbón-Bayes.
But wait, there's more!
Beautiful visualizations and beautiful beverages from Berlin Buzzwords 2015
Antoine Girbal on Performance Tuning: Best Practices for your Elasticsearch Cluster under Heavy Load from our recent Elastic Chicago Meetup
Where to find Us
We'd love to feature all the great Elasticsearch, Logstash, and Kibana presentations and meetups happening worldwide in this section. If you're speaking about the ELK stack or hosting a meetup, let us know!
The .NET Community Austria Meetup will get together on June 11 to talk all about the ELK stack. RSVP now to save your seat.
The Montreal Monitoring Meetup will get together on June 8 to talk about the ELK stack, amongst many other tools. Register now to save your seat.
- David Pilato will also give two talks at the web2day conference. Join him in Nantes from June 3-5.
- Our team will be hanging out in the exhibits hall at dotScale, which takes place in Paris June 8. Come say hello!
During @RivieraDEV 2015, @dadoonet will show us how to add @ElasticSearch to legacy applications in a blink ! https://t.co/SEQK4M9ZVe
— RivieraDEV (@RivieraDEV) May 5, 2015
Université Kibana et Elasticsearch @breizhcamp : http://t.co/ZRAomhneKC. Analyse de données temps réel avec la suite @elastic et Adelean.
— Lucian Precup (@lucianprecup) May 5, 2015
The Big Data Analytics on Cloud Meetup in Hyderabad will host a free workshop on Elasticsearch on June 20. Register now to attend the workshop.
Please join all members of Elastic's team in Japan at LinuxCon Japan in Tokyo on June 3-5. We will have a booth in the exhibits hall and will be very happy to answer any questions you may have.
GOTO Amsterdam Special Edition Meetup
Reg now: @elastic Netherlands Meetup will get together 17 June w/ talks from @rashidkpc & @Wikimedia dev Nik Everett http://t.co/Sh1R9u1sxR
— Leslie Hawthorn (@lhawthorn) May 27, 2015
- But wait, there's more! Join us at GOTO Amsterdam 2015 for a full track on Elasticsearch, featuring five talks on topics from Scaling your ELK Cluster to Securing it with Shield. The conference runs June 18-19, with the Elasticsearch track running all day on June 18.
- And even more! DevOps Days Amsterdam returns to the Pakhuis de Zwijger June 24-26. You can visit us at our booth or hear from Leslie Hawthorn on her latest DevOps and Culture topic, Fear of Failing Fast: How to Avoid Sabotaging Your Success. Rumor has it that the amazing BBQ will be reprised this year, so do not miss this one!
PolandIf you'll be in Katowice, Poland on June 11, join the AWS Poland User Group to talk Elasticsearch on AWS. Register now to save your place.
David Pilato and João Duarte will attend Devoxx Poland 2015 taking place June 22-25 in Krakow. Between the two of them, they'll deliver three talks:
- June 23 at 11:50 AM: David on Make Sense of Your Big Data
- June 24 at 3:10 PM: João on Why I Love Logstash and You Should Too
- June 25 at 1:30 PM: David and João host the Hands on Logstash Workshop
The Madrid Open Analytics Meetup will get together on June 25 to talk big data before your holidays, including Elasticsearch. Register now to join them. (No holiday included, but definitely great knowledge sharing.)
- For folks in Cardiff, Wales, your welcome to attend our Elasticsearch Meetup hosted at DjangoCon EU. Make sure to pop by the conference to say hello to Honza Kral in the hallway track. DjangoCon EU 2015 runs May 31 - June 5. The nifty meetup featured below takes place on June 4.
- If you happen to be in Bristol tomorrow night, join the Bristech User Group to hear from Neil Andrassy on Elasticsearch. RSVP to save your seat for June 4.
- Join us at Big Data Analytics London on June 16 for a seminar on How To Extract Value From Your Data and Create Dazzling Dashboards. The event takes place at the Hotel Russell.
South Wales Elasticsearchers: a meetup with a talk by Honza Král @HonzaKral, Elasticsearch developer: http://t.co/ZwUe3ln5VL All welcome.
— DjangoCon Europe (@DjangoConEurope) May 11, 2015
United States - East
- The Elastic Howard County Meetup will convene tomorrow night, June 4, to talk Prodding ELK. If you're far from Howard County, we're talking Coumbia, Maryland. Register now to save your seat.
- The St. Louis Machine Learning and Data Science Meetup will get together on June 17 to talk Python and Elasticsearch. Register now to save your place.
- The Boston Elasticsearch Meetup will convene on June 18 to talk Elasticsearch & Fuzzy Matching. Register now to save your seat.
- The Cleveland DevOps User Group will get together on June 18 to get Into the Weeds with Elasticsearch. Register now to save your seat.
- Our team will be on the show floor to answer any questions you may have at Red Hat Summit 2015 slated for June 23-26 in Boston. Co-located with the event, check out Red Hat's Developer Conference DevNation, on June 21-15. Amongst the many great talks on offer at DevNation, our very own Robyn Bergeron will address The Democratization of DevOps.
- The Elastic DC Meetup will get together on June 25 to talk Elasticsearch and Fuzzy Matching. Register now to save your place,
United States - West
- New meetup: On Friday, June 5, the Elastic San Francisco Meetup group will get together for lightning talks: Justin Zhu on How Iterable Uses Elasticsearch, our very own Shaunak Kashyap on Watcher and Amir Kibbar on his new Elasticsearch plugin to use Gradle to help with integration tests. There are still seats left, so register now to save your seat.
- New meetup: On Friday, June 5, the Elastic Seattle Meetup will convene to talk Elasticsearch + Docker and throw in some Swarm and Compose on the side. Register now to save your place.
- Our team will be on the show floor at Hadoop Summit, which runs June 9-11 in San Jose, California. Stop by, say hello and learn all about our solutions to make Hadoop sing by using Elasticsearch.
- The Austin Scala Enthusiasts User Group will get together on June 11 to talk how Avention Uses Akka to load data into Elasticsearch. Register now to save your place.
- Join us at Monitorama 2015 in Portland, Oregon and catch a lightning demo from our very own Suyog Rao. Monitorama runs June 15-17.
- The Elastic Silicon Valley Meetup will get together on June 16 to talk Elasticsearch and MapR, plus even more Apache Hadoop goodness. Register now to save your seat.
- The Elastic LAX Meetup group will convene on June 24 to talk about the ELK stack. They're also looking for a venue host and presenters, so get in touch! You can RSVP and talk to the group organizers via meetup.com.
- The Elastic Dallas Fort Worth Meetup will get together on June 25 for an Introduction to Elasticsearch, which will include both a presentation and interactive learning / hands-on component. Register now to save your seat. (Plus, while you are there, congratulate the community organizers, Charith Tangirala and Jason Gaylon, on getting the group to 100 participants!)
This may be our coolest swag ever, courtesy of the PyWaw Summit 2015 Organizing Team.
Where to Find You
PSST! If you're a regular reader, you're thinking of skipping this section. You may even be thinking to yourself, yes of course I will drop a note on Twitter when I am giving a talk on all things ELK. That's awesome, because we'd like to showcase every meetup, conference presentation and workshop on Elasticsearch, Logstash, and Kibana happening worldwide. And now, we've made it even easier for you to get support for your meetup!
Head on over to our meetups page! (And we'll still totally send you swag if you're giving a talk on anything ELKy at a conference.)
Oh yeah, we're also hiring. If you'd like us to find you for employment purposes, just drop us a note. We care more about your skill set and passion for Elasticsearch, Kibana, and Logstash than where you rest your head.
If you are interested in Elasticsearch training we have courses taught by our core developers coming up in:
- New York - June 16, 2015 (Hands-On Workshop)
- New York - June 17, 2015 (Core Elasticsearch)
- Bangalore - June 22, 2015 (Hands-On Workshop)
- Bangalore - June 23, 2015 (Core Elasticsearch)
- Amsterdam - June 23, 2015 (Hands-On Workshop)
- Manchester - June 23, 2015 (Hands-On Workshop)
- Amsterdam - June 24, 2015 (Core Elasticsearch)
- Toronto - June 24, 2015 (Core Elasticsearch)
- Berlin - July 1, 2015 (Hands-On Workshop)
- Beriin - July 2, 2015 (Core Elasticsearch)
- Sydney - July 6, 2015 (Hands-On Workshop)
- Sydney - July 7, 2015 (Core Elasticsearch Operations)
- Sydney - July 8, 2015 (Core Elasticsearch)
- Zurich - July 14, 2015 (Core Elasticsearch)
- Stockholm - July 14, 2015 (Core Elasticsearch)
- Reston, VA - July 14, 2015 (Core Elasticsearch Operations)
- Dallas - July 14, 2015 (Core Elasticsearch)
- Reston, VA - July 15, 2015 (Core Elasticsearch)
- Los Angeles - July 16, 2015 (Core Elasticsearch)
- Mountain View, CA - July 22, 2015 (Core Elasticsearch)
- Portland, OR - July 23, 2015 (Hands-On Workshop)
- Mountain View, CA - July 24, 2015 (Kibana Workshop)
- London - July 28, 2015 (Hands-On Workshop)