Tech Topics

Welcome to the Elastic Advent Calendar, 2019! A look at Week Three

We are in the final stretch for the 2019 version of the Elastic Advent Calendar! This is the last weekly wrap up, the next one will be a recap of the full 25 days.

This week we have some great insights into SLM, Elasticsearch with Github, MicroBit, monitoring your home network, the new enrich processor, App Search and Maps.

Let's dive into Week 3

Dec 15 [english] — SLM: setting up an S3 repository using Minio.io, by Luca Belluccini 

Snapshot Lifecycle Management (SLM) is a way to schedule and define snapshot policies using the Elasticsearch API or the Kibana UI. It also allows to check the existing snapshots and restore them directly on Kibana.

Dec 16 [english] — Indexing Github Events for Fun and Profit, by Ron Toland

Like a lot of companies, we lean on Github for more than just git repo hosting. We use it to track work via tickets, asynchronously pair on code via PR reviews, and even use project boards for some Kanban goodness.

All well and good, but there are certain things Github just can't do. Like tell us whether the number of incoming critical bugs is trending up. Or give us hard numbers about who on the team is going above and beyond to review as many PRs as possible.

There are custom tools that can fetch data from Github via its API and assemble this kind of information for us. But we thought: What if we could just get this into Elasticsearch? Once there, could we build visualizations in Kibana to get the answers we need?

Dec 17 [english] — IoT: Christmas tree lights with Elasticsearch and Micro:bit, by Hendrik Muhs 

Like a lot of companies, we lean on Github for more than just git repo hosting. We use it to track work via tickets, asynchronously pair on code via PR reviews, and even use project boards for some Kanban goodness.

All well and good, but there are certain things Github just can't do. Like tell us whether the number of incoming critical bugs is trending up. Or give us hard numbers about who on the team is going above and beyond to review as many PRs as possible.

There are custom tools that can fetch data from Github via its API and assemble this kind of information for us. But we thought: What if we could just get this into Elasticsearch? Once there, could we build visualizations in Kibana to get the answers we need?

Dec 18 [english] — Monitoring your home network with the Elastic Stack, by Paul Coghlan 

This article describes how to monitor your home router with the Elastic Stack. 

Dec 19 [english] — Simplifying Ingest Pipelines with the new Enrich Processor, by Imma Valls 

When ingesting data through a regular Elasticsearch ingest pipeline (e.g. with dissect, rename, or remove processors) we can now add an Enrich Processor.

This allows us to do lookups on other Elasticsearch’s indices and enrich the incoming document before sending it to its own index.

Dec 20 [english] — Getting Started with App Search, by Aravind Putrevu

App Search is a search solution that is built on Elasticsearch. Using App Search, one can build search experience faster. One can tune relevance, create synonyms or even change the index schema using the App Search Dashboard. All one needs is a dataset they want to search upon.

Dec 21 [english] — Gain insights from large datasets with choropleth maps and Elastic maps, by Nathan Reese

"Get It Done" is a San Diego initiative to engage citizens in reporting non-emergency problems like potholes, missed garbage collection, and street light outages. Smart phone applications make reporting easy. The "Get It Done" data set is publicly available and can be downloaded as CSV 1. Follow these instructions 1 to ingest the "Get It Done" data set into Elasticsearch.

The 2019 CSV contains over 250,000 reports. Each report contains a GPS location. Lets start by viewing the reports on a map.

Not long now

Only 4 more posts of handy howto's and tips from the engineers behind the projects, and that'll be our 2019 series over! Make sure you subscribe to the Advent category on our forums for the latest posts, and follow @elastic for tweets when new posts are published.