The Census Bureau has large amounts of rich and complex data sets that are retrieved and used each day by the public. This data reveals insights into our economy, demographic characteristics of states, and helps communities make infrastructural decisions such as where and when to plan public transportation systems and the location of new housing. Given the criticality of Census data, a team at the Bureau has built a prototype that leverages Elasticsearch to make data more accessible and relevant to users. This talk explores our key challenges, successes, and how we used Elasticsearch to build the prototype
Using enrichment to turn low-value events into high-value events. Enrichment techniques are geoip, tld extraction, length, and entropy. I then demonstrate how to find anomalous stuff like: drive-by malware / malicious web browsing Command and Control (C2) Communications DNS tunneling Data Exfiltration
Optum’s Cyber Defense organization utilizes Elastic within its Security Big Data Lake to search and pivot between cyber threats. The Hadoop and Elastic architecture of the data lake allows correlation and enrichment of logs prior to Elastic ingestion, accelerating investigation timelines. The SBDL can replace and improve on many cyber products offered by third parties at significantly lower cost and risk.
How does a large enterprise company change the way it thinks about and measures the success of its digital endeavors, from customer experience to developer quality of life? In this talk, we discuss Kroger's migration from tailing log files on servers to creating a large-scale data pipeline for log and metric aggregation and analysis. We’ll share some of the challenges faced, what our current production pipeline looks like and take a peek at the road map.
As our marketing efforts become more precise, our search capabilities needed to change to keep up. Migrating from Endeca to Elastic has been an interesting experience. As Endeca is a configuration intensive application and the search engine is a bit of a black box, Elastic has allowed us to reduce the configuration effort to almost nothing. Untested script code script code is a thing of past. Our searching has become very precise and efficient. This talk will be about our journey.
Having worked on supercomputers in the 1980s, as an evangelist for Java development in the 1990s, and today, as an OpenStack board member and leader for Cisco’s open source initiatives, this conversation between Shay and Lew will surface perspectives on the future of open source for developers and enterprises.
How many shards should I have? How many nodes should I have? What about replicas? Do these questions sound familiar? The answer is often ‘it depends’. This talk will outline the factors that affect sizing and walk you through a quantitative approach to estimating the configuration and size of your cluster.
This talk will focus on the ways to leverage the Elastic Stack to build tools for your sales and marketing teams. We will demo some internal tools we’ve built including cohort analysis of Salesforce data, leveraging Watcher to alert on large data changes, and more.
Salesforce built a plugin to the Elastic Stack – called ELF – that enables the collection of Salesforce log data. Come learn how it allows businesses to easily report on user activity in Salesforce and gain insights into organizational usage trends and user behavior.
Netflix messages millions of customers a day across many channels – email, push notifications, text, voice calls, etc – via its messaging platform: a distributed system made up of a series of separate applications. Learn how they use Elasticsearch for higher message deliverability and operational excellence.
If you’re using Elasticsearch on Windows or Azure, this session is a must-attend. Our .NET team will demo our Azure Marketplace offering & give a sneak preview of the MSI-based installer. In closing we'll give an overview of everything new in NEST and Elasticsearch.NET 2.0, the official .NET clients.
The Beats project has evolved from just one Beat – Packetbeat – to several Beats, many of which are written by users like you. In this talk, join Beats core developers Nicolas and Steffen in their whirlwind attempt at creating a new Beat, live, from scratch!
Get insights and ask questions about the ever-evolving journey of Elastic engineering. This talk will cover what changed as we grew from 15 to 150+, how we operate as a global distributed team and communicate effectively, as well as what guides us in developing the software you know and (hopefully) love.
Mayo Clinic is bringing real-time clinical decision making to the point of care with a vertical application they built using the cloud, Elasticsearch, and D3 widgets. Hear how this application allows physicians to find similar patients and explore what-if scenarios using outcome and intervention parameters.
Today the default scoring algorithm in Elasticsearch is TF/IDF. This default will change to BM25 once Elasticsearch switches to Lucene 6. In this talk, Britta will tell you all about BM25 – what it is, how it differs from TF/IDF and other scoring techniques, and why it might be the better default going forward.
Learn how Elastic uses the Elastic Stack throughout the company — from how and where its data stores are built to best practices for production clusters, as well as what is built on premise and when it leverages its Cloud service.
Learn how Giant Oak and its partners use Elastic to help power work combating human trafficking, financial fraud, abuse of prescription drugs, and the trade in endangered species.
This talk will cover everything you ever wanted to know about geo and Elasticsearch! Get advice on field mapping strategies, learn about geo aggregations and visualizations for exploratory spatial data analysis, as well as get insights into new spatial data structures being added to Lucene and Elasticsearch.