Distributed Systems Engineer
Solving World Data Problems
We have a simple goal to solve the world’s data problems with products that delight and inspire. As the company behind the popular open source projects — Elasticsearch, Kibana, Logstash, and Beats — we help people around the world do great things with their data. From stock quotes to Twitter streams, Apache logs to WordPress blogs, our products are extending what’s possible with data, delivering on the promise that good things come from connecting the dots.
Elastic’s Origin: Search, Open Source, and Distributed
Founded in 2012 in Amsterdam by the people behind Elasticsearch and Apache Lucene, Elastic set forth a vision that search can solve a plethora of data problems. The origins of the company start back in 2010 when Shay Banon wrote the first lines of Elasticsearch and open sourced it as a distributed search engine. With the rise of cloud computing and changes in IT infrastructure demanding requirements such as real-time search across infinite amounts of structured and unstructured data, Shay foresaw the need for a new type of software to solve today’s real-world data problems. Steven Schuurman, Uri Boness, and Simon Willnauer shared in Shay’s vision, joining forces to create the Elastic company we have today. Since then, the creators of Kibana, Logstash, and Beats have joined the Elastic family, rounding out a product portfolio known as the Elastic Stack, which is used by millions of developers around the world. The Elastic family unites employees across 32 countries into one coherent team, while the broader community spans across over 100 countries.
We are looking for top Software Engineers with experience in complex distributed systems to join our team. This is a great opportunity to work on the inner heart of one of the most popular open source products.
Your work will primarily focus on the distributed aspects of Elasticsearch, by which we mean the parts that are responsible for data replication, consensus and node to node coordination.
- The logic for keep multiple copies of the data in sync while supporting concurrent and high through put indexing and searches;
- Consensus algorithms used by the cluster master to coordinate meta data like cluster membership, shard assignment and document metadata;
- Shard migration logic responsible for transferring gigabytes of data between nodes without dropping a single indexing or search operation;
- Some modelling work using TLA+ and/or similar languages.
- We believe in room for creativity and breadth of knowledge. As such you will be given to opportunity and time to work on other aspects of the complex system that is Elasticsearch - be it the high speed lower level indexing code or an aggregation using the latest analysis algorithms.
- Collaborate with other development teams, our community, and our customers to execute on product deliverables
- Occasionally provide training at Elasticsearch Training Events
Practical experience in working and developing a complex distributed system.
Passion and experience programming in Java and building enterprise software or similar products.
Experience with Raft and/or Primary-Backup systems is a plus
Excellent verbal and written communication skills, a team player with strong analytical, problem solving, debugging, and troubleshooting skills
Ability to work on a distributed team throughout the world.
BS, MS or PhD in Computer Science or related engineering discipline and 2+ years of industry experience
Knowledge and experience in Lucene, Elasticsearch or other NoSQL solutions is a plus.
Competitive pay. Medical, dental, vision, disability benefits in some countries
Catered lunches, snacks, and beverages in most offices
An environment in which you can balance great work with a great life
Passionate people building great products
Employees with a wide variety of interests
Your age is only a number. It doesn't matter if you're just out of college or your children are; we need you for what you can do.
Distributed-first company with employees in over 27 countries, spread across 18 time zones, and speaking over 30 languages! Some even fly south for the winter :)
Elastic is an Equal Employment employer committed to the principles of equal employment opportunity and affirmative action for all applicants and employees. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status or any other basis protected by federal, state or local law, ordinance or regulation. Elastic also makes reasonable accommodations for disabled employees consistent with applicable law.