Log Pipeline Workflows


Course Summary

You can get your log data into Elasticsearch exactly how you want it, regardless of your ecosystem's complexity. This course provides a solid understanding of ingest node pipeline operations and error handling. You'll learn how to loop array values through the foreach processor, shuffle fields through the rename and remove processors, and set field values with hard-coded or dynamic values through the set processor. You will also learn how to handle failure on the processor level as well as on the pipeline level. After completing this course, you will be able develop your own powerful log pipelines.

  • Introduction to Log Pipelines
  • Shuffling Fields with the rename/remove Processor
  • Looping with the foreach Processor
  • Assigning values with the set Processor
  • Error Handling with the fail Processor

Course Details

This course is a module of the Logging specialization. Find out how our focused Training Specializations can help you with your use case.

Software Developers and Engineers, Data Architects, System Administrators, DevOps

2-3 hours

We recommend you have taken Elasticsearch Engineer I and Elasticsearch Engineer II or possess equivalent knowledge. Engineer I and Engineer II teach the concepts that are the foundation upon which all specializations are built.

  • Stable internet connection
  • Mac, Linux, or Windows
  • Latest version of Chrome or Firefox (Safari is not 100% supported)
  • Due to virtual classroom JavaScript requirements, we recommend that you disable any ad-blockers and restart your browser before class.

It was awesome. Both instructors are great speakers. They have a wide and deep knowledge about the topic, and they know how to pass it on. They are infecting with their enthusiasm.

Mariusz Kuskowski | Allegro Group