This course provides a 28 hour introduction to the ELK stack, moving from basic to advanced concepts. It begins with an overview of Elasticsearch, Logstash, and Kibana before teaching students how to set up their environments, parse logs with Logstash, perform various searches with Elasticsearch, analyze data through aggregation and modeling, and create visualizations with Kibana. Practical exercises are included for each topic. The target audience includes DevOps, sysadmins, and others interested in learning the ELK stack.
This course provides a 28 hour introduction to the ELK stack, moving from basic to advanced concepts. It begins with an overview of Elasticsearch, Logstash, and Kibana before teaching students how to set up their environments, parse logs with Logstash, perform various searches with Elasticsearch, analyze data through aggregation and modeling, and create visualizations with Kibana. Practical exercises are included for each topic. The target audience includes DevOps, sysadmins, and others interested in learning the ELK stack.
This course provides a 28 hour introduction to the ELK stack, moving from basic to advanced concepts. It begins with an overview of Elasticsearch, Logstash, and Kibana before teaching students how to set up their environments, parse logs with Logstash, perform various searches with Elasticsearch, analyze data through aggregation and modeling, and create visualizations with Kibana. Practical exercises are included for each topic. The target audience includes DevOps, sysadmins, and others interested in learning the ELK stack.
This course provides a 28 hour introduction to the ELK stack, moving from basic to advanced concepts. It begins with an overview of Elasticsearch, Logstash, and Kibana before teaching students how to set up their environments, parse logs with Logstash, perform various searches with Elasticsearch, analyze data through aggregation and modeling, and create visualizations with Kibana. Practical exercises are included for each topic. The target audience includes DevOps, sysadmins, and others interested in learning the ELK stack.
● Course Name: Tour de ELK - From Novice to Advanced
● Delivery Mode: English ● Duration: 28 hours ● Prerequisites: ● Operating System fundamentals commands ● Overview: ○ This course is designed for people looking for advancement in their career using docker and microservices. It gives a solid foundation to elk fundamentals and slowly deepens into more complex docker USPs. ● By the end of this training, participants will be able to: ● Understand the USP of elk and start implementing them ● Will no more need hand-holding for ○ Setting up their environment ○ Comfortable with creating the elk cluster and hands-on ● Course format: Heavy hands-on(reference materials will be provided) ● Target Audience: ○ DevOps, Sysadmins, Anyone with an itch to learn!! 1. Introduction to ELK stack Objectives: Upon completing this lesson, you should be able to: • Introduce ELK stack • Learn about Architecture of ELK stack • Understand various ELK terminology • Learn the basics of ElasticSearch, Logstash and Kibana • Understand ELK stack use case
Topics: • Introduction to ELK stack • Why ELK? • Architecture of ELK • High level overview of o ElasticSearch o Logstash o Kibana
2. Parsing with Logstash
Objectives: At the end of this lesson, you should be able to: • Install and verify running of Logstash on your machine • Learn to stash first event • Create a more advanced pipeline that takes Apache web logs as input, parses the logs, and writes the parsed data to an Elasticsearch cluster. • Learn how to stitch together multiple input and output plugins to unify data from a variety of disparate sources Topics: • Introduction to Logstash • Installing Logstash • Configuring a log file • Stashing your First Event • Parsing Logs with Logstash • Stitching together Multiple Input and Output • Plugins • Execution Model
Hands On: • Step by step guide to install Logstash on your machine • Configure the log file • Stash your first event in Logstash • Parsing Logs with Logstash • Installing FileBeats and configuring it to work with Logstash • Configuring Grok Plugin
3. Searching with Elasticsearch
Objectives: At the end of this module, you should be able to: • Enable Multi Value tags, Numbers, and Full text • Retrieve the full details of any employee • Perform Structured search • Learn about full-text search • Return highlighted search snippets Topics: • Elastic Search Overview • Installing and running Elastic Search • Indexing Documents • Retrieving a Document • Searching a Document
Hands On: • Installing and running Elastic Search • Indexing Documents • Retrieving Full Document • Retrieving a part of Document • Checking Document Existence • Updating a Document • Deleting a Document • Searching a Document (Overview)
4. Searching in Depth Objectives: At the end of this module, you should be able to: Perform Structured Search using Elastic search Deploy and understand full text search query Know your data with multi field search Find associated words Understand partial matching query Topics: • Structured Search • Full text Search • Complicated Search • Phrase Search • Highlighting our Search • Multi-field Search • Proximity Matching • Partial Matching Hands On: Above all topics are hands-on intensive
5. Data Aggregation Objectives: At the end of this module you will be able to: Understand the concepts of buckets and metrics Build bar chart with buckets Look at the time using Date Histogram Filter queries and aggregation Sort multivalue bucket
Topics: • High Level Concepts • Getting started with Aggregation • Time Analysis • Filtering Queries and Aggregations • Sorting Multivalue Buckets • Approximate Aggregation • Doc Values and Field Data Hands On: Above all topics are hands-on intensive
6. Data Modeling Objectives: At the end of this lesson, you should be able to: • Compare Elasticsearch with RDBMS • Get the best search result by learning Denormalizing Data • Perform action with Nested Objects • Understand Parent-Child Relationship • Finally conclude the module with concept of shards and replicas
Topics: • Elastic Search vs RDBMS • Handling Relationships • Nested Objects • Parent-Child Relationship • Designing for Scale
Hands On: Above all topics are hands-on intensive
7. Visualization with Kibana
Objectives: At the end of this lesson, you should be able to: Install and Verify Kibana Ingest .json files into Elasticsearch Create different visualization – Pie Chart – Bar Chart – Coordinate Map Summarize the Dashboard
Topics: • Introduction to Kibana • Installing Kibana • Loading Sample Data • Discovering your Data • Visualizing your Data • Working with Dashboard
Hands On: Using Kibana to create a dashboard
8. Implementing ELK stack
Objectives: Search your Data in Kibana Understanding Metric Beat Comparing CPU time spent in user space with offset by an hour Understand Timeline and Analyzing Earthquake with ELK Extend what is possible with Elastic search using X-Pack Detect Fraud with X-Pack Topics: • Setting the Time Filter • Searching your Data • Filtering by Field • Viewing Document Data • Viewing Document Context • Viewing Field Statistics • Data Visualization • Dashboard • Analyzing live data with ELK stack
Hands On: • Time Filter • Document Context • Creating a Dashboard
Project - What are the system requirements for this course? The system requirements for ELK Stack course is Multicore Processor (i3-i7 series), 8GB of RAM is recommended and 20GB Hard Disk (SDD preferable). The operating system can be Windows. - How will I execute the practicals? The practicals can be executed on your machine by installing all the three component of the stack. - Case study: Tech Analyst : A 9.5 years young and energetic IT services company founded by IIT'ians, providing a full 360 degree solution to the clients across the globe. One of the main task of the company involves analyzing huge amount of data. They have decided to use open source tool ELK stack for their analysis due its several robust features Task: The task of the employee is to fetch the required data from the source to Logstash and run queries on elastic search and finally visualize the data with the help of Kibana.
