From the course: Stream Processing Design Patterns with Kafka Streams
Join today to access over 22,600 courses taught by industry experts.
Alerts and thresholds: Use case design - Kafka Tutorial
From the course: Stream Processing Design Patterns with Kafka Streams
Alerts and thresholds: Use case design
- [Instructor] I will discuss the goal for the alerts and thresholds use case and create a pipeline design for the same in this video. What is the use case we will be solving here for alerts and thresholds? We have an input Kafka topic that contains real-time exception logs collected from various services across the network. They are flowing into Kafka in real-time. Each message is in a CSV format. It contains the timestamp when the exception occurred, the level of the error, whether it is critical, high, or elevated, then it also has the error code and an error message. There are two goals for this use case. First, every time a critical exception happens, send the exception to a special critical alerts Kafka topic. Second, when the same error code occurs more than two times in a 10 second interval, send an alert to a high volume alert Kafka topic. How does the pipeline design look like in this case? We receive the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.