From the course: Stream Processing Design Patterns with Kafka Streams
Join today to access over 22,600 courses taught by industry experts.
Design of the project - Kafka Tutorial
From the course: Stream Processing Design Patterns with Kafka Streams
Design of the project
- [Instructor] In this video, I will discuss a design for the streaming pipeline use case for website views analytics. The first goal is to compute user summaries by five second intervals. This is the same as the streaming analytics pattern with windowing. You will need to first consume the Kafka topic, extract the value in CSV format, and then convert it into a case stream. Then, you will apply a processing window of five seconds, and compute the total minutes by user. Next, you will publish the results to the system console. The next goal is to manage a leaderboard for topics. This is the same as the leaderboards pattern so you can use the same Redis solution we discussed in the leaderboards pattern implementation. For this, you will consume the case string record and update a Redis sorted set. Additionally, you will also print the leaderboard periodically. In the next video, we will review the implementation for the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.