From the course: Stream Processing Patterns in Apache Flink
Unlock the full course today
Join today to access over 22,500 courses taught by industry experts or purchase this course individually.
Streaming analytics: Use case design - Flink Tutorial
From the course: Stream Processing Patterns in Apache Flink
Streaming analytics: Use case design
- [Instructor] Let us design an example use case for streaming analytics in this video. Our example use case involves analyzing real-time orders. We have an e-commerce system where customers are placing orders. The orders would flow through a Kafka input topic. The order is of JSON format. The input is simple. It contains an order ID, the name of the product, the quantity purchased, and the price of each item. The goal for the use case is to analyze all the data every five seconds to compute product-wise total value. This is done by multiplying the quantity with the price and aggregating across the window. Then the product-wise five second summary would be returned to a MariaDB table. What is the pipeline designed for this use case in Flink? We will use a Kafka topic called streaming.orders.input. We already created this topic in our Kafka setup. Then we will convert the JSON input value from the Kafka message to a data…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.