From the course: Stream Processing Patterns in Apache Flink

Unlock the full course today

Join today to access over 22,500 courses taught by industry experts or purchase this course individually.

Streaming analytics: Use case design

Streaming analytics: Use case design - Flink Tutorial

From the course: Stream Processing Patterns in Apache Flink

Start my 1-month free trial

Streaming analytics: Use case design

- [Instructor] Let us design an example use case for streaming analytics in this video. Our example use case involves analyzing real-time orders. We have an e-commerce system where customers are placing orders. The orders would flow through a Kafka input topic. The order is of JSON format. The input is simple. It contains an order ID, the name of the product, the quantity purchased, and the price of each item. The goal for the use case is to analyze all the data every five seconds to compute product-wise total value. This is done by multiplying the quantity with the price and aggregating across the window. Then the product-wise five second summary would be returned to a MariaDB table. What is the pipeline designed for this use case in Flink? We will use a Kafka topic called streaming.orders.input. We already created this topic in our Kafka setup. Then we will convert the JSON input value from the Kafka message to a data…

Contents