From the course: Apache Kafka Essential Training: Getting Started (2021)
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Consumer groups
From the course: Apache Kafka Essential Training: Getting Started (2021)
Consumer groups
- [Instructor] Let's discuss Consumer Groups in Kafka in this video. What is a consumer group? A consumer group is a group of consumers that share a topic workload. A topic may be generating thousands of messages in a short amount of time. It may not be possible for one single consumer process to keep up with processing these messages. For scalability, multiple consumer processes can be started and the messages can be distributed among them. For load balancing, a consumer group is a logical group of consumers that Kafka users for such low distribution. Each message will be sent to only one consumer within a consumer group, that consumer is then responsible for processing the message and acknowledging back to Kafka. Consumers split workload among themselves using petitions. Kafka, keep tracks of the active number of consumers for a given topic, it then distributes the messages evenly between these consumers. Kafka…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.