From the course: Apache Kafka Essential Training: Getting Started (2021)
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Kafka brokers
From the course: Apache Kafka Essential Training: Getting Started (2021)
Kafka brokers
- [Instructor] A kafka broker is the center brain behind everything that kafka does. Let's explore more about brokers in this video. A broker is nothing but a running Kafka instance. It is a physical process that runs on the base operating system and executes all Kafka functions. A Kafka process listens on a specific port. Usually this is 9092 but it's configurable. The Kafka broker receives messages from producers and stores them locally in logs. Consumers subscribe to specific topics within the Kafka broker. The broker keeps track of all active consumers. It knows about the last message that was sent to a consumer. So only sends any new messages in the subscribe topic to that consumer. It also keeps a heartbeat with every consumer. So when a consumer dies, it can track and reset. Kafka brokers manage the life cycle of topics. They track and manage topic partitions. They also manage the corresponding partition logs.…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.