From the course: Apache Kafka Essential Training: Getting Started (2021)

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Producers and consumers

Producers and consumers

From the course: Apache Kafka Essential Training: Getting Started (2021)

Start my 1-month free trial

Producers and consumers

“

- [Instructor] Producers and consumers from the ecosystem for Kafka, from feeding in data to consuming them. Let's discuss more about them in this video. A producer is any client that publishes data to Kafka. Some examples include web servers that publish web click events, a log scrubber pushing in log messages, and a sensor pushing in telemetric data. To build a producer, a developer needs to use a Kafka client library within their code and publish data. Such client libraries are available for multiple programming languages. Please check the Kafka website for more details. We will discuss Java client libraries in this course. There are multiple concurrent producers for each topic. These producers can be different physical processes or threats in the same process. It is the job of the producer to identify the key of the message. Typical keys would include customer IDs, product IDs or transaction IDs. Please note that…

Contents