From the course: Stream Processing Design Patterns with Spark

Unlock the full course today

Join today to access over 22,400 courses taught by industry experts or purchase this course individually.

Setting up Kafka

Setting up Kafka - Apache Spark Tutorial

From the course: Stream Processing Design Patterns with Spark

Start my 1-month free trial

Setting up Kafka

- [Instructor] A message queue is an integral part of a stream processing pipeline, serving as both input and output. We will use Apache Kafka extensively in this course. If you do not have an Apache Kafka setup, this video will help you install and set up one on your local desktop or laptop. The instructions for setting up Kafka are available in the Setup Kafka.txt file under the resources directory in the project. Now I will execute the instructions in the file in my local desktop. Open your browser and go to kafka.apache.org/downloads. This contains the latest downloads for Kafka. For this course, I will be downloading the 2.6 version with Scala 2.12. Depending on the time you are viewing this video, the latest version might have changed. Newer versions will be generally okay, but if you run into trouble, go with the specific version used for this course. Click on the Kafka version for Scala 2.12 choose a link…

Contents