From the course: Apache Spark Deep Learning Essential Training
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Future project ideas - Spark DataFrames Tutorial
From the course: Apache Spark Deep Learning Essential Training
Future project ideas
- [Jonathan] Now we've looked at Databricks' Deep Learning package for Spark which is very feature-rich. With the Databricks Community Edition that we've been using as our lab environment, we haven't been able to run our processing in parallel. Go ahead and process these images in a standalone Spark environment with multiple workers or in a cloud environment and see the difference when Spark processes these models and images in parallel. This is why companies use Spark for processing millions of images at a time. Now what if your use case is distributed training? Then check out some of the other packages such as Intel's BigDL, Yahoo's TensorFlowOnSpark, or Deeplearning4j if you also know Scala. I hope you found this course helpful. Thanks for watching, and I'd love to hear back from you and to connect via LinkedIn. Enjoy, and (speaking foreign language).
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.