From the course: Azure Spark Databricks Essential Training
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Use Databricks Runtime ML
From the course: Azure Spark Databricks Essential Training
Use Databricks Runtime ML
- So today, in this course, we've been focusing on the notebook as the driving interface for our workflows. We've been running notebooks, which have been training machine learning models for most of our workflows, although that's not required, there are Spark workflows that don't include machine learning models. In some cases, we've been creating streams, and we haven't got yet to the point of serving models. Now, in the previous section, we looked at scaling machine learning models that we wrote. Of course, distributed machine learning is really a key workload for Spark and Databricks. So we're going to dive a little bit deeper into very complex machine learning workloads. So as of this recording, Databricks offers the Databricks runtime for machine learning as a cluster type, and what this is is an environment for machine learning and data science. And I would add the word advanced. Now this is an area of active development on the platform and what I'm going to be showing you here…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
Use Databricks jobs and role-based control5m 37s
-
(Locked)
Use Databricks Runtime ML2m 52s
-
(Locked)
Understand ML Pipelines API4m 16s
-
(Locked)
Use ML Pipelines API8m 39s
-
(Locked)
Use distributed ML training9m 59s
-
(Locked)
Understand Databricks Delta3m 41s
-
(Locked)
Use Databricks Delta5m 10s
-
(Locked)
Use Azure Blob storage2m 41s
-
(Locked)
Understand MLflow7m 34s
-
-
-