From the course: Azure Spark Databricks Essential Training
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Use Databricks Delta
From the course: Azure Spark Databricks Essential Training
Use Databricks Delta
- [Narrator] So I'm working with the Databricks Delta sample notebook and I've attached this notebook and run it to the ML Cluster. Now this needed some input data, so I've provided both of these things and I'll show you where they are here. So if I go to to the demos and I go to import you can see that you have the notebook here and then I have this csv file. Now this is a publicly available file and I've done a bit of data prep, so you might just want to use this file, but let me explain how this works. So we're going to be working with this Lending Club data. So you can see the data dictionary here. If you want the raw sample you can get it here. You have to strip off the first header row and the bottom two informational rows for it to load properly. Now what I've done to prepare it as a table, because this notebook starts with, and this is what the data looks like its whether or not somebody got a loan and the attributes associated with it, is it on line one here it loads a table…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
Use Databricks jobs and role-based control5m 37s
-
(Locked)
Use Databricks Runtime ML2m 52s
-
(Locked)
Understand ML Pipelines API4m 16s
-
(Locked)
Use ML Pipelines API8m 39s
-
(Locked)
Use distributed ML training9m 59s
-
(Locked)
Understand Databricks Delta3m 41s
-
(Locked)
Use Databricks Delta5m 10s
-
(Locked)
Use Azure Blob storage2m 41s
-
(Locked)
Understand MLflow7m 34s
-
-
-