From the course: Azure Spark Databricks Essential Training
Join today to access over 22,500 courses taught by industry experts or purchase this course individually.
Azure Databricks concepts
From the course: Azure Spark Databricks Essential Training
Azure Databricks concepts
- [Instructor] So the Databricks offering around Apache Spark has three component areas, as I mentioned previously. So let's dive a little bit deeper into them. So, at the top level, you have the Databricks collaborative workspace and that's expressed as Databricks Interactive where you can work with your cluster through a Jupyter-style notebook. So this is a browser-based integration that we'll be working with very frequently in this course. I like to think of it as a smart IVE because it has information about not only the execution, but also visualizations and documentation. There's also a Databricks production layer at this level and there are APIs, which you can work with. The Databricks runtime includes Apache Spark core, also Databricks I/O, and now Databricks Serverless, which we'll be exploring in addition to running Databricks on more traditional cloud-based VMs. And surrounding that is Databricks Enterprise Security, which is more and more an absolute requirement for many of…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.