From the course: Azure Spark Databricks Essential Training
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Azure Databricks for intrusion detection
From the course: Azure Spark Databricks Essential Training
Azure Databricks for intrusion detection
- So, in this scenario we're going to take a look at how you build for intrusion detection. You're going to have very similar components to the last one. So, data scientists, multiple machine learning algorithms, evaluating, tuning, visualizations, streaming data, metadata, historical data. The streaming data is going to be events in this case. And the thing you're going to add is alerting and actions. So, two different types of architectures, just so we can compare and contrast, and kind of understand some of the trade offs that you might consider in building these pipelines. So, the first one uses structured streaming and cognitive services. So, again for the data sources, we're just showing Twitter just to make it simple, but it would be lots of other data sources. If it was to look for intrusion on your devices you'd get event information from your devices as well, for example. But it's typically streaming data that comes into some sort of event bus, like the event hub. That's the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.