From the course: Azure Spark Databricks Essential Training

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Azure Databricks for intrusion detection

Azure Databricks for intrusion detection

From the course: Azure Spark Databricks Essential Training

Start my 1-month free trial

Azure Databricks for intrusion detection

- So, in this scenario we're going to take a look at how you build for intrusion detection. You're going to have very similar components to the last one. So, data scientists, multiple machine learning algorithms, evaluating, tuning, visualizations, streaming data, metadata, historical data. The streaming data is going to be events in this case. And the thing you're going to add is alerting and actions. So, two different types of architectures, just so we can compare and contrast, and kind of understand some of the trade offs that you might consider in building these pipelines. So, the first one uses structured streaming and cognitive services. So, again for the data sources, we're just showing Twitter just to make it simple, but it would be lots of other data sources. If it was to look for intrusion on your devices you'd get event information from your devices as well, for example. But it's typically streaming data that comes into some sort of event bus, like the event hub. That's the…

Contents