From the course: Microsoft Azure Data Fundamentals (DP-900) Exam Tips

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Data processing concepts

Data processing concepts - Azure Tutorial

From the course: Microsoft Azure Data Fundamentals (DP-900) Exam Tips

Start my 1-month free trial

Data processing concepts

“

- [Instructor] Okay, so far we have discussed how the data can be organized, either as structured, semi-structured or non-structured. Now let's discuss how to process this data. Data processing is just a conversion of raw data into meaningful information, through a specific method after it has been ingested and collected. You can process data in mainly two ways. Batch processing and streaming processing. Let's just start with batch processing. In this processing mode, newly arriving data elements are collected into a group. The whole group is then processed at a future time, as a batch, when a certain condition is met. For example, you could set scheduled time intervals to process the data. Let's say every hour or twice a day. If you think about it, our lives are full of time scheduled batches, often occurring once a month, a credit card or utility bill, the processing of salary payments, the expiration phone credits…

Contents