From the course: Amazon Web Services: Data Analytics

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Batching vs. streaming

Batching vs. streaming - Amazon Web Services (AWS) Tutorial

From the course: Amazon Web Services: Data Analytics

Start my 1-month free trial

Batching vs. streaming

“

- [Instructor] The next concept in analytics is the input types. And there's two considerations here, the data that you're going to be working with and what's called batch or stream. Batch means sent in groups. So in other words, are you sending a group of new data into your database, for example, every 24 hours? Every hour? Every minute? This data is generally processed as a group and often as a transaction. Transaction means it either all gets successfully processed. And by processed it usually means added or written to either the file store or to the database. Or if it does not get successfully get written, then nothing gets written. So all or none. So understanding the business needs in terms of the data coming around batch, particularly around transaction integrity is really, really key to setting up the appropriate analytics solutions. In addition to batch, increasingly there's data that's coming in streams. Now, where I'm seeing this is in events. So for example if you have IoT…

Contents