From the course: Designing Highly Scalable and Highly Available SQL Databases

Unlock the full course today

Join today to access over 22,500 courses taught by industry experts or purchase this course individually.

Different data ingestion strategies

Different data ingestion strategies

From the course: Designing Highly Scalable and Highly Available SQL Databases

Start my 1-month free trial

Different data ingestion strategies

- [Narrator] Let's take a look at how data is used and how it's different at human scale versus machine scale. By all means this isn't always the case, but typically human scale data is ingested directly by the application which receives the data, writes the data to persistent storage, like a relational database. And typically what we find with things like enterprise applications is that the data is often read a lot more than it's written. So it's a write once read many times kind of scenario. And this data is often used either for targeted look-ups, so, for example, looking up my insurance policy by my account number is one way to do it or by filtering on certain sets of attributes. So for example, you might want to know about sales at a particular region of a particular product. So you filter and query based on those attributes that you're interested in and you get multiple rows back. That's kind of typical for human scale…

Contents