From the course: Designing Highly Scalable and Highly Available SQL Databases
Unlock the full course today
Join today to access over 22,500 courses taught by industry experts or purchase this course individually.
Solution: Services and APIs for a scable user interface
From the course: Designing Highly Scalable and Highly Available SQL Databases
Solution: Services and APIs for a scable user interface
(upbeat music) - [Instructor] The solution to this ingestion challenge begins with identifying the fact that the application, or the app, will write data to a network endpoint, and there'll be a service there that will consume the data. And basically, that first tier service does minimal processing and it should do things like just checking for a valid key to make sure this is data that you want to accept. And then basically, it'll write data to a message queue. It may also do some filtering based on timestamps if the data is past a certain limit with regards to old data, we could drop it there, or you could drop it later in the application. That may depend on other business requirements. For example, do you need to log the fact that data arrived late and you discarded it? Now, the other piece of the solution is that there will be a second service, which is an application or a service that reads data from the messaging queue,…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
Human-scale and machine-scale data6m 13s
-
Different data ingestion strategies5m 6s
-
Designing scalable user interfaces6m 45s
-
Message queues to buffer ingested data4m 10s
-
Data modeling for scale: Event sourcing5m 17s
-
Distributing workload: Command Query Response Separation (CQSR)4m 26s
-
Challenge: Services and APIs for a scable user interface46s
-
Solution: Services and APIs for a scable user interface1m 10s
-
-
-