Google offers several services for processing large amounts of data. Explore several and review complex event data pipelines.
- [Instructor] Many of the big data pipelines … that I work on process events. … You might be surprised at the complexity … of scenarios such as the one shown here. … Now I want to highlight the sections … that focus on data processing. … When we're thinking about what type … of services we can use on GCP … to process massive amounts of data, … there are a number of services that have been available … for a while and some new ones too. … So in this typical type … of complex event processing architecture, … you have needs to process, … information coming in from both streaming and batch. … In this case, … the streaming information is coming in through Pub/Sub. … Notice the processing is being handled … by Cloud Dataflow and then the processed events … are being dumped into Cloud Bigtable. … For batch, … we're using ETL to do pre-processing on the data … as it's sent in each batch. … The data is then dumped into another instance … of Cloud Dataflow, … which is a rules engine, … and another service for even more rules processing, …
- Enterprise concerns
- Enterprise scenarios
- Setting up your organization’s account
- Managing billing
- Enterprise compute services
- Enterprise storage and database services
- Enterprise data pipelines
- GCP developer and DevOps tools
Skill Level Intermediate
Work with cloud services1m 13s
1. GCP for the Enterprise
2. Enterprise Setup and Security
3. Enterprise Compute
4. Enterprise Storage and Database
5. Enterprise Data Pipelines
6. Dev and DevOps Tools
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.