From the course: Data Science on Google Cloud Platform: Designing Data Warehouses
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Monitoring and logging
From the course: Data Science on Google Cloud Platform: Designing Data Warehouses
Monitoring and logging
- [Narrator] Let us look at some best practices for monitoring and logging in BigQuery. BigQuery, itself, is serverless and fully managed. Administration costs are minimal. Still, using BigQuery for production environments will benefit from some monitoring and logging. GCP provides a product called Stackdriver to monitor all GCP products, including BigQuery. It can be used to monitor query performance, as well as storage use. Set up Stackdriver thresholds to monitor, both, query performance and storage. Stackdriver will send out alerts when these thresholds are exceeded. Cloud audit logs is another GCP product that provides GCP-wide audit trail for access and usage. Use this to audit users to understand who is managing and using BigQuery, and whether they are using them in the optimal manner. Cloud audit logs provide the ability to create queries and filters on audit data. This helps in easy analytics of the audit trails. Ensuring availability, performance, and cost control of…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.