From the course: Data Science on Google Cloud Platform: Designing Data Warehouses
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Partition tables
From the course: Data Science on Google Cloud Platform: Designing Data Warehouses
Partition tables
- [Instructor] BigQuery allows tables to be partitioned based on date or timestamp columns. Individual partitions are stored separately and treated like individual tables for storage and querying purposes. BigQuery allows partitions of data based on either time of ingestion or an explicit date or timestamp column. When a partition is created based on the ingestion time, BigQuery creates two pseudo columns called underscore partition date and underscore partition time. These two columns can be used as regular table columns in queries for selection and filtering. The other option is to create a partition explicitly based on a date or time column that exists in the table. In this case, no pseudo columns are created. Rather, the column's data is used to physically partition and store data. There are a couple of advantages of partitioning tables. When a query is made based on filter using the partition columns, then BigQuery only looks at data in those partitions. This improves performance…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.