From the course: Data Engineering Foundations
Unlock the full course today
Join today to access over 22,400 courses taught by industry experts or purchase this course individually.
Challenge: Transforming data
From the course: Data Engineering Foundations
Challenge: Transforming data
(bright music) - [Instructor] So here's a quick challenge for you to transform the users data frame by aggregating all the ratings. You have to fill in these blanks with the right function and the columns to aggregate the data. And then the second task is to join the two tables. That is, the movies data fame and the average rating data frame based on the common columns that is there in each of these tables. The last task is to actually print the final data frame that you have just returned after merging the two tables.
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
Sources of data extraction4m 46s
-
Data extraction from a PostgreSQL database4m 51s
-
Challenge: Data extraction40s
-
Solution: Data extraction51s
-
Transforming data2m 3s
-
Challenge: Transforming data42s
-
Solution: Transforming data58s
-
Loading data into a DB4m 11s
-
Challenge: Loading data59s
-
Solution: Loading data1m
-
Scheduling ETL pipeline using Airflow9m 3s
-
-