From the course: Data Engineering Foundations
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Data extraction from a PostgreSQL database
From the course: Data Engineering Foundations
Data extraction from a PostgreSQL database
- [Instructor] It's time to start implementing what we have learned so far to a real world project. To keep things simple, I have created a two table database schema for a movie rating application. Here we have two tables, movies and users. Movies table obviously contains the information about the films, and users table contains user data, who have rated a number of movies. Now, there are a number of fields in each table. We have id, which is the primary key in both of the tables. And then we have name, description, and category in the movies table. On the other hand, in the user's table, we have movie_id, which is a foreign key, that will reference the movies table, and the rating, or you can say the number of stars out of five given by a particular user to a particular movie_id. So, I've created a new PostgreSQL database and added some dummy data in each of these tables to showcase the usage of each of the tools and…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
(Locked)
Sources of data extraction4m 46s
-
(Locked)
Data extraction from a PostgreSQL database4m 51s
-
(Locked)
Challenge: Data extraction40s
-
(Locked)
Solution: Data extraction51s
-
(Locked)
Transforming data2m 3s
-
(Locked)
Challenge: Transforming data42s
-
(Locked)
Solution: Transforming data58s
-
(Locked)
Loading data into a DB4m 11s
-
(Locked)
Challenge: Loading data59s
-
(Locked)
Solution: Loading data1m
-
(Locked)
Scheduling ETL pipeline using Airflow9m 3s
-
(Locked)
-