From the course: Data Engineering Foundations
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Data engineer vs. data scientist
From the course: Data Engineering Foundations
Data engineer vs. data scientist
- [Instructor] When you try to scale up an organization, the person who is building the algorithm is not the person who should be cleaning the data or building the tools. Let's try to understand how responsibilities of a data engineer differ from that of a data scientist. Typically, the tasks of a data engineer consists of developing a scalable data architecture, streamlining data acquisition, setting up processes that bring data together from several sources, and safeguarding data quality by cleaning up corrupt data. Now typically, they also have a deep understanding of cloud technology. They are experienced using cloud service providers, like AWS, Azure, or Google Cloud Platform. On the other hand, data scientists spend most of their time mining for patterns in data, deriving insights, applying statistical models on large datasets, or building predictive models using machine learning. They develop tools to monitor…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.