From the course: Amazon Web Services: Data Services
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Scenario: Build for the Internet of Things with Hadoop - Amazon Web Services (AWS) Tutorial
From the course: Amazon Web Services: Data Services
Scenario: Build for the Internet of Things with Hadoop
- [Instructor] In this scenario we're going to look at Internet of Things with Hadoop. Now, if you're looking closely at the architectural diagrams you'll see that there's very little that is different from the previous one, where we talked about caching architecture. We still have our on-premise sources and our Kinesis enabled application. And, in the Amazon cloud we still have relational instances that we manage, the DB on instance, and relational instances that are partially managed, the MySQL (DB) instances for behavioral data. We have the caching capability with ElastiCache. We have S3 buckets. We have DynamoDB. We have Kinesis for streaming. We have a pipeline. So, what's new? We added in this scenario, an HDFS cluster, and that is our Hadoop implementation, otherwise known as EMR, or Elastic Map Reduced. And we've also added machine learning, because we now have enough data that we want to try out using…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
-
-
-
(Locked)
Understand a data lake pattern with AWS Lake Formation4m 23s
-
(Locked)
Explore AWS Athena3m 11s
-
(Locked)
Explore AWS Glue Data Catalog and Crawlers4m 10s
-
(Locked)
Use AWS Glue for ETL5m 32s
-
(Locked)
Explore a data lake pattern with AWS Lake Formation7m 8s
-
(Locked)
Scenario: Build for the Internet of Things with Hadoop6m 20s
-
(Locked)
-