From the course: Web Scraping with Python
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Solution: Scraping all data on a page - Python Tutorial
From the course: Web Scraping with Python
Solution: Scraping all data on a page
(upbeat music) - [Instructor] I hope you enjoyed scraping your first webpage. A huge skill in web scraping is just being able to stare at a page's HTML and not get lost. So if you manage this, you're halfway there. Some other skills you may have used: digging to find the cleaner sources of data, being a little creative, not being afraid to get dirty and do some data wrangling, looking for perhaps hidden data, if you saw any of that. So, the fields I ended up collecting, although you may have gotten more or fewer of them: the RFC number. This might be useful if you're collecting a database of these things. I had the title, obviously. The date, the description, the author's name, the author's company, the text of the document and the list of titles and headings. If you got the description field, congratulations. If you didn't, did you happen to notice the data in the header of the page? Page headers are often…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.