From the course: Web Scraping with Python
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Interacting with a page - Python Tutorial
From the course: Web Scraping with Python
Interacting with a page
- [Instructor] Okay, this section's a fun one. We're going to sort of tie everything all together in chapter four and show you a delightfully redundant way to log into websites without messing around with cookies and all of that. You just type your information in and press the login button, of course. Remember on this website the username can be anything and then the password has to be password. Great. So we're going to start this off with a brand new profiles project. And this project has a spider called PythonScraper.py. The start URL is going to be the same as the one we used in the first section of chapter four. So that's that login page that we just saw. We also want to make that same make_requests_from_url that we used in the second section. And that's going to return a selenium request object. Also note that we want to bring over the same settings.py file we set up in the last section. So now let's go to the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.