From the course: Web Scraping with Python

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Submitting a form

Submitting a form - Python Tutorial

From the course: Web Scraping with Python

Start my 1-month free trial

Submitting a form

- So our web crawlers have been making a lot of HTTP requests while they traverse the internet. These are the same HTTP requests that happen when you visit a website in your browser. And you can see all these requests pop up in your browser's developer tools as they're being made by the browser. And this can be a really handy starting point for scraping forms because all a website form is is a sort of creative application of HTTP requests. So we can see this form over here and we can see this request in action. If you don't understand what this form is asking, or if you're a little confused, by the way, I recommend that you watch more Monty Python. But my name is Ryan, my quest is to seek the grail of course and my favorite color is blue, nope, green. My favorite color is green. All right, let's do that. Let's see this form action.php down here and you can see all those parameters I put in there, and the page uses those…

Contents