From the course: Technical SEO
Unlock the full course today
Join today to access over 22,400 courses taught by industry experts or purchase this course individually.
Technical SEO tools: Website crawler
- [Instructor] A website crawler is your search engine translator when it comes to technical SEO. Crawlers mimic how search engine bots crawl your website to rank and index your content. In order to fix the issues that a search engine crawler will run into, you need to mimic that process to find the same problems that they will. There are lots of options out there for website crawlers. The ones that I mention here are the ones that we use at our agency. And these are paid tools, although one of them does have a free option for smaller websites. You also might opt not to use a dedicated crawler like the ones I'll cover here. Most SEO tools include some sort of crawling ability and that might be just fine for your needs. Not all crawlers are created equal though and it's often a good idea to run the same site through a couple of different crawlers, at least at first, just to make sure that all the issues are getting…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.