Skip to content

Crawling and Indexing

Now that we have a general overview of how search systems and Googlebot work, we'll deep-dive into several key parts that impact Crawling and Indexing.

In this lesson, we'll take a look at:

  • HTTP status code fundamentals.
  • Metadata and what web crawlers look for when parsing web content.
  • How to communicate with Google so its search crawler knows when there is new content on your site.
  • How to leverage meta robot tags and canonical links to indicate to search engines your desired indexing status.