Crawling and Indexing

Now that we have a general overview of how search systems and Googlebot work, we'll deep-dive into several key parts that impact Crawling and Indexing.

In this lesson, we'll take a look at:

• HTTP status code fundamentals.
• Metadata and what web crawlers look for when parsing web content.
• How to communicate with Google so its search crawler knows when there is new content on your site.
• How to leverage meta robot tags and canonical links to indicate to search engines your desired indexing status.