Does Googlebot use inference when crawling?

Channel:

Google Search Central

Subscribers:

751,000

Published on September 9, 2009 6:34:38 PM ● Video Link: https://www.youtube.com/watch?v=OdJf1l3jWN4

Duration: 2:11

5,975 views

17

Leon from the UK asks:

"Does GoogleBot use inference when spidering - having crawled site.com/article/page1.htm and /page2.htm, can it guess at the existence of a /page3.htm and crawl it? Or does it stick entirely to what it finds via the link graph and/or Sitemaps/feeds?"

This video is part of a "Grab Bag" series in which Matt Cutts, head of Google's webspam team, answers questions from webmasters. We're not currently taking new video questions, so your best bet for getting an answer about webmaster-related search issues is to head to our help forum: http://www.google.com/support/forum/p/Webmasters?hl=en