If I don't need to block crawlers, should I create a robots.txt file?

Channel:
United States Google Search Central
Subscribers:
751,000
Published on ● Video Link: https://www.youtube.com/watch?v=P7GY1fE5JQQ


Duration: 1:58
21,427 views
76

Is it better to have a blank robots.txt file, a robots.txt that contains User-agent: * Disallow:" or no robots.txt file at all?" Corey S, Pennsylvania

Have a question? Ask it in our Webmaster Help Forum: http://www.google.com/support/forum/p/Webmasters?hl=en

Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: http://twitter.com/googlewmc

More videos: http://www.youtube.com/GoogleWebmasterHelp
Webmaster Central Blog: http://googlewebmastercentral.blogspot.com/
Webmaster Central: http://www.google.com/webmasters



Other Videos By Google Search Central


2011-12-05Notifying Google of Video Updates
2011-12-05Introduction to Rich Snippets
2011-12-05Common Video Indexing Pitfalls
2011-12-05Video Country Restrictions
2011-12-05Video Platform Restrictions
2011-12-05Testing Your Video Markup
2011-12-04Alternate Markups for Videos
2011-12-04Schema.org for Videos
2011-12-04Introduction to Video Markup
2011-09-22Live Q&A September 21, 2011
2011-08-19If I don't need to block crawlers, should I create a robots.txt file?
2011-08-19Submit to index via Google Webmaster Tools
2011-08-19If I buy AdWords, will that cause my algorithmic search rankings to rise?
2011-08-19Should I block Googlebot from crawling a dynamically generated calendar?
2011-08-19How can I identify causes of a PageRank drop?
2011-08-19Can too many redirects from a single URL have a negative effect on crawling?
2011-08-19How does SafeSearch work?
2011-08-19What is Google's approach to customer service?
2011-08-19Will Google implement the ability to search with regular expressions?
2011-08-18What is the ideal keyword density of a page?
2011-08-18Does translated content cause a duplicate content issue?


Tags:
google
seo
robots