Monday, September 14, 2009

SEO Interview Question 35 - Robots.txt




What will the following robots.txt file do?

User-agent: Googlebot
Disallow: /*?
User-agent:Scooter
Disallow:

a. It will allow google to crawl any the dynamically generated pages. It will also allow the altavista scooter bot to access every page

b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the altavista scooter bot to accessing any page

c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the altavista scooter bot to access every page

d. none of the above


Finally i found another straightforward question. Happy..

No comments:

Post a Comment