Monday, September 14, 2009
SEO Interview Question 35 - Robots.txt
What will the following robots.txt file do?
User-agent: Googlebot
Disallow: /*?
User-agent:Scooter
Disallow:
a. It will allow google to crawl any the dynamically generated pages. It will also allow the altavista scooter bot to access every page
b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the altavista scooter bot to accessing any page
c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the altavista scooter bot to access every page
d. none of the above
Finally i found another straightforward question. Happy..
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment