Monday, September 14, 2009

SEO Interview Question 35 - Robots.txt




What will the following robots.txt file do?

User-agent: Googlebot
Disallow: /*?
User-agent:Scooter
Disallow:

a. It will allow google to crawl any the dynamically generated pages. It will also allow the altavista scooter bot to access every page

b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the altavista scooter bot to accessing any page

c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the altavista scooter bot to access every page

d. none of the above


Finally i found another straightforward question. Happy..

1 comment:

t28 Tower Noida said...

eally, i am thankful for the new things and i have learned reading from your post also picked up some great ideas.Thanks a lot.
paras the rise tower t28
paras the rize tower t28
paras the rize t28 tower
paras tierea tower t28
paras tierea t28 tower

Post a Comment