Wednesday, September 23, 2009

class="robots-noindex"

This is another experiment on how robots treat the following class="robots-noindex".

<div class="robots-noindex"> Robots must exclude this content in their search index</div>


Lets try  to get a paragraph indexed by Google bot only

<div class="robots-noindex googlebot-index"> All robots must exclude this content in their search index except Googlebot</div>

<div class="robots-noindex slurp-index"> All robots must exclude this content in their search index except Yahoo bot</div>

No comments:

Post a Comment