Liens
1785 shaares
2 results
tagged
robots
Optimisation SEO
User-agent: Googlebot
Disallow:
User-agent: googlebot-image
Disallow:
User-agent: googlebot-mobile
Disallow:
User-agent: bingbot
Disallow:
User-agent: MSNBot
Disallow:
User-agent: Slurp
Disallow:
User-agent: yahoo-mmcrawler
Disallow:
User-agent: psbot
Disallow:
User-agent: DuckDuckBot
Disallow:
User-agent: *
Disallow:
Disallow: /cgi-bin/
Amicalement
User-agent: Googlebot
Disallow:
User-agent: googlebot-image
Disallow:
User-agent: googlebot-mobile
Disallow:
User-agent: bingbot
Disallow:
User-agent: MSNBot
Disallow:
User-agent: Slurp
Disallow:
User-agent: yahoo-mmcrawler
Disallow:
User-agent: psbot
Disallow:
User-agent: DuckDuckBot
Disallow:
User-agent: *
Disallow:
Disallow: /cgi-bin/
Amicalement
Ce document décrit la façon dont nous gérons le fichier robots.txt qui vous permet de contrôler comment nos robots explorent et indexent les sites Web accessibles au public.