# / robots.txt file - to tell web robots which site areas not to index User-agent: * Disallow: /stats Disallow: /abstracts Disallow: /cat Disallow: /patchman Disallow: /specman Disallow: /Offers