# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /serendipity_admin.php Disallow: /search crawl-delay: 15 User-agent: TinEye Disallow: / User-agent: 008 Disallow: / User-agent: GPTBot Disallow: /