User-agent: ia_archiver Disallow: / # Looking at this blank file will add your IP to a blacklist. It is there to track malicious bots. So, don't do it. OK? User-Agent: * Disallow: /gotcha_bastard.php