#all robots will spider domain User-agent:* Disallow: /test/