# /robots.txt file for http://searchboston.com/ # mail webmaster@searchboston.com for constructive criticism User-agent: Mediapartners-Google* User-agent: * Disallow: /adsdata Disallow: /bin Disallow: /cgi-local Disallow: /collection Disallow: /etc Disallow: /images Disallow: /lib32 Disallow: /stats