# Disallow all crawlers access to certain pages. User-agent: * Disallow: /popup/ Disallow: /dtd/ Disallow: /css/ Disallow: /js/ Disallow: /ajax/ Sitemap: http://www.squakenet.com/sitemap.xml User-agent: Googlebot Disallow: /abandonwarering/site.asp