# robots.txt for http://www.infosnap.com/ # nothing under /secure should be indexed User-agent: * Disallow: /secure/ # no .pdf files User-agent: * Disallow: /*.pdf$ # no .asp files User-agent: * Disallow: /*.asp