# Disallow all crawlers access to certain pages. User-agent: * Allow: / Disallow: /aspnet_client Disallow: /backup Disallow: /backup.4.1.10 Disallow: /backup.6.10.10 Disallow: /code Disallow: /css Disallow: /images Disallow: /unused Disallow: /unused2 # Sitemap files Sitemap: http://www.planetheritage.org/sitemap.txt