User-Agent: * Disallow: /common/ Disallow: /Common/ Disallow: /content/ Disallow: /Content/ Disallow: /secure/ Disallow: /Secure/ # stop spiders from crawling deep catalog pages (too much duplicate content) Disallow: */r50p # stop spiders from treating some strings in JS as potential URLs Disallow: */AAMB Disallow: *%5E Sitemap: http://concerts.wolfgangsvault.com/sitemap.xml