#Disallow all crawlers access to certain pages.

User-Agent: *
Allow: /