# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /error/ Disallow: /warn/ Disallow: /inform/ Disallow: /users/ Disallow: /logout/ Disallow: /profile/ Disallow: /openids/ Disallow: /twips/new/