# robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ User-agent: * disallow: /cms/ disallow: /oud/ disallow: /old/ disallow: /wp-admin/ disallow: /api/