# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /tag/ Disallow: /search/ Disallow: /people/ Disallow: /hot/all Disallow: /my Disallow: /my/ Disallow: /publish Disallow: /publish/ Disallow: /portal/ Disallow: /add Disallow: /add/ Disallow: /share Disallow: /share/ Disallow: /post Disallow: /post/