User-agent: * # Uncomment the following line ONLY if sitemaps.org or HTML sitemaps are used # and you have verified that your site is being indexed correctly. Disallow: /browse-subject Disallow: /browse-author Disallow: /browse-title Disalow: /browse-date Disallow: /suggest Disallow: /*/browse-subject Disallow: /*/browse-author Disallow: /*/browse-title Disallow: /*/browse-date Disallow: /image Disallow: /feed Disallow: /password-login # You also may wish to disallow access to the following paths, in order # to stop web spiders from accessing user-based content: Disallow: /advanced-search Disallow: /contact Disallow: /feedback Disallow: /forgot Disallow: /login Disallow: /register Disallow: /search