# # this file limits restrict certain paths from being indexed by robots. # # see http://info.webcrawler.com/mak/projects/robots/norobots.html # for more information # # Note: blank line delimit records, so there should be a blank line before # and after every group so that all robots parse this file correctly. # all robots stay out of webmail, stay out of java-ssh, stay out of group, and # stay out of papers User-agent: * Disallow: /webmail Disallow: /apps/rworks/repo Disallow: /apps/RWorks/repo Disallow: /apps/rinterface/repo Disallow: /java-ssh Disallow: /group Disallow: /papers #- disabled papers to allow search script to work, to the best of my knowledge there are no inbound links to that directory on the pages so it should be safe Disallow: /owm User-agent: fast Disallow: /