# # this file limits restrict certain paths from being indexed by robots. # # see http://info.webcrawler.com/mak/projects/robots/norobots.html # for more information # # Note: blank line delimit records, so there should be a blank line before # and after every group so that all robots parse this file correctly. # all robots stay out of webmail, stay out of java-ssh, stay out of group, and # stay out of papers User-agent FDSE Disallow: User-agent: * Disallow: /webmail Disallow: /apps/rworks/repo Disallow: /apps/RWorks/repo Disallow: /apps/rinterface/repo Disallow: /java-ssh Disallow: /group Disallow: /papers Disallow: /owm User-agent: fast Disallow: /