User-agent: * Crawl-Delay: 20 Disallow: /retrieveGenomeSequence.do Disallow: /appendAnnotation.do Disallow: /downloadAnnotation.do Disallow: /downloadIntergenicDNA.do Disallow: /downloadProteinSequence.do Disallow: /compareAnnotation.do Disallow: /compareAnnotation Disallow: /doBlastAlignment.do Disallow: /searchAnnotation.do Disallow: /WEB-INF Disallow: /logSearch.do Disallow: /downloads/pub Disallow: /cgi-bin/gbrowse Disallow: /PSEUDO/ Disallow: /flipOrthologs.do Disallow: /getOrthologs.do Disallow: /removeAnnotation.do Disallow: /AnnotationByPAu.asp Disallow: /getAnnotationByFeature.do Disallow: /downloadOrthologs.do