User-agent: * Disallow: /aspnet_client/ Disallow: /Batch/ Disallow: /Perl/ Disallow: /scripts/ Disallow: /search/ Disallow: /servlet/ Disallow: /WU01/VC/visitor_info/ Disallow: /cfdocs/legis/home/bills/applyStyle.cfm Disallow: /cfdocs/Errors/404.cfm Disallow: /cfdocs/Errors/ Crawl-delay: 5 #block synapse User-agent: Mozilla/4.0 (compatible; Synapse) Disallow: / #block HttpComponents/1.1 from btchech.cfm - BTCheck does not know if it is a mobile site or not and sends it to PALEGIS\Choose\Index.cfm User-agent: HttpComponents/1.1 Disallow: /CFDOCS/Legis/PN/Public/btCheck.cfm