#Allow All Robots: # Robots.txt file from http://www.thebestaffiliate.com # # All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /group/ Disallow: /et/ Disallow: /burung/ Disallow: /blog/ Disallow: /arp3/ Disallow: /ecmadm/ Disallow: /ecmaff/ Disallow: /jv/ Disallow: /my_diary/ Disallow: /mom/ Disallow: /majid/ Disallow: /lothar_x/ Disallow: /lcw/ Disallow: /phpadmin/ Disallow: /SF/ Disallow: /simulasi/ Disallow: /rq/ Disallow: /ultah/ Disallow: /video/ Disallow: /work_anywhere/ Disallow: /zxydat/ User-agent: msnbot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: /