############################### # # robots.txt file for this website # # addresses all robots by using wild card * # User-agent: googlebot Disallow: User-agent: Titan Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: * # # list folders robots are not allowed to index # Disallow: /admin/ Disallow: /blog/ Disallow: /cache/ Disallow: /download/ Disallow: /enet/ Disallow: /ext/ Disallow: /FCKeditor/ Disallow: /forum/ Disallow: /forumnotvalid/ Disallow: /images/ Disallow: /includes/ Disallow: /indonesia/ Disallow: /international/ Disallow: /news/ Disallow: /newsletter/ Disallow: /oscdemo/ Disallow: /phpsitemappng/ Disallow: /pub/ Disallow: /receipt/ Disallow: /schedule/ Disallow: /pub/ Disallow: /receipt/ Disallow: /schedule/ Disallow: /script/ Disallow: /temp/ Disallow: /templates/ Disallow: /test/ Disallow: /UserFiles/ # # list specific files robots are not allowed to index # # # End of robots.txt file # ###############################