# Robots.txt file for Roguepenguin.com & Dezran.net User-agent: * Disallow: /arawen/ Disallow: /avatars/ Disallow: /cgi-bin/ Disallow: /downloads/ Disallow: /files/ Disallow: /images/ Disallow: /forum/memberlist.php Disallow: /forum/admin/ Disallow: /forum/cgi-bin/ Disallow: /forum/db/ Disallow: /forum/docs/ Disallow: /forum/images/ Disallow: /forum/templates/ Disallow: /halloween/ Disallow: /scgi-bin/ Disallow: /wp-admin/ Request-rate: 1/30 # maximum rate is one page every 5 seconds Visit-time: 0600-0845 # only visit between 6:00 AM and 8:45 AM UT (GMT)