changeset 114:594b5f33fe36

Ask robots to keep out of the awffull/ and builds/ directories.
author Martin Geisler <mg@daimi.au.dk>
date Mon, 24 Mar 2008 10:46:17 +0100
parents 1a06d362d76e
children 4e414f5c17da
files robots.txt
diffstat 1 files changed, 4 insertions(+), 0 deletions(-) [+]
line wrap: on
line diff
--- a/robots.txt	Sun Mar 23 15:08:48 2008 -0700
+++ b/robots.txt	Mon Mar 24 10:46:17 2008 +0100
@@ -1,1 +1,5 @@
 # robots.txt
+
+User-agent: *
+Disallow: /awffull/
+Disallow: /builds/