[llvm-commits] [www] r170553 - /www/trunk/robots.txt

Benjamin Kramer benny.kra at googlemail.com
Wed Dec 19 08:35:53 PST 2012


Author: d0k
Date: Wed Dec 19 10:35:52 2012
New Revision: 170553

URL: http://llvm.org/viewvc/llvm-project?rev=170553&view=rev
Log:
Add /perf to robots.txt. It's slow enough without google crawling it.

While there sort alphabetically.

Modified:
    www/trunk/robots.txt

Modified: www/trunk/robots.txt
URL: http://llvm.org/viewvc/llvm-project/www/trunk/robots.txt?rev=170553&r1=170552&r2=170553&view=diff
==============================================================================
--- www/trunk/robots.txt (original)
+++ www/trunk/robots.txt Wed Dec 19 10:35:52 2012
@@ -1,12 +1,13 @@
 User-agent: *
 Disallow: /bugs
-Disallow: /doxygen
 Disallow: /cvsweb
-Disallow: /stats
-Disallow: /testresults/X86
+Disallow: /devmtg/2008-08/*.3gp$
+Disallow: /devmtg/2008-08/*.m4v$
+Disallow: /doxygen
 Disallow: /nightlytest
-Disallow: /viewvc
 Disallow: /nightlytest2
-Disallow: /devmtg/2008-08/*.m4v$
-Disallow: /devmtg/2008-08/*.3gp$
+Disallow: /perf
+Disallow: /stats
 Disallow: /svn
+Disallow: /testresults/X86
+Disallow: /viewvc





More information about the llvm-commits mailing list