[llvm-commits] [www] r170553 - /www/trunk/robots.txt
Benjamin Kramer
benny.kra at googlemail.com
Wed Dec 19 08:35:53 PST 2012
Author: d0k
Date: Wed Dec 19 10:35:52 2012
New Revision: 170553
URL: http://llvm.org/viewvc/llvm-project?rev=170553&view=rev
Log:
Add /perf to robots.txt. It's slow enough without google crawling it.
While there sort alphabetically.
Modified:
www/trunk/robots.txt
Modified: www/trunk/robots.txt
URL: http://llvm.org/viewvc/llvm-project/www/trunk/robots.txt?rev=170553&r1=170552&r2=170553&view=diff
==============================================================================
--- www/trunk/robots.txt (original)
+++ www/trunk/robots.txt Wed Dec 19 10:35:52 2012
@@ -1,12 +1,13 @@
User-agent: *
Disallow: /bugs
-Disallow: /doxygen
Disallow: /cvsweb
-Disallow: /stats
-Disallow: /testresults/X86
+Disallow: /devmtg/2008-08/*.3gp$
+Disallow: /devmtg/2008-08/*.m4v$
+Disallow: /doxygen
Disallow: /nightlytest
-Disallow: /viewvc
Disallow: /nightlytest2
-Disallow: /devmtg/2008-08/*.m4v$
-Disallow: /devmtg/2008-08/*.3gp$
+Disallow: /perf
+Disallow: /stats
Disallow: /svn
+Disallow: /testresults/X86
+Disallow: /viewvc
More information about the llvm-commits
mailing list