[LLVMdev] llvm.org robots.txt prevents crawling by Google code search?

[Anton Korobeynikov]

> indexing the llvm.org svn archive. This means that when you search for an
> LLVM-related symbol in code search, you get one of the many (possibly
> out-of-date) mirrors, rather than the up-to-date llvm.org version. This is
> sad.
This is intentional. The workload of the server was pretty huge w/o this.

-- 
With best regards, Anton Korobeynikov
Faculty of Mathematics and Mechanics, Saint Petersburg State University