[llvm-dev] LLVM.org/viewvc down?

[Anton Korobeynikov via llvm-dev]

> How much of that are stupid (chinese) spiders?
You're right, the majority of them were from Chinese IPs.

> I had a lot of load
> issues for the NetBSD fossil repositories until I added the following to
> my nginx configuration:
>
>   if ($http_user_agent ~* (360Spider|80legs|App3leWebKit|Baiduspider|EasouSpider)) {
>     return 403;
>   }
I saw some other user agents as well. And they ignored robots.txt, yes.

-- 
With best regards, Anton Korobeynikov
Faculty of Mathematics and Mechanics, Saint Petersburg State University