<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Yeah, we should totally document our buildbot utils somewhere.<br>
<br>
I believe the main reason why there aren't any public buildbots is
that most parties target their own code, i.e. they're more
interested in fixing false positives that hurt them specifically,
and these overlap very poorly, given how dramatically different any
different codebases usually are.<br>
<br>
There's a historical attempt at
<a class="moz-txt-link-freetext" href="http://green.lab.llvm.org/green/view/Experimental/job/StaticAnalyzerBenchmarks/">http://green.lab.llvm.org/green/view/Experimental/job/StaticAnalyzerBenchmarks/</a>
- technically it's there but in practice we never got to growing it
into anything more than an experimental prototype. Also, i heard
that Green Dragon's CPU power is relatively expensive, so we should
go for a separate machine if we are to set up a public Static
Analyzer reference results bot.<br>
<br>
<div class="moz-cite-prefix">On 4/26/19 2:06 AM, Alexander Zaitsev
via cfe-dev wrote:<br>
</div>
<blockquote type="cite"
cite="mid:9b404ef6-c7b1-eccc-6611-a476ba3ca5bf@tut.by">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<p>Hi!</p>
<p>For Clang Static Analyzer (CSA) and for Clang Tidy there are a
lot of unit-tests. That's great, but from my point of view
running CSA and clang tidy <b>regularly </b>on some set of
real life projects and comparing the results between runs is
also important to check any regressions.</p>
<p>Now I know that for CSA there are set of useful scripts in
'clang/utils/analyzer' but didn't find anything similar for
clang-tidy.<br>
</p>
<p>My questions are:<br>
</p>
<ol>
<li>Are there any buildbots which test CSA and/or Clang Tidy on
some set of projects regularly? If there are not any buildbots
- is it possible to setup it?<br>
</li>
<li>I didn't find anything about regression testing in official
documentation. I think a note about regression testing has to
be added to the documentation: how it works now, how to it for
your code, etc. Now we have just small note about running
unit-tests - <a
href="https://clang-analyzer.llvm.org/checker_dev_manual.html#testing"
moz-do-not-send="true">https://clang-analyzer.llvm.org/checker_dev_manual.html#testing</a></li>
</ol>
<p>Thank you.<br>
</p>
<pre class="moz-signature" cols="72">--
Best regards,
Alexander Zaitsev</pre>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
cfe-dev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:cfe-dev@lists.llvm.org">cfe-dev@lists.llvm.org</a>
<a class="moz-txt-link-freetext" href="https://lists.llvm.org/cgi-bin/mailman/listinfo/cfe-dev">https://lists.llvm.org/cgi-bin/mailman/listinfo/cfe-dev</a>
</pre>
</blockquote>
<br>
</body>
</html>