<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>There's also a couple other active fuzzing efforts running
concurrently:</p>
<ul>
<li>OSSFuzz is continuously running a set of codegen and
individual pass fuzzers. A bit more information can be found
here:
<a class="moz-txt-link-freetext" href="http://llvm.org/docs/FuzzingLLVM.html#continuously-running-and-finding-bugs">http://llvm.org/docs/FuzzingLLVM.html#continuously-running-and-finding-bugs</a></li>
<li>We (Azul Systems) have a continuously running Java fuzzer
which exercises LLVM through our Falcon compiler, and regularly
finds regressions and occasional deep long lurking issues. We
don't have a public bug tracker for this, but a sizable portion
of our upstream bug fixing activity is driven by the output of
this tool.</li>
</ul>
<p>Philip<br>
</p>
<div class="moz-cite-prefix">On 12/7/18 11:04 AM, Zhendong Su via
llvm-dev wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CALUzsy96TTRC2yLzSZs3p=aBjnazTM7Yr3Z2xWn8DF-P8_wNrw@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">
<div dir="ltr">Thanks, Vedant. Yes, we have done a lot of
testing of Clang/LLVM (and GCC) in the past several years
(more details at <a
href="https://people.inf.ethz.ch/suz/emi/index.html"
moz-do-not-send="true">https://people.inf.ethz.ch/suz/emi/index.html</a>):
<div><br>
</div>
<div><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">[GCC/LLVM
bugs: </span><b
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">1,602</b><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify"> (total)
/ </span><b
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">1,007</b><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify"> (fixed)]</span><br
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">
<span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">[Reports:
GCC (</span><a href="http://tinyurl.com/ojzdt78"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link1</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="http://tinyurl.com/oxlkmjc"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link2</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="http://tinyurl.com/jd3jnl3"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link3</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="http://tinyurl.com/zs2826l"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link4</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="https://tinyurl.com/yb7okzqd"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link5</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">),
LLVM (</span><a href="http://tinyurl.com/qj8x5ry"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link1</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="http://tinyurl.com/nc9celr"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link2</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="http://tinyurl.com/qy58smb"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link3</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="http://tinyurl.com/z7y8rwo"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link4</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a
href="https://tinyurl.com/y7wdf5b4"
style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify"
moz-do-not-send="true">link5</a><span
style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">)]</span><br>
</div>
<div><br>
</div>
<div>
<div>Best,</div>
<div>Zhendong</div>
<div><br>
</div>
<div>--------</div>
<div>Zhendong Su<br>
</div>
<div>Professor, Department of Computer Science, ETH Zurich<br>
Office: CAB E 64.1, Tel: <span style="font-size:12.8px">+41
44 633 77 72</span></div>
<div><span style="font-size:12.8px"><a
href="https://people.inf.ethz.ch/suz/" target="_blank"
moz-do-not-send="true">https://people.inf.ethz.ch/suz/</a></span><br>
</div>
<div>--------</div>
</div>
<div><br>
</div>
<div>
<div class="gmail_quote">
<div dir="ltr">On Fri, Dec 7, 2018 at 7:42 PM Vedant Kumar
<<a href="mailto:vsk@apple.com"
moz-do-not-send="true">vsk@apple.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div style="overflow-wrap: break-word;">Hello,
<div><br>
</div>
<div>+ Zhendong, who’s done a lot of work on automated
testing of llvm.<br>
<div><br>
<blockquote type="cite">
<div>On Dec 6, 2018, at 10:15 PM, Radu Ometita
via llvm-dev <<a
href="mailto:llvm-dev@lists.llvm.org"
target="_blank" moz-do-not-send="true">llvm-dev@lists.llvm.org</a>>
wrote:</div>
<br
class="gmail-m_6701961534287802269Apple-interchange-newline">
<div>
<div style="overflow-wrap: break-word;">
<div dir="auto" style="overflow-wrap:
break-word;">Hello everyone!<br>
<br>
We are working on writing a paper about
testing the reliability of C compilers by
using Csmith (a random C99 program
generator).<br>
<br>
A previous testing effort, using Csmith,
found 202 LLVM bugs, which represented 2%
of all reported bugs at that time (PDF: <a
href="https://www.flux.utah.edu/download?uid=114" target="_blank"
moz-do-not-send="true">https://www.flux.utah.edu/download?uid=114</a>):
. However, after this paper was published
we are unaware of any further testing
using Csmith, and we would like to ask you
if you are aware of any such efforts or
further results.<br>
</div>
</div>
</div>
</blockquote>
<div><br>
</div>
<div>Just speaking for myself here, I use Csmith
as part of my pre-commit testing.</div>
<div><br>
</div>
<div>vedant</div>
<br>
<blockquote type="cite">
<div>
<div style="overflow-wrap: break-word;">
<div dir="auto" style="overflow-wrap:
break-word;"><br>
Best regards,<br>
Radu Ometita,<br>
Functional compilers engineer @IOHK<br>
</div>
</div>
_______________________________________________<br>
LLVM Developers mailing list<br>
<a href="mailto:llvm-dev@lists.llvm.org"
target="_blank" moz-do-not-send="true">llvm-dev@lists.llvm.org</a><br>
<a
href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev"
target="_blank" moz-do-not-send="true">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a><br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
LLVM Developers mailing list
<a class="moz-txt-link-abbreviated" href="mailto:llvm-dev@lists.llvm.org">llvm-dev@lists.llvm.org</a>
<a class="moz-txt-link-freetext" href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a>
</pre>
</blockquote>
</body>
</html>