<div dir="ltr"><div dir="ltr">Thanks, Vedant.  Yes, we have done a lot of testing of Clang/LLVM (and GCC) in the past several years (more details at <a href="https://people.inf.ethz.ch/suz/emi/index.html">https://people.inf.ethz.ch/suz/emi/index.html</a>): <div><br></div><div><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">[GCC/LLVM bugs: </span><b style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">1,602</b><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify"> (total) / </span><b style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">1,007</b><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify"> (fixed)]</span><br style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify"><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">[Reports: GCC (</span><a href="http://tinyurl.com/ojzdt78" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link1</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="http://tinyurl.com/oxlkmjc" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link2</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="http://tinyurl.com/jd3jnl3" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link3</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="http://tinyurl.com/zs2826l" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link4</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="https://tinyurl.com/yb7okzqd" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link5</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">), LLVM (</span><a href="http://tinyurl.com/qj8x5ry" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link1</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="http://tinyurl.com/nc9celr" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link2</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="http://tinyurl.com/qy58smb" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link3</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="http://tinyurl.com/z7y8rwo" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link4</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">, </span><a href="https://tinyurl.com/y7wdf5b4" style="text-decoration-line:none;font-family:ariel,helvetica;text-align:justify">link5</a><span style="color:rgb(0,0,0);font-family:ariel,helvetica;text-align:justify">)]</span><br></div><div><br></div><div><div>Best,</div><div>Zhendong</div><div><br></div><div>--------</div><div>Zhendong Su<br></div><div>Professor, Department of Computer Science, ETH Zurich<br>Office: CAB E 64.1, Tel: <span style="font-size:12.8px">+41 44 633 77 72</span></div><div><span style="font-size:12.8px"><a href="https://people.inf.ethz.ch/suz/" target="_blank">https://people.inf.ethz.ch/suz/</a></span><br></div><div>--------</div></div><div><br></div><div><div class="gmail_quote"><div dir="ltr">On Fri, Dec 7, 2018 at 7:42 PM Vedant Kumar <<a href="mailto:vsk@apple.com">vsk@apple.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;">Hello,<div><br></div><div>+ Zhendong, who’s done a lot of work on automated testing of llvm.<br><div><br><blockquote type="cite"><div>On Dec 6, 2018, at 10:15 PM, Radu Ometita via llvm-dev <<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a>> wrote:</div><br class="gmail-m_6701961534287802269Apple-interchange-newline"><div><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;">Hello everyone!<br><br>We are working on writing a paper about testing the reliability of C compilers by using Csmith (a random C99 program generator).<br><br>A previous testing effort, using Csmith, found 202 LLVM bugs, which represented 2% of all reported bugs at that time (PDF: <a href="https://www.flux.utah.edu/download?uid=114" target="_blank">https://www.flux.utah.edu/download?uid=114</a>): . However, after this paper was published we are unaware of any further testing using Csmith, and we would like to ask you if you are aware of any such efforts or further results.<br></div></div></div></blockquote><div><br></div><div>Just speaking for myself here, I use Csmith as part of my pre-commit testing.</div><div><br></div><div>vedant</div><br><blockquote type="cite"><div><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><br>Best regards,<br>Radu Ometita,<br>Functional compilers engineer @IOHK<br></div>
</div>_______________________________________________<br>LLVM Developers mailing list<br><a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a><br><a href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev" target="_blank">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a><br></div></blockquote></div><br></div></div></blockquote></div></div></div></div>