<div dir="ltr">Hi Sunil,<div><br></div><div>looks cool. The included test file example looks "llvm-y" to me :-) A few questions:</div><div><br></div><div>1.) How much of your 400 test files is from the manual abi method, how much from your test case generator?</div>
<div>2.) Test runtime probably scales fairly well with the number of cores, right? You say it takes one hour to run on one core, so an 8-core system should take less than 10 minutes?</div><div>3.) How many bugs did you find with this so far?</div>
<div><br></div><div>(I tend to be somewhat cautious about programs that generate exhaustive tests and then compare the results to golden files. In my experience, they tend to take a long time to run since they generate many "not interesting" test cases, and when changing something one has to update many golden files and then it's easy to miss undesired changes. For an ABI test suite, the golden files will hopefully not change often though.</div>
<div><br></div><div>I like the approach taken during clang/win bringup: They wrote fuzzers to generate lots of test cases, and then checked in hand-reduced versions of the test cases that turned out to be interesting, using the regular clang testing architecture.)</div>
<div><br></div><div>Nico</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jul 2, 2014 at 3:51 PM, Srivastava, Sunil <span dir="ltr"><<a href="mailto:sunil_srivastava@playstation.sony.com" target="_blank">sunil_srivastava@playstation.sony.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;color:black">Hi,</span><span style="color:black">
<br>
<br>
</span><span style="font-size:10.0pt;color:black">At the SN Systems division of Sony, we have developed an IA64 ABI test-suite for clang/llvm based on the lit framework. We would like to submit this to the LLVM community. The test-suite currently supports
clang in both LP64/x86-64 and ILP32/x86 targets, with the ability of adding others. The tests perform target-side execution and work with both cross and native targets.</span><span style="color:black">
<br>
<br>
</span><span style="font-size:10.0pt;color:black">Please find attached a pdf document that describes the design of this test-suite. In summary, the test-suite covers:</span><span style="color:black">
<br>
</span><span style="font-size:10.0pt;font-family:Symbol;color:black">·</span><span style="font-size:7.5pt;color:black">
</span><span style="font-size:10.0pt;color:black">struct layout rules, including bit-fields,</span><span style="color:black">
<br>
</span><span style="font-size:10.0pt;font-family:Symbol;color:black">·</span><span style="font-size:7.5pt;color:black">
</span><span style="font-size:10.0pt;color:black">Object layout, base classes, vtables, VTTs, construction vtables,</span><span style="color:black">
<br>
</span><span style="font-size:10.0pt;font-family:Symbol;color:black">·</span><span style="font-size:7.5pt;color:black">
</span><span style="font-size:10.0pt;color:black">Name mangling,</span><span style="color:black">
<br>
</span><span style="font-size:10.0pt;font-family:Symbol;color:black">·</span><span style="font-size:7.5pt;color:black">
</span><span style="font-size:10.0pt;color:black">Contents of typeinfo variables,</span><span style="color:black">
<br>
</span><span style="font-size:10.0pt;font-family:Symbol;color:black">·</span><span style="font-size:7.5pt;color:black">
</span><span style="font-size:10.0pt;color:black">Array cookies,</span><span style="color:black">
<br>
</span><span style="font-size:10.0pt;font-family:Symbol;color:black">·</span><span style="font-size:7.5pt;color:black">
</span><span style="font-size:10.0pt;color:black">and a few other items.</span><span style="color:black">
<br>
<br>
</span><span style="font-size:10.0pt;color:black">Please consider accepting this test-suite as an llvm project. We look forward to addressing any comments and questions you have on this topic.</span><span style="color:black">
<br>
<br>
</span><span style="font-size:10.0pt">Best regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt">Sunil Srivastava<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt">SN Systems / Sony Computer Entertainment<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<br>_______________________________________________<br>
cfe-dev mailing list<br>
<a href="mailto:cfe-dev@cs.uiuc.edu">cfe-dev@cs.uiuc.edu</a><br>
<a href="http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev</a><br>
<br></blockquote></div><br></div>