<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi Bill,
<div class=""><br class="">
</div>
<div class="">Yes, it is possible to run SPEC tests through LNT/test-suite.</div>
<div class="">You won’t get official reportable SPEC numbers as you don’t use the official build-and-run framework from SPEC, but OTOH you get the extra features in LNT/test-suite working out of the box, e.g. the ones documented at <a href="http://blog.llvm.org/2016/06/using-lnt-to-track-performance.html" class="">http://blog.llvm.org/2016/06/using-lnt-to-track-performance.html</a>.</div>
<div class=""><br class="">
</div>
<div class="">To make use of this, I think you need to use the cmake driver in the test-suite.</div>
<div class="">Which, if you use the LNT wrapper to drive runs, is invoked using “lnt runtest test-suite”.</div>
<div class=""><br class="">
</div>
<div class="">A few example of the important options on the command line that I hope will get you started:</div>
<div class="">
<ul class="MailOutline">
<li class="">Running SPEC2K6int reference inputs:<font face="Menlo" class=""> <span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">lnt runtest test-suite
</span><span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">--only-test=External/SPEC/CINT2006
</span><span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">--cmake-define TEST_SUITE_SPEC2006_ROOT=/work/Benchmark/spec2006 --cmake-define TEST_SUITE_RUN_TYPE=ref</span></font></li></ul>
</div>
<div class="">
<ul class="MailOutline">
<li class="">Running SPEC2K6int train inputs:<font face="Menlo" class=""> <span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">lnt runtest test-suite
</span><span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">--only-test=External/SPEC/CINT2006
</span><span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">--cmake-define TEST_SUITE_SPEC2006_ROOT=/work/Benchmark/spec2006 --cmake-define TEST_SUITE_RUN_TYPE=train</span></font></li><li class="">Running SPEC2Kfp reference inputs: <font face="Menlo" class=""><span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">lnt runtest test-suite
</span><span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">--only-test=External/SPEC/CFP2000
</span><span style="orphans: 2; white-space: pre-wrap; widows: 2;" class="">--cmake-define TEST_SUITE_SPEC2000_ROOT=/work/Benchmark/spec2000 --cmake-define TEST_SUITE_RUN_TYPE=ref</span></font><br class="">
</li></ul>
</div>
<div class="">Thanks,</div>
<div class=""><br class="">
</div>
<div class="">Kristof</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div>
<blockquote type="cite" class="">
<div class="">On 19 Jun 2018, at 23:53, Bill Seurer via llvm-dev <<a href="mailto:llvm-dev@lists.llvm.org" class="">llvm-dev@lists.llvm.org</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="">It appears that lnt has the capability to run the SPEC2000/2006/2017(maybe) tests from looking at the options and from poking around in the mailing list archives. Or does it? I experimented a bit and cannot get it to work right. However, it
isn't really documented anywhere so maybe I didn't set it up properly. Plus there's all the mention of llvmgcc...<br class="">
<br class="">
So is anyone doing this? Is there some setup information that I missed? Thanks for any tips on how to do this!<br class="">
-- <br class="">
<br class="">
-Bill Seurer<br class="">
<br class="">
_______________________________________________<br class="">
LLVM Developers mailing list<br class="">
<a href="mailto:llvm-dev@lists.llvm.org" class="">llvm-dev@lists.llvm.org</a><br class="">
http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>