<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 11/24/16 3:12 AM, Arnaud De
Grandmaison via llvm-dev wrote:<br>
</div>
<blockquote
cite="mid:VI1PR08MB10544BFD0BF726C8D54E8B3980B60@VI1PR08MB1054.eurprd08.prod.outlook.com"
type="cite">
<meta http-equiv="Context-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered
medium)">
<div class="WordSection1">
<p class="MsoNormal"><span>Hi Sandeep,</span></p>
<p class="MsoNormal"><span> </span></p>
<p class="MsoNormal"><span lang="EN-US">The CMake version of the
test-suite has been improved (see
<a class="moz-txt-link-freetext" href="https://reviews.llvm.org/D21360">https://reviews.llvm.org/D21360</a>) so that it’s easy to plug
additional test suites. A starting point would be to look at
how the TEST_SUITE_SUBDIRS variable in the top level
CMakeLists.txt is used.</span></p>
</div>
</blockquote>
<br>
I think this bug report is about adding new programs to the test
suite. I don't think Sandeep is asking how to add more test
programs to the test suite; he is asking how to add new Makefiles to
the test suite to make it run new experiments that it did not run
previously.<br>
<br>
As context, several previous research projects used an interface
within the old autoconf test suite to extend it to compile programs
with different compiler options and run performance experiments on
them. For example, the SAFECode and Automatic Pool Allocation
projects added rules to compile and run programs with additional
transforms and to record the results in CSV files which could be
imported into other programs for creating graphs for papers. All of
this could be done without modifying any files within the test-suite
project; one simply created additional Makefiles, set come variables
on the make command line, and fired off the experiments with "make."<br>
<br>
I believe Sandeep is asking whether similar functionality exists
within the new Cmake build system and, if so, how to use it. I am
curious, too. It would make running some experiments for my
research projects more convenient. I just assumed this feature was
deprecated as I got the impression that I was the only one still
using it.<br>
<br>
Regards,<br>
<br>
John Criswell<br>
<br>
<blockquote
cite="mid:VI1PR08MB10544BFD0BF726C8D54E8B3980B60@VI1PR08MB1054.eurprd08.prod.outlook.com"
type="cite">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<p class="MsoNormal"><span>Kind regards,</span></p>
<p class="MsoNormal"><span>Arnaud</span></p>
<p class="MsoNormal"><span> </span></p>
<div>
<div>
<div>
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span
lang="EN-US"> llvm-dev
[<a class="moz-txt-link-freetext" href="mailto:llvm-dev-bounces@lists.llvm.org">mailto:llvm-dev-bounces@lists.llvm.org</a>]
<b>On Behalf Of </b>Sandeep Dasgupta via llvm-dev<br>
<b>Sent:</b> 24 November 2016 02:32<br>
<b>To:</b> <a class="moz-txt-link-abbreviated" href="mailto:llvm-dev@lists.llvm.org">llvm-dev@lists.llvm.org</a><br>
<b>Subject:</b> [llvm-dev] Running "different tests"
on cmake based test-suite build</span></p>
</div>
</div>
<p class="MsoNormal"> </p>
<p><span>Hello Friends,</span></p>
<p><span>With configure based build deprecated on llvm, how
can I run different tests/pass on the suite (<a
moz-do-not-send="true"
href="http://llvm.org/docs/TestSuiteMakefileGuide.html#running-different-tests">http://llvm.org/docs/TestSuiteMakefileGuide.html#running-different-tests</a>)?
</span></p>
<p><span>Right now I am having a hacky solution, which
includes running the "still present" configure file of
test-suite to generate the MAKE.<MYPASS>.Makefile;
</span></p>
<blockquote>
<p><span>cd external-testsuite-build-loc</span></p>
<p><span><llvmsrc>/project/test-suite/configure
--enable-optimized -disable-assertions
</span></p>
</blockquote>
<p><span>but while running 'make TEST=PASS' I am getting error
for trying to include $(LLVM_OBJ_ROOT)/Makefile.config
which is obviously not there on a cmake based llvm build.
I have to edit the generated makefile to bypass this.</span></p>
<p><span>Can you please point me to some clean solution or let
me know if am missing something?
</span></p>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">-- <br>
<b>With Thanks and Regards</b><br>
Sandeep Dasgupta<br>
Research Assistant CS @UIUC<br>
(<a moz-do-not-send="true"
href="http://web.engr.illinois.edu/%7Esdasgup3/">http://web.engr.illinois.edu/~sdasgup3/</a>)
</p>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
LLVM Developers mailing list
<a class="moz-txt-link-abbreviated" href="mailto:llvm-dev@lists.llvm.org">llvm-dev@lists.llvm.org</a>
<a class="moz-txt-link-freetext" href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a>
</pre>
</blockquote>
<br>
<p><br>
</p>
<pre class="moz-signature" cols="72">--
John Criswell
Assistant Professor
Department of Computer Science, University of Rochester
<a class="moz-txt-link-freetext" href="http://www.cs.rochester.edu/u/criswell">http://www.cs.rochester.edu/u/criswell</a></pre>
</body>
</html>