<div dir="ltr">Steve's change went in earlier today.<div><br></div><div>> <span style="font-family:arial,sans-serif;font-size:12.727272033691406px">This doesn't yet work with ninja makes, but tfiala or I will look at that as well.</span></div>
<div><span style="font-family:arial,sans-serif;font-size:12.727272033691406px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:12.727272033691406px">I did look into this and it actually works fine without modification if you do the 'ninja check-lldb' with the environment variable set.</span></div>
<div><span style="font-family:arial,sans-serif;font-size:12.727272033691406px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:12.727272033691406px">This was the run I just did using 32 procs:</span></div>
<div><span style="font-family:arial,sans-serif;font-size:12.727272033691406px"><br></span></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div><font size="1" face="courier new, monospace">Running multithreaded with 32 threads.</font></div>
</div><div><div><font size="1" face="courier new, monospace">Ran 278 tests.</font></div></div><div><div><font size="1" face="courier new, monospace"><br></font></div></div><div><div><font size="1" face="courier new, monospace"><b>real 1m22.855s</b></font></div>
</div><div><div><font size="1" face="courier new, monospace">user 5m38.520s</font></div></div><div><div><font size="1" face="courier new, monospace">sys 0m51.520s</font></div></div></blockquote><br><span class="" style="font-family:arial,sans-serif;font-size:12.727272033691406px"><font color="#888888"></font></span><div>
That used to take 10+ minutes.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Mar 5, 2014 at 9:51 AM, Steve Pucci <span dir="ltr"><<a href="mailto:spucci@google.com" target="_blank">spucci@google.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi all,</div><div><br></div><div>This patch provides support for running the dosep.ty test driver with multiple threads. It speeds up running the full test suite on my HP z620 Ubuntu machine with 32 hyperthreaded CPUs from 11 minutes to about 1m13s (about 9x).</div>
<div><br></div><div>The default behavior is to run single-threaded as before. If the environment variable LLDB_TEST_THREADS is set, a Python work queue is set up with that many worker threads.</div><div><br></div><div>To avoid collisions within a test directory where multiple tests make use of the same prebuilt executable, the unit of work for the worker threads is a single directory (that is, all tests within a directory are processed in the normal serial way by a single thread).</div>
<div><br></div><div>I've run this way a number of times; the only issue I found was that the TestProcessAttach.py test failed once, when attempting to attach to the process "a.out" by name. I assume this is because some other thread was running an executable of that name at the same time, and we were attempting to attach to the wrong one, so I changed that test to use a different executable name (that change is also included in the attached patch).</div>
<div><br></div><div>There is actually an opportunity to speed the overall test time further (maybe as much as another 1.5x or so) by dividing up a few long-running tests into multiple directories, but I'm not planning to do that now.</div>
<div><br></div><div>This doesn't yet work with ninja makes, but tfiala or I will look at that as well.</div><span class="HOEnZb"><font color="#888888"><div><br></div><div> - Steve</div></font></span></div>
<br>_______________________________________________<br>
lldb-dev mailing list<br>
<a href="mailto:lldb-dev@cs.uiuc.edu">lldb-dev@cs.uiuc.edu</a><br>
<a href="http://lists.cs.uiuc.edu/mailman/listinfo/lldb-dev" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/lldb-dev</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><table cellspacing="0" cellpadding="0" style="color:rgb(136,136,136);font-family:'Times New Roman'"><tbody><tr style="color:rgb(85,85,85);font-family:sans-serif;font-size:small">
<td nowrap style="border-top-style:solid;border-top-color:rgb(213,15,37);border-top-width:2px">Todd Fiala |</td><td nowrap style="border-top-style:solid;border-top-color:rgb(51,105,232);border-top-width:2px"> Software Engineer |</td>
<td nowrap style="border-top-style:solid;border-top-color:rgb(0,153,57);border-top-width:2px"> <a href="mailto:tfiala@google.com" style="color:rgb(17,85,204)" target="_blank"><span style="background-color:rgb(255,255,204);color:rgb(34,34,34);background-repeat:initial initial">tfiala@google.com</span></a> |</td>
<td nowrap style="border-top-style:solid;border-top-color:rgb(238,178,17);border-top-width:2px"><font color="#1155cc"> <a>650-943-3180</a></font></td></tr></tbody></table><br></div>
</div>