<div dir="ltr">That's worth a try.<div><br></div><div>I don't yet have any insight into exactly what's wrong with the one I'm seeing (or the additional failures that Ed is seeing on FreeBSD), so I'm not yet sure if this will address it. But it does seem worth a try.</div>
<div><br></div><div>In the event that your idea works out to eliminate those failures, there is another element we can consider. We can have Python give us the # cores available (if there's something portable to do that), and when not otherwise specified, pick a reasonable default # threads to get decent test run performance without needing the environment variable specified. This would give anybody running the tests a decent test run speedup without having to read docs on configuring the environment variable. (I think this was Steve Pucci's idea but definitely something we discussed.)</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Mar 17, 2014 at 10:12 AM, Greg Clayton <span dir="ltr"><<a href="mailto:gclayton@apple.com" target="_blank">gclayton@apple.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Maybe we can mark certain tests with a decorator so they get serially run after all other parallel tests have completed?<br>
<br>
Maybe "@serializeTest"?<br>
<div class="HOEnZb"><div class="h5"><br>
<br>
<br>
On Mar 17, 2014, at 7:16 AM, Ed Maste <<a href="mailto:emaste@freebsd.org">emaste@freebsd.org</a>> wrote:<br>
<br>
> On 7 March 2014 01:32, Todd Fiala <<a href="mailto:tfiala@google.com">tfiala@google.com</a>> wrote:<br>
>> Steve's change went in earlier today.<br>
>><br>
>>> This doesn't yet work with ninja makes, but tfiala or I will look at that<br>
>>> as well.<br>
>><br>
>> I did look into this and it actually works fine without modification if you<br>
>> do the 'ninja check-lldb' with the environment variable set.<br>
>><br>
>> This was the run I just did using 32 procs:<br>
>><br>
>> Running multithreaded with 32 threads.<br>
>> Ran 278 tests.<br>
>><br>
>> real 1m22.855s<br>
>> user 5m38.520s<br>
>> sys 0m51.520s<br>
>><br>
>><br>
>> That used to take 10+ minutes.<br>
><br>
> For reference, these are the test times I see on FreeBSD (after<br>
> including a PoC patch for <a href="http://llvm.org/pr18894" target="_blank">llvm.org/pr18894</a>)<br>
><br>
> 1 thread: 443.49 real 214.02 user 63.72 sys<br>
> 4 threads: 121.17 real 234.17 user 66.27 sys<br>
> 8 threads: 88.70 real 305.37 user 92.82 sys<br>
><br>
> I see occasional test failures with higher thread settings (I believe<br>
> this was mentioned on the list before). These are the ones that seem<br>
> susceptible:<br>
><br>
> FAIL: LLDB (suite) :: TestCallThatRestarts.py<br>
> FAIL: LLDB (suite) :: TestWatchpointConditionCmd.py<br>
> FAIL: LLDB (suite) :: TestWatchpointConditionAPI.py<br>
</div></div><div class="HOEnZb"><div class="h5">> _______________________________________________<br>
> lldb-dev mailing list<br>
> <a href="mailto:lldb-dev@cs.uiuc.edu">lldb-dev@cs.uiuc.edu</a><br>
> <a href="http://lists.cs.uiuc.edu/mailman/listinfo/lldb-dev" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/lldb-dev</a><br>
<br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><table cellspacing="0" cellpadding="0" style="color:rgb(136,136,136);font-family:'Times New Roman'"><tbody><tr style="color:rgb(85,85,85);font-family:sans-serif;font-size:small">
<td nowrap style="border-top-style:solid;border-top-color:rgb(213,15,37);border-top-width:2px">Todd Fiala |</td><td nowrap style="border-top-style:solid;border-top-color:rgb(51,105,232);border-top-width:2px"> Software Engineer |</td>
<td nowrap style="border-top-style:solid;border-top-color:rgb(0,153,57);border-top-width:2px"> <a href="mailto:tfiala@google.com" style="color:rgb(17,85,204)" target="_blank"><span style="background-color:rgb(255,255,204);color:rgb(34,34,34);background-repeat:initial initial">tfiala@google.com</span></a> |</td>
<td nowrap style="border-top-style:solid;border-top-color:rgb(238,178,17);border-top-width:2px"><font color="#1155cc"> <a>650-943-3180</a></font></td></tr></tbody></table><br></div>
</div>