[Lldb-commits] [Diffusion] rL238467: Refactor test runner to print sub-test-case pass/fail rate.

dawn at burble.org dawn at burble.org
Tue Jul 28 21:47:52 PDT 2015


On Mon, Jul 20, 2015 at 05:46:57PM +0000, Zachary Turner wrote:
> I'm quite confident that the drop in tests is simply a reporting issue, but
> it's hard to be more concrete than this without having a before and after
> comparison of the exact tests that were run before my patch, and the exact
> tests that were run after my patch.
> 
> If I had to hazard a guess, I'd say the difference comes from skipped tests
> being added to the lldb_total result now, but not before.

There was a drop of ~500 tests which I doubt can be explained by the
addition/subtraction of skips.  To know exactly which tests are reported
to have no longer run is difficult, because dosep.py doesn't report
which tests ran, just those that FAILed.

Any idea how to figure out which tests actually ran?  (BTW, I would
love it if dosep -v would display this!  I'd add that if I only had the
time...).  Can you please go back to the rev from before this commit and check?

Thanks!
-Dawn

PS: welcome back Zach! :)




More information about the lldb-commits mailing list