[lldb-dev] test results look typical?

[via lldb-dev]

On Mon, Aug 24, 2015 at 03:37:52PM -0700, Todd Fiala via lldb-dev wrote:
> On Linux on non-virtualized hardware, I currently see the failures below on
> Ubuntu 14.04.2 using a setup like this:
> [...]
> 
> ninja check-lldb output:
> 
> Ran 394 test suites (15 failed) (3.807107%)
> Ran 474 test cases (17 failed) (3.586498%)

I don't think you can't trust the reporting of dosep.py's "Ran N test
cases", as it fails to count about 500 test cases.  The only way I've
found to get an accurate count is to add up all the Ns from "Ran N tests
in" as follows:

./dosep.py -s --options "-v --executable $BLDDIR/bin/lldb" 2>&1 | tee test_out.log
export total=`grep -E "^Ran [0-9]+ tests? in" test_out.log | awk '{count+=$2} END {print count}'`

(See comments in http://reviews.llvm.org/rL238467.)