[LLVMdev] local test-suite failures on linux

Redmond, Paul paul.redmond at intel.com
Sun Jan 20 13:26:04 PST 2013

There is almost certainly a bug in lnt or the makefiles.

I changed the body of Burg main to the following:

+  printf("Hello World\n");
+  return 0;

I re-ran the test-suite again and got the following errors:

--- Tested: 986 tests --
FAIL: MultiSource/Applications/Burg/burg.execution_time (494 of 986)
FAIL: MultiSource/Applications/ClamAV/clamscan.execution_time (495 of 986)
FAIL: MultiSource/Applications/lemon/lemon.execution_time (496 of 986)
ution_time (497 of 986)
(498 of 986)
FAIL: MultiSource/Benchmarks/Olden/voronoi/voronoi.execution_time (499 of
FAIL: MultiSource/Benchmarks/Ptrdist/anagram/anagram.execution_time (500
of 986)
FAIL: SingleSource/Benchmarks/BenchmarkGame/puzzle.execution_time (501 of

Notice how the test numbers are consecutive (494-501). They all pass when
Burg passes.


On 2013-01-20 2:50 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:

>I figured out how to resolve the failures. I noticed that Mountain Lion
>includes Bison 2.3 while Ubuntu 12.04 includes Bison 2.5. I installed
>Bison 2.3 from source in Ubuntu and the failures went away.
>I'm a little concerned that the bison version fixed all the failures I was
>seeing. To my knowledge the only failing test that depended on bison was
>Burg. It almost looks like one failure can cause unrelated tests to fail.
>Any ideas?
>On 2013-01-17 5:24 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:
>>I get the following failures when I run the test-suite on linux (Ubuntu
>>12.04) using LNT (lnt runtest nt ...):
>>(all are execution failures)
>>Everything is built off trunk.
>>Has anyone else seen these failures and found a fix? Perhaps I'm missing
>>a dependency? There doesn't appear to be a linux machine on llvm.org/perf
>>to compare with either.
>>LLVM Developers mailing list
>>LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu

More information about the llvm-dev mailing list