[LLVMdev] local test-suite failures on linux

[Redmond, Paul]

There is almost certainly a bug in lnt or the makefiles.

I changed the body of Burg main to the following:

+  printf("Hello World\n");
+  return 0;


I re-ran the test-suite again and got the following errors:

--- Tested: 986 tests --
FAIL: MultiSource/Applications/Burg/burg.execution_time (494 of 986)
FAIL: MultiSource/Applications/ClamAV/clamscan.execution_time (495 of 986)
FAIL: MultiSource/Applications/lemon/lemon.execution_time (496 of 986)
FAIL: 
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount.exec
ution_time (497 of 986)
FAIL: 
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft.execution_time
(498 of 986)
FAIL: MultiSource/Benchmarks/Olden/voronoi/voronoi.execution_time (499 of
986)
FAIL: MultiSource/Benchmarks/Ptrdist/anagram/anagram.execution_time (500
of 986)
FAIL: SingleSource/Benchmarks/BenchmarkGame/puzzle.execution_time (501 of
986)

Notice how the test numbers are consecutive (494-501). They all pass when
Burg passes.

paul


On 2013-01-20 2:50 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:

>Hi,
>
>I figured out how to resolve the failures. I noticed that Mountain Lion
>includes Bison 2.3 while Ubuntu 12.04 includes Bison 2.5. I installed
>Bison 2.3 from source in Ubuntu and the failures went away.
>
>I'm a little concerned that the bison version fixed all the failures I was
>seeing. To my knowledge the only failing test that depended on bison was
>Burg. It almost looks like one failure can cause unrelated tests to fail.
>
>Any ideas?
>
>paul
>
>On 2013-01-17 5:24 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:
>
>>Hi,
>>
>>I get the following failures when I run the test-suite on linux (Ubuntu
>>12.04) using LNT (lnt runtest nt ...):
>>
>>(all are execution failures)
>>MultiSource/Applications/Burg
>>MultiSource/Applications/ClamAV
>>MultiSource/Applications/lemon
>>MultiSource/Applications/obsequi
>>MultiSource/Benchmarks/MiBench/automotive-bitcount
>>MultiSource/Benchmarks/MiBench/telecomm-FFT
>>MultiSource/Benchmarks/Olden/voronoi
>>MultiSource/Benchmarks/Ptrdist/anagram
>>SingleSource/Benchmarks/BenchmarkGame
>>
>>Everything is built off trunk.
>>
>>Has anyone else seen these failures and found a fix? Perhaps I'm missing
>>a dependency? There doesn't appear to be a linux machine on llvm.org/perf
>>to compare with either.
>>
>>paul
>>_______________________________________________
>>LLVM Developers mailing list
>>LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
>>http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
>