[LLVMdev] local test-suite failures on linux

[David Blaikie]

On Sun, Jan 20, 2013 at 1:26 PM, Redmond, Paul <paul.redmond at intel.com> wrote:
> There is almost certainly a bug in lnt or the makefiles.
>
> I changed the body of Burg main to the following:
>
> +  printf("Hello World\n");
> +  return 0;
>
>
> I re-ran the test-suite again and got the following errors:
>
> --- Tested: 986 tests --
> FAIL: MultiSource/Applications/Burg/burg.execution_time (494 of 986)
> FAIL: MultiSource/Applications/ClamAV/clamscan.execution_time (495 of 986)
> FAIL: MultiSource/Applications/lemon/lemon.execution_time (496 of 986)
> FAIL:
> MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount.exec
> ution_time (497 of 986)
> FAIL:
> MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft.execution_time
> (498 of 986)
> FAIL: MultiSource/Benchmarks/Olden/voronoi/voronoi.execution_time (499 of
> 986)
> FAIL: MultiSource/Benchmarks/Ptrdist/anagram/anagram.execution_time (500
> of 986)
> FAIL: SingleSource/Benchmarks/BenchmarkGame/puzzle.execution_time (501 of
> 986)
>
> Notice how the test numbers are consecutive (494-501). They all pass when
> Burg passes.

Yeah, that's disturbing. Bumping this thread to keep some visibility -
I haven't looked into this yet but someone (maybe me, eventually)
should figure this out.

>
> paul
>
>
> On 2013-01-20 2:50 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:
>
>>Hi,
>>
>>I figured out how to resolve the failures. I noticed that Mountain Lion
>>includes Bison 2.3 while Ubuntu 12.04 includes Bison 2.5. I installed
>>Bison 2.3 from source in Ubuntu and the failures went away.
>>
>>I'm a little concerned that the bison version fixed all the failures I was
>>seeing. To my knowledge the only failing test that depended on bison was
>>Burg. It almost looks like one failure can cause unrelated tests to fail.
>>
>>Any ideas?
>>
>>paul
>>
>>On 2013-01-17 5:24 PM, "Redmond, Paul" <paul.redmond at intel.com> wrote:
>>
>>>Hi,
>>>
>>>I get the following failures when I run the test-suite on linux (Ubuntu
>>>12.04) using LNT (lnt runtest nt ...):
>>>
>>>(all are execution failures)
>>>MultiSource/Applications/Burg
>>>MultiSource/Applications/ClamAV
>>>MultiSource/Applications/lemon
>>>MultiSource/Applications/obsequi
>>>MultiSource/Benchmarks/MiBench/automotive-bitcount
>>>MultiSource/Benchmarks/MiBench/telecomm-FFT
>>>MultiSource/Benchmarks/Olden/voronoi
>>>MultiSource/Benchmarks/Ptrdist/anagram
>>>SingleSource/Benchmarks/BenchmarkGame
>>>
>>>Everything is built off trunk.
>>>
>>>Has anyone else seen these failures and found a fix? Perhaps I'm missing
>>>a dependency? There doesn't appear to be a linux machine on llvm.org/perf
>>>to compare with either.
>>>
>>>paul
>>>_______________________________________________
>>>LLVM Developers mailing list
>>>LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
>>>http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
>>
>
>
> _______________________________________________
> LLVM Developers mailing list
> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev