[LLVMdev] failures in test-suite for make TEST=simple

[Nadav Rotem]

I use the 'make TEST=simple' as a pre-commit test. I think that everybody should run these tests before committing to LLVM. 

On Dec 12, 2012, at 5:06 PM, reed kotler <rkotler at mips.com> wrote:

> when I create the report, there are no failures in it. so maybe these are being filtered for known failures.
> 
> On 12/12/2012 05:03 PM, reed kotler wrote:
>> The first one failed on a diff:
>> ******************** TEST (simple) 'sse.expandfft' FAILED! ********************
>> Execution Context Diff:
>> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07
>> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02
>> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00
>> ******************** TEST (simple) 'sse.expandfft' ****************************
>> 
>> The second one too.
>> 
>> /llvmpb3/build/projects/test-suite/tools/fpcmp  -r 0.016" simple sse.stepfft
>> ******************** TEST (simple) 'sse.stepfft' FAILED! ********************
>> Execution Context Diff:
>> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07
>> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02
>> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00
>> ******************** TEST (simple) 'sse.stepfft' ****************************
>> 
>> The third also.
>> 
>> /home/rkotler/workspace/llvmpb3/projects/test-suite/DiffOutput.sh "/home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp  -r 0.0001" simple linpack-pc
>> ******************** TEST (simple) 'linpack-pc' FAILED! ********************
>> Execution Context Diff:
>> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 4.500000e+01 and 0.000000e+00
>> abs. diff = 4.500000e+01 rel.diff = 1.000000e+00
>> Out of tolerance: rel/abs: 1.000000e-04/0.000000e+00
>> ******************** TEST (simple) 'linpack-pc' ****************************
>> 
>> The change that I'm testing would cause massive breakage if it were wrong since it is touching fundamental classes. I don't think there is any chance that my change is causing this.
>> 
>> On 12/12/2012 04:06 PM, Nadav Rotem wrote:
>>> I forgot to mention that you can also run "make TEST=simple report" which will generate a nice report.
>>> 
>>> Do you know why these tests fail ? You can step into the test directory and run 'make TEST=simple' from there. It will save you some time.
>>> 
>>> On Dec 12, 2012, at 4:04 PM, reed kotler <rkotler at mips.com> wrote:
>>> 
>>>> I'm getting three failures.
>>>> 
>>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.expandfft
>>>> TEST-RESULT-exec-time: user       0.3200
>>>> TEST-RESULT-exec-real-time: real       0.3172
>>>> 
>>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.stepfft
>>>> TEST-RESULT-exec-time: user       0.4000
>>>> TEST-RESULT-exec-real-time: real       0.4172
>>>> make[4]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE'
>>>> 
>>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack/linpack-pc
>>>> TEST-RESULT-exec-time: user       164.9400
>>>> TEST-RESULT-exec-real-time: real       165.3131
>>>> make[3]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack'
>>>> make[3]: Entering directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/LivermoreLoops
>>>> _______________________________________________
>>>> LLVM Developers mailing list
>>>> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
>>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
>> 
>