[LLVMdev] failures in test-suite for make TEST=simple

[reed kotler]

when I create the report, there are no failures in it. so maybe these 
are being filtered for known failures.

On 12/12/2012 05:03 PM, reed kotler wrote:
> The first one failed on a diff:
> ******************** TEST (simple) 'sse.expandfft' FAILED! 
> ********************
> Execution Context Diff:
> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 
> 1.139094e-07 and 1.159249e-07
> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02
> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00
> ******************** TEST (simple) 'sse.expandfft' 
> ****************************
>
> The second one too.
>
> /llvmpb3/build/projects/test-suite/tools/fpcmp  -r 0.016" simple 
> sse.stepfft
> ******************** TEST (simple) 'sse.stepfft' FAILED! 
> ********************
> Execution Context Diff:
> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 
> 1.139094e-07 and 1.159249e-07
> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02
> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00
> ******************** TEST (simple) 'sse.stepfft' 
> ****************************
>
> The third also.
>
> /home/rkotler/workspace/llvmpb3/projects/test-suite/DiffOutput.sh 
> "/home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp  -r 
> 0.0001" simple linpack-pc
> ******************** TEST (simple) 'linpack-pc' FAILED! 
> ********************
> Execution Context Diff:
> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 
> 4.500000e+01 and 0.000000e+00
> abs. diff = 4.500000e+01 rel.diff = 1.000000e+00
> Out of tolerance: rel/abs: 1.000000e-04/0.000000e+00
> ******************** TEST (simple) 'linpack-pc' 
> ****************************
>
> The change that I'm testing would cause massive breakage if it were 
> wrong since it is touching fundamental classes. I don't think there is 
> any chance that my change is causing this.
>
> On 12/12/2012 04:06 PM, Nadav Rotem wrote:
>> I forgot to mention that you can also run "make TEST=simple report" 
>> which will generate a nice report.
>>
>> Do you know why these tests fail ? You can step into the test 
>> directory and run 'make TEST=simple' from there. It will save you 
>> some time.
>>
>> On Dec 12, 2012, at 4:04 PM, reed kotler <rkotler at mips.com> wrote:
>>
>>> I'm getting three failures.
>>>
>>> TEST-FAIL: exec 
>>> /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.expandfft
>>> TEST-RESULT-exec-time: user       0.3200
>>> TEST-RESULT-exec-real-time: real       0.3172
>>>
>>> TEST-FAIL: exec 
>>> /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.stepfft
>>> TEST-RESULT-exec-time: user       0.4000
>>> TEST-RESULT-exec-real-time: real       0.4172
>>> make[4]: Leaving directory 
>>> `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE'
>>>
>>> TEST-FAIL: exec 
>>> /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack/linpack-pc
>>> TEST-RESULT-exec-time: user       164.9400
>>> TEST-RESULT-exec-real-time: real       165.3131
>>> make[3]: Leaving directory 
>>> `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack'
>>> make[3]: Entering directory 
>>> `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/LivermoreLoops
>>> _______________________________________________
>>> LLVM Developers mailing list
>>> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
>