[LLVMdev] failures in test-suite for make TEST=simple

[Reed Kotler]

Is "simple" pretty comprehensive?

What is the largest test I can run from linux ?

On 12/12/2012 09:21 PM, Nadav Rotem wrote:
> I use the 'make TEST=simple' as a pre-commit test. I think that everybody should run these tests before committing to LLVM.
>
> On Dec 12, 2012, at 5:06 PM, reed kotler <rkotler at mips.com> wrote:
>
>> when I create the report, there are no failures in it. so maybe these are being filtered for known failures.
>>
>> On 12/12/2012 05:03 PM, reed kotler wrote:
>>> The first one failed on a diff:
>>> ******************** TEST (simple) 'sse.expandfft' FAILED! ********************
>>> Execution Context Diff:
>>> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07
>>> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02
>>> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00
>>> ******************** TEST (simple) 'sse.expandfft' ****************************
>>>
>>> The second one too.
>>>
>>> /llvmpb3/build/projects/test-suite/tools/fpcmp  -r 0.016" simple sse.stepfft
>>> ******************** TEST (simple) 'sse.stepfft' FAILED! ********************
>>> Execution Context Diff:
>>> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 1.139094e-07 and 1.159249e-07
>>> abs. diff = 2.015500e-09 rel.diff = 1.738626e-02
>>> Out of tolerance: rel/abs: 1.600000e-02/0.000000e+00
>>> ******************** TEST (simple) 'sse.stepfft' ****************************
>>>
>>> The third also.
>>>
>>> /home/rkotler/workspace/llvmpb3/projects/test-suite/DiffOutput.sh "/home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp  -r 0.0001" simple linpack-pc
>>> ******************** TEST (simple) 'linpack-pc' FAILED! ********************
>>> Execution Context Diff:
>>> /home/rkotler/llvmpb3/build/projects/test-suite/tools/fpcmp: Compared: 4.500000e+01 and 0.000000e+00
>>> abs. diff = 4.500000e+01 rel.diff = 1.000000e+00
>>> Out of tolerance: rel/abs: 1.000000e-04/0.000000e+00
>>> ******************** TEST (simple) 'linpack-pc' ****************************
>>>
>>> The change that I'm testing would cause massive breakage if it were wrong since it is touching fundamental classes. I don't think there is any chance that my change is causing this.
>>>
>>> On 12/12/2012 04:06 PM, Nadav Rotem wrote:
>>>> I forgot to mention that you can also run "make TEST=simple report" which will generate a nice report.
>>>>
>>>> Do you know why these tests fail ? You can step into the test directory and run 'make TEST=simple' from there. It will save you some time.
>>>>
>>>> On Dec 12, 2012, at 4:04 PM, reed kotler <rkotler at mips.com> wrote:
>>>>
>>>>> I'm getting three failures.
>>>>>
>>>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.expandfft
>>>>> TEST-RESULT-exec-time: user       0.3200
>>>>> TEST-RESULT-exec-real-time: real       0.3172
>>>>>
>>>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE/sse.stepfft
>>>>> TEST-RESULT-exec-time: user       0.4000
>>>>> TEST-RESULT-exec-real-time: real       0.4172
>>>>> make[4]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/UnitTests/Vector/SSE'
>>>>>
>>>>> TEST-FAIL: exec /home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack/linpack-pc
>>>>> TEST-RESULT-exec-time: user       164.9400
>>>>> TEST-RESULT-exec-real-time: real       165.3131
>>>>> make[3]: Leaving directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/Linpack'
>>>>> make[3]: Entering directory `/home/rkotler/llvmpb3/build/projects/test-suite/SingleSource/Benchmarks/LivermoreLoops
>>>>> _______________________________________________
>>>>> LLVM Developers mailing list
>>>>> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
>>>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev