[llvm-testresults] smoosh-01.apple.com nightly tester results

Wed Nov 4 00:20:31 PST 2009

SlotIndex asserts pointer sanity on every access, which will be very  
expensive. I'll see if I can cut this down.

The hit to LLC time over the whole test suite should be < 2%. A few  
~5% outliers wouldn't be surprising, but this is excessive.

- Lang.

On 04/11/2009, at 12:05 AM, Evan Cheng wrote:

> Hrm. I am not sure if it's Lang's change. With assertion turned, I  
> see almost no overhead. Lang, do you have expensive checks with  
> assertion on?
>
> Evan
> On Nov 3, 2009, at 11:39 PM, Evan Cheng wrote:
>
>> Lang, can you check? I thought the compile time hit should be < 2%?
>>
>> Evan
>>
>> On Nov 3, 2009, at 10:21 PM, Daniel Dunbar wrote:
>>
>>> Looks like something hit compile time...
>>>
>>> - Daniel
>>>
>>> On Tue, Nov 3, 2009 at 8:04 PM,  <daniel_dunbar at apple.com> wrote:
>>>> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/ 
>>>> 2771/
>>>> Name:  smoosh-01
>>>> Nickname: smoosh-01.apple.com:2
>>>> Buildstatus: OK
>>>>
>>>> Run: 2771, Start Time: 2009-11-03 18:27:12
>>>> Comparing To: 2769, Start Time: 2009-11-03 15:36:16
>>>>
>>>> --- Changes Summary ---
>>>> New Test Passes: 0
>>>> New Test Failures: 0
>>>> Added Tests: 0
>>>> Removed Tests: 0
>>>> Significant Changes: 56
>>>>
>>>> --- Tests Summary ---
>>>> Total Tests: 3537
>>>> Total Test Failures: 91
>>>>
>>>> Total Test Failures By Type:
>>>> CBE: 45
>>>> JIT: 23
>>>> JIT codegen: 23
>>>>
>>>> --- Changes Detail ---
>>>> New Test Passes:
>>>>
>>>> New Test Failures:
>>>>
>>>> Added Tests:
>>>>
>>>> Removed Tests:
>>>>
>>>> Significant Changes in Test Results:
>>>> JIT codegen:
>>>> MultiSource/Applications/ClamAV/clamscan: 7.50% (4.7214 => 5.0754)
>>>> MultiSource/Applications/JM/lencod/lencod: 5.87% (6.6143 => 7.0025)
>>>> MultiSource/Applications/SPASS/SPASS: 5.01% (7.1128 => 7.4689)
>>>> MultiSource/Applications/kimwitu++/kc: 5.47% (11.9269 => 12.5795)
>>>> MultiSource/Applications/siod/siod: 8.78% (0.9397 => 1.0222)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (2.4029
>>>> => 2.5430)
>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.15%
>>>> (1.6756 => 1.7619)
>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.92%
>>>> (0.2588 => 0.2767)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.96%
>>>> (0.6403 => 0.6977)
>>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.31%
>>>> (0.3991 => 0.4203)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.29% (0.9474 =>
>>>> 1.0449)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.30%
>>>> (0.2856 => 0.3036)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.01% (0.2331 =>
>>>> 0.2471)
>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 7.59% (0.9722 =>
>>>> 1.0460)
>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.82% (5.4110 =>
>>>> 5.7258)
>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>> 9.62% (1.9577 => 2.1460)
>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant:
>>>> 8.44% (1.1080 => 1.2015)
>>>> LLC-BETA:
>>>> SingleSource/Benchmarks/Dhrystone/dry: -7.14% (1.4000 => 1.3000)
>>>> LLC compile:
>>>> MultiSource/Applications/ClamAV/clamscan: 6.17% (8.5640 => 9.0925)
>>>> MultiSource/Applications/JM/lencod/lencod: 5.11% (7.9122 => 8.3167)
>>>> MultiSource/Applications/lemon/lemon: 5.80% (0.6702 => 0.7091)
>>>> MultiSource/Applications/siod/siod: 5.36% (2.2838 => 2.4063)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (3.0572
>>>> => 3.2505)
>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.03%
>>>> (2.3926 => 2.5130)
>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>>> 5.60% (0.3090 => 0.3263)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60%
>>>> (3.3864 => 3.5759)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.35% (0.9403 =>
>>>> 1.0376)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01%
>>>> (0.3135 => 0.3292)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.2340 =>
>>>> 0.2472)
>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (2.0192 =>
>>>> 2.1348)
>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.21% (5.7198 =>
>>>> 6.0178)
>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>> 9.23% (1.9367 => 2.1155)
>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant:
>>>> 8.25% (1.0970 => 1.1875)
>>>> JIT:
>>>> MultiSource/Applications/ClamAV/clamscan: 6.68% (5.2400 => 5.5900)
>>>> MultiSource/Applications/hbd/hbd: 6.67% (0.4500 => 0.4800)
>>>> MultiSource/Applications/kimwitu++/kc: 5.30% (12.6300 => 13.3000)
>>>> MultiSource/Applications/lemon/lemon: 5.51% (183.8700 => 194.0100)
>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.14%
>>>> (0.2800 => 0.3000)
>>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.88% (0.3400 =>
>>>> 0.3600)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.35%
>>>> (0.6800 => 0.7300)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.00% (1.0000 =>
>>>> 1.1000)
>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.03% (6.5600 =>
>>>> 6.8900)
>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>> 5.42% (3.3200 => 3.5000)
>>>> LLC:
>>>> SingleSource/Benchmarks/Dhrystone/dry: 6.45% (1.2400 => 1.3200)
>>>> LLC-BETA compile:
>>>> MultiSource/Applications/ClamAV/clamscan: 6.39% (8.5963 => 9.1452)
>>>> MultiSource/Applications/lemon/lemon: 5.39% (0.6751 => 0.7115)
>>>> MultiSource/Applications/siod/siod: 5.11% (2.2946 => 2.4119)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.04% (3.0674
>>>> => 3.2526)
>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>>> 5.86% (0.3087 => 0.3268)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.61%
>>>> (3.4026 => 3.5936)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.05% (0.9430 =>
>>>> 1.0378)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.17% (0.2361 =>
>>>> 0.2483)
>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (2.0285 =>
>>>> 2.1511)
>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.19% (5.7841 =>
>>>> 6.0845)
>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>> 9.87% (1.9324 => 2.1232)
>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant:
>>>> 7.66% (1.1011 => 1.1854)
>>>> _______________________________________________
>>>> llvm-testresults mailing list
>>>> llvm-testresults at cs.uiuc.edu
>>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>>>
>>
>> _______________________________________________
>> llvm-testresults mailing list
>> llvm-testresults at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>