[llvm-testresults] smoosh-01.apple.com nightly tester results

Evan Cheng evan.cheng at apple.com
Wed Nov 4 00:38:51 PST 2009 

On Nov 4, 2009, at 12:20 AM, Lang Hames wrote:

> SlotIndex asserts pointer sanity on every access, which will be very  
> expensive. I'll see if I can cut this down.
>
> The hit to LLC time over the whole test suite should be < 2%. A few  
> ~5% outliers wouldn't be surprising, but this is excessive.
>

Thanks. I am seeing < 1% overhead with assertion turned off. So I am  
not too concerned. However, the default build configuration is with  
assertion on so we should turn it down a bit.

Evan

> - Lang.
>
>
> On 04/11/2009, at 12:05 AM, Evan Cheng wrote:
>
>> Hrm. I am not sure if it's Lang's change. With assertion turned, I  
>> see almost no overhead. Lang, do you have expensive checks with  
>> assertion on?
>>
>> Evan
>> On Nov 3, 2009, at 11:39 PM, Evan Cheng wrote:
>>
>>> Lang, can you check? I thought the compile time hit should be < 2%?
>>>
>>> Evan
>>>
>>> On Nov 3, 2009, at 10:21 PM, Daniel Dunbar wrote:
>>>
>>>> Looks like something hit compile time...
>>>>
>>>> - Daniel
>>>>
>>>> On Tue, Nov 3, 2009 at 8:04 PM,  <daniel_dunbar at apple.com> wrote:
>>>>> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/2771/
>>>>> Name:  smoosh-01
>>>>> Nickname: smoosh-01.apple.com:2
>>>>> Buildstatus: OK
>>>>>
>>>>> Run: 2771, Start Time: 2009-11-03 18:27:12
>>>>> Comparing To: 2769, Start Time: 2009-11-03 15:36:16
>>>>>
>>>>> --- Changes Summary ---
>>>>> New Test Passes: 0
>>>>> New Test Failures: 0
>>>>> Added Tests: 0
>>>>> Removed Tests: 0
>>>>> Significant Changes: 56
>>>>>
>>>>> --- Tests Summary ---
>>>>> Total Tests: 3537
>>>>> Total Test Failures: 91
>>>>>
>>>>> Total Test Failures By Type:
>>>>> CBE: 45
>>>>> JIT: 23
>>>>> JIT codegen: 23
>>>>>
>>>>> --- Changes Detail ---
>>>>> New Test Passes:
>>>>>
>>>>> New Test Failures:
>>>>>
>>>>> Added Tests:
>>>>>
>>>>> Removed Tests:
>>>>>
>>>>> Significant Changes in Test Results:
>>>>> JIT codegen:
>>>>> MultiSource/Applications/ClamAV/clamscan: 7.50% (4.7214 => 5.0754)
>>>>> MultiSource/Applications/JM/lencod/lencod: 5.87% (6.6143 =>  
>>>>> 7.0025)
>>>>> MultiSource/Applications/SPASS/SPASS: 5.01% (7.1128 => 7.4689)
>>>>> MultiSource/Applications/kimwitu++/kc: 5.47% (11.9269 => 12.5795)
>>>>> MultiSource/Applications/siod/siod: 8.78% (0.9397 => 1.0222)
>>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (2.4029
>>>>> => 2.5430)
>>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.15%
>>>>> (1.6756 => 1.7619)
>>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.92%
>>>>> (0.2588 => 0.2767)
>>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.96%
>>>>> (0.6403 => 0.6977)
>>>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.31%
>>>>> (0.3991 => 0.4203)
>>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.29% (0.9474 =>
>>>>> 1.0449)
>>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.30%
>>>>> (0.2856 => 0.3036)
>>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.01% (0.2331 =>
>>>>> 0.2471)
>>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 7.59% (0.9722 =>
>>>>> 1.0460)
>>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.82% (5.4110 =>
>>>>> 5.7258)
>>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>>> 9.62% (1.9577 => 2.1460)
>>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant:
>>>>> 8.44% (1.1080 => 1.2015)
>>>>> LLC-BETA:
>>>>> SingleSource/Benchmarks/Dhrystone/dry: -7.14% (1.4000 => 1.3000)
>>>>> LLC compile:
>>>>> MultiSource/Applications/ClamAV/clamscan: 6.17% (8.5640 => 9.0925)
>>>>> MultiSource/Applications/JM/lencod/lencod: 5.11% (7.9122 =>  
>>>>> 8.3167)
>>>>> MultiSource/Applications/lemon/lemon: 5.80% (0.6702 => 0.7091)
>>>>> MultiSource/Applications/siod/siod: 5.36% (2.2838 => 2.4063)
>>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (3.0572
>>>>> => 3.2505)
>>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.03%
>>>>> (2.3926 => 2.5130)
>>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>>>> 5.60% (0.3090 => 0.3263)
>>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60%
>>>>> (3.3864 => 3.5759)
>>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.35% (0.9403 =>
>>>>> 1.0376)
>>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01%
>>>>> (0.3135 => 0.3292)
>>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.2340 =>
>>>>> 0.2472)
>>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (2.0192 =>
>>>>> 2.1348)
>>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.21% (5.7198 =>
>>>>> 6.0178)
>>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>>> 9.23% (1.9367 => 2.1155)
>>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant:
>>>>> 8.25% (1.0970 => 1.1875)
>>>>> JIT:
>>>>> MultiSource/Applications/ClamAV/clamscan: 6.68% (5.2400 => 5.5900)
>>>>> MultiSource/Applications/hbd/hbd: 6.67% (0.4500 => 0.4800)
>>>>> MultiSource/Applications/kimwitu++/kc: 5.30% (12.6300 => 13.3000)
>>>>> MultiSource/Applications/lemon/lemon: 5.51% (183.8700 => 194.0100)
>>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.14%
>>>>> (0.2800 => 0.3000)
>>>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.88% (0.3400 =>
>>>>> 0.3600)
>>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.35%
>>>>> (0.6800 => 0.7300)
>>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.00% (1.0000 =>
>>>>> 1.1000)
>>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.03% (6.5600 =>
>>>>> 6.8900)
>>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>>> 5.42% (3.3200 => 3.5000)
>>>>> LLC:
>>>>> SingleSource/Benchmarks/Dhrystone/dry: 6.45% (1.2400 => 1.3200)
>>>>> LLC-BETA compile:
>>>>> MultiSource/Applications/ClamAV/clamscan: 6.39% (8.5963 => 9.1452)
>>>>> MultiSource/Applications/lemon/lemon: 5.39% (0.6751 => 0.7115)
>>>>> MultiSource/Applications/siod/siod: 5.11% (2.2946 => 2.4119)
>>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.04% (3.0674
>>>>> => 3.2526)
>>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>>>> 5.86% (0.3087 => 0.3268)
>>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.61%
>>>>> (3.4026 => 3.5936)
>>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.05% (0.9430 =>
>>>>> 1.0378)
>>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.17% (0.2361 =>
>>>>> 0.2483)
>>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (2.0285 =>
>>>>> 2.1511)
>>>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.19% (5.7841 =>
>>>>> 6.0845)
>>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>>>> 9.87% (1.9324 => 2.1232)
>>>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant:
>>>>> 7.66% (1.1011 => 1.1854)
>>>>> _______________________________________________
>>>>> llvm-testresults mailing list
>>>>> llvm-testresults at cs.uiuc.edu
>>>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>>>>
>>>
>>> _______________________________________________
>>> llvm-testresults mailing list
>>> llvm-testresults at cs.uiuc.edu
>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>
>

More information about the llvm-testresults mailing list