[llvm-testresults] smoosh-01.apple.com nightly tester results

Evan Cheng evan.cheng at apple.com
Tue Jul 21 10:07:11 PDT 2009


And last night's Grue-O0 test result shows this:

LLC compile:
MultiSource/Applications/ClamAV/clamscan: 36.23% (1.7056 => 2.3235)
MultiSource/Applications/JM/ldecod/ldecod: 39.66% (0.9846 => 1.3751)
MultiSource/Applications/JM/lencod/lencod: 44.91% (2.0477 => 2.9673)
MultiSource/Applications/SPASS/SPASS: 26.88% (2.6105 => 3.3121)
MultiSource/Applications/d/make_dparser: 38.56% (0.3646 => 0.5052)
MultiSource/Applications/kimwitu++/kc: 27.08% (3.8236 => 4.8589)
MultiSource/Applications/lua/lua: 30.57% (0.5633 => 0.7355)
MultiSource/Applications/oggenc/oggenc: 40.32% (0.5695 => 0.7991)
MultiSource/Applications/siod/siod: 29.45% (0.3878 => 0.5020)
MultiSource/Applications/sqlite3/sqlite3: 36.53% (1.2424 => 1.6963)
MultiSource/Applications/treecc/treecc: 27.37% (0.4249 => 0.5412)

David, are you planning to fix this soon? Please make sure the compile  
time recovers completely without -asm-verbose. Thanks.

Evan

On Jul 21, 2009, at 12:07 AM, Daniel Dunbar wrote:

> On Mon, Jul 20, 2009 at 10:56 PM, Evan Cheng<evan.cheng at apple.com>  
> wrote:
>> Massive slowdown again? Is this real?
>
> Good question.
>
> Its real in the sense that it isn't noise, as it hasn't changed with
> subsequent commits. The last massive slow down was (somehow) due to
> the nightlytester using an incremental rebuild, but that has been
> fixed.
>
> The build in question is this one:
>  http://smooshlab.apple.com:8010/builders/nnt/builds/234
> There aren't too many changes to LLVM, and the slowdowns are only in
> the compile steps, so it seems like this is almost certainly revision
> 76486:
>  http://llvm.org/viewvc/llvm-project/?view=rev&revision=76486
>
> - Daniel
>
>> Evan
>>
>> On Jul 20, 2009, at 6:12 PM, daniel_dunbar at apple.com wrote:
>>
>>>
>>> Significant Changes in Test Results:
>>> LLC-BETA compile:
>>> MultiSource/Applications/ClamAV/clamscan: 6.08% (7.4785 => 7.9334)
>>> MultiSource/Applications/JM/ldecod/ldecod: 8.01% (3.2697 => 3.5316)
>>> MultiSource/Applications/JM/lencod/lencod: 8.48% (7.1728 => 7.7808)
>>> MultiSource/Applications/SIBsim4/SIBsim4: 7.34% (0.5474 => 0.5876)
>>> MultiSource/Applications/SPASS/SPASS: 6.77% (6.3823 => 6.8146)
>>> MultiSource/Applications/d/make_dparser: 7.62% (1.3929 => 1.4990)
>>> MultiSource/Applications/hbd/hbd: 7.97% (0.4465 => 0.4821)
>>> MultiSource/Applications/hexxagon/hexxagon: 6.71% (0.2547 => 0.2718)
>>> MultiSource/Applications/kimwitu++/kc: 6.00% (7.1432 => 7.5720)
>>> MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.4205 =>  
>>> 0.4455)
>>> MultiSource/Applications/lemon/lemon: 7.15% (0.5942 => 0.6367)
>>> MultiSource/Applications/lua/lua: 7.79% (2.9709 => 3.2023)
>>> MultiSource/Applications/minisat/minisat: 6.80% (0.2484 => 0.2653)
>>> MultiSource/Applications/oggenc/oggenc: 7.99% (1.4045 => 1.5167)
>>> MultiSource/Applications/siod/siod: 5.84% (2.2048 => 2.3335)
>>> MultiSource/Applications/spiff/spiff: 6.36% (0.3239 => 0.3445)
>>> MultiSource/Applications/treecc/treecc: 6.47% (1.5297 => 1.6287)
>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.19% (3.1365 =>
>>> 3.3933)
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.86% (0.3997 =>
>>> 0.4431)
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.25% (0.3614 =>
>>> 0.3876)
>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (2.3810
>>> => 2.5517)
>>> MultiSource/Benchmarks/MallocBench/gs/gs: 8.05% (1.9223 => 2.0771)
>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>> 8.02% (0.2980 => 0.3219)
>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.76%
>>> (1.0021 => 1.0799)
>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.29%
>>> (1.3033 => 1.4114)
>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset:
>>> 7.98% (6.7357 => 7.2730)
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.94%
>>> (0.7739 => 0.8276)
>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.52%
>>> (0.2967 => 0.3190)
>>> MultiSource/Benchmarks/PAQ8p/paq8p: 8.21% (1.0983 => 1.1885)
>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67%
>>> (2.9837 => 3.2125)
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.32% (0.5409 =>
>>> 0.5805)
>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.19% (0.3633
>>> => 0.3858)
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.37% (0.7462 =>
>>> 0.7937)
>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.74% (0.2735 =>
>>> 0.2892)
>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.39% (0.2662
>>> => 0.2832)
>>> MultiSource/Benchmarks/Prolangs-C/football/football: 6.70% (0.5153
>>> => 0.5498)
>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.85% (0.2204 =>
>>> 0.2377)
>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.86% (0.3586
>>> => 0.3868)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69%
>>> (0.2602 => 0.2776)
>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.68% (0.4734
>>> => 0.5050)
>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 6.94% (0.7175 => 0.7673)
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.02% (0.3089 => 0.3306)
>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.2263 =>  
>>> 0.2419)
>>> MultiSource/Benchmarks/mafft/pairlocalalign: 6.56% (1.7913 =>  
>>> 1.9088)
>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.92% (0.2956 =>
>>> 0.3190)
>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.46% (0.8387
>>> => 0.9013)
>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.14%
>>> (0.5748 => 0.6216)
>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.25% (5.4726 =>  
>>> 5.9242)
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.78% (1.6044 =>
>>> 1.7293)
>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>> 5.27% (1.4829 => 1.5610)
>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.35%
>>> (0.9436 => 0.9941)
>>> SingleSource/Benchmarks/Misc-C++/bigfib: 5.94% (0.2139 => 0.2266)
>>> SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.76% (0.2129
>>> => 0.2273)
>>> LLC compile:
>>> MultiSource/Applications/ClamAV/clamscan: 6.91% (6.9863 => 7.4689)
>>> MultiSource/Applications/JM/ldecod/ldecod: 8.80% (2.9918 => 3.2552)
>>> MultiSource/Applications/JM/lencod/lencod: 9.02% (6.5722 => 7.1652)
>>> MultiSource/Applications/SIBsim4/SIBsim4: 7.99% (0.5057 => 0.5461)
>>> MultiSource/Applications/SPASS/SPASS: 7.62% (5.9441 => 6.3973)
>>> MultiSource/Applications/d/make_dparser: 7.97% (1.2928 => 1.3958)
>>> MultiSource/Applications/hbd/hbd: 8.77% (0.4071 => 0.4428)
>>> MultiSource/Applications/hexxagon/hexxagon: 7.61% (0.2340 => 0.2518)
>>> MultiSource/Applications/kimwitu++/kc: 7.12% (6.3361 => 6.7875)
>>> MultiSource/Applications/lambda-0_1_3/lambda: 6.36% (0.3883 =>  
>>> 0.4130)
>>> MultiSource/Applications/lemon/lemon: 6.90% (0.5581 => 0.5966)
>>> MultiSource/Applications/lua/lua: 8.86% (2.7349 => 2.9771)
>>> MultiSource/Applications/minisat/minisat: 8.59% (0.2269 => 0.2464)
>>> MultiSource/Applications/oggenc/oggenc: 9.79% (1.2895 => 1.4158)
>>> MultiSource/Applications/siod/siod: 6.81% (2.0421 => 2.1811)
>>> MultiSource/Applications/spiff/spiff: 7.23% (0.3016 => 0.3234)
>>> MultiSource/Applications/treecc/treecc: 6.99% (1.4200 => 1.5192)
>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.30% (2.8998 =>
>>> 3.1404)
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.60% (0.3468 =>
>>> 0.3905)
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.54% (0.3368 =>
>>> 0.3622)
>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.80% (2.2166
>>> => 2.3895)
>>> MultiSource/Benchmarks/MallocBench/gs/gs: 8.62% (1.7770 => 1.9301)
>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>> 8.41% (0.2736 => 0.2966)
>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.62%
>>> (0.9226 => 1.0021)
>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.08%
>>> (1.1798 => 1.2869)
>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset:
>>> 8.55% (6.1594 => 6.6860)
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.56%
>>> (0.7152 => 0.7693)
>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.77%
>>> (0.2645 => 0.2877)
>>> MultiSource/Benchmarks/PAQ8p/paq8p: 9.02% (0.9480 => 1.0335)
>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.03%
>>> (2.7552 => 2.9764)
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.59% (0.5070 =>
>>> 0.5455)
>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.93% (0.3356
>>> => 0.3622)
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.83% (0.7050 =>
>>> 0.7461)
>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.48% (0.2573 =>
>>> 0.2714)
>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.2502
>>> => 0.2673)
>>> MultiSource/Benchmarks/Prolangs-C/football/football: 7.83% (0.4802
>>> => 0.5178)
>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.49% (0.2013 =>
>>> 0.2184)
>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.46% (0.3296
>>> => 0.3575)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27%
>>> (0.2434 => 0.2611)
>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.91% (0.4444
>>> => 0.4751)
>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 7.62% (0.6691 => 0.7201)
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.42% (0.2886 => 0.3100)
>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.46% (0.2063 =>  
>>> 0.2217)
>>> MultiSource/Benchmarks/mafft/pairlocalalign: 7.33% (1.6698 =>  
>>> 1.7922)
>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.59% (0.2629 =>
>>> 0.2881)
>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.98% (0.7748
>>> => 0.8366)
>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.05%
>>> (0.5265 => 0.5794)
>>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.88% (4.8912 =>  
>>> 5.3257)
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.26% (1.4939 =>
>>> 1.6173)
>>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>>> 6.06% (1.4183 => 1.5042)
>>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.12%
>>> (0.8908 => 0.9453)
>>> _______________________________________________
>>> llvm-testresults mailing list
>>> llvm-testresults at cs.uiuc.edu
>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>
>> _______________________________________________
>> llvm-testresults mailing list
>> llvm-testresults at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>




More information about the llvm-testresults mailing list