[llvm-testresults] smoosh-01.apple.com nightly tester results

Tue Jul 21 00:07:22 PDT 2009

On Mon, Jul 20, 2009 at 10:56 PM, Evan Cheng<evan.cheng at apple.com> wrote:
> Massive slowdown again? Is this real?

Good question.

Its real in the sense that it isn't noise, as it hasn't changed with
subsequent commits. The last massive slow down was (somehow) due to
the nightlytester using an incremental rebuild, but that has been
fixed.

The build in question is this one:
  http://smooshlab.apple.com:8010/builders/nnt/builds/234
There aren't too many changes to LLVM, and the slowdowns are only in
the compile steps, so it seems like this is almost certainly revision
76486:
  http://llvm.org/viewvc/llvm-project/?view=rev&revision=76486

 - Daniel

> Evan
>
> On Jul 20, 2009, at 6:12 PM, daniel_dunbar at apple.com wrote:
>
>>
>> Significant Changes in Test Results:
>> LLC-BETA compile:
>> MultiSource/Applications/ClamAV/clamscan: 6.08% (7.4785 => 7.9334)
>> MultiSource/Applications/JM/ldecod/ldecod: 8.01% (3.2697 => 3.5316)
>> MultiSource/Applications/JM/lencod/lencod: 8.48% (7.1728 => 7.7808)
>> MultiSource/Applications/SIBsim4/SIBsim4: 7.34% (0.5474 => 0.5876)
>> MultiSource/Applications/SPASS/SPASS: 6.77% (6.3823 => 6.8146)
>> MultiSource/Applications/d/make_dparser: 7.62% (1.3929 => 1.4990)
>> MultiSource/Applications/hbd/hbd: 7.97% (0.4465 => 0.4821)
>> MultiSource/Applications/hexxagon/hexxagon: 6.71% (0.2547 => 0.2718)
>> MultiSource/Applications/kimwitu++/kc: 6.00% (7.1432 => 7.5720)
>> MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.4205 => 0.4455)
>> MultiSource/Applications/lemon/lemon: 7.15% (0.5942 => 0.6367)
>> MultiSource/Applications/lua/lua: 7.79% (2.9709 => 3.2023)
>> MultiSource/Applications/minisat/minisat: 6.80% (0.2484 => 0.2653)
>> MultiSource/Applications/oggenc/oggenc: 7.99% (1.4045 => 1.5167)
>> MultiSource/Applications/siod/siod: 5.84% (2.2048 => 2.3335)
>> MultiSource/Applications/spiff/spiff: 6.36% (0.3239 => 0.3445)
>> MultiSource/Applications/treecc/treecc: 6.47% (1.5297 => 1.6287)
>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.19% (3.1365 =>
>> 3.3933)
>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.86% (0.3997 =>
>> 0.4431)
>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.25% (0.3614 =>
>> 0.3876)
>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (2.3810
>> => 2.5517)
>> MultiSource/Benchmarks/MallocBench/gs/gs: 8.05% (1.9223 => 2.0771)
>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>> 8.02% (0.2980 => 0.3219)
>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.76%
>> (1.0021 => 1.0799)
>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.29%
>> (1.3033 => 1.4114)
>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset:
>> 7.98% (6.7357 => 7.2730)
>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.94%
>> (0.7739 => 0.8276)
>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.52%
>> (0.2967 => 0.3190)
>> MultiSource/Benchmarks/PAQ8p/paq8p: 8.21% (1.0983 => 1.1885)
>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67%
>> (2.9837 => 3.2125)
>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.32% (0.5409 =>
>> 0.5805)
>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.19% (0.3633
>> => 0.3858)
>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.37% (0.7462 =>
>> 0.7937)
>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.74% (0.2735 =>
>> 0.2892)
>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.39% (0.2662
>> => 0.2832)
>> MultiSource/Benchmarks/Prolangs-C/football/football: 6.70% (0.5153
>> => 0.5498)
>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.85% (0.2204 =>
>> 0.2377)
>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.86% (0.3586
>> => 0.3868)
>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69%
>> (0.2602 => 0.2776)
>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.68% (0.4734
>> => 0.5050)
>> MultiSource/Benchmarks/Ptrdist/bc/bc: 6.94% (0.7175 => 0.7673)
>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.02% (0.3089 => 0.3306)
>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.2263 => 0.2419)
>> MultiSource/Benchmarks/mafft/pairlocalalign: 6.56% (1.7913 => 1.9088)
>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.92% (0.2956 =>
>> 0.3190)
>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.46% (0.8387
>> => 0.9013)
>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.14%
>> (0.5748 => 0.6216)
>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.25% (5.4726 => 5.9242)
>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.78% (1.6044 =>
>> 1.7293)
>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>> 5.27% (1.4829 => 1.5610)
>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.35%
>> (0.9436 => 0.9941)
>> SingleSource/Benchmarks/Misc-C++/bigfib: 5.94% (0.2139 => 0.2266)
>> SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.76% (0.2129
>> => 0.2273)
>> LLC compile:
>> MultiSource/Applications/ClamAV/clamscan: 6.91% (6.9863 => 7.4689)
>> MultiSource/Applications/JM/ldecod/ldecod: 8.80% (2.9918 => 3.2552)
>> MultiSource/Applications/JM/lencod/lencod: 9.02% (6.5722 => 7.1652)
>> MultiSource/Applications/SIBsim4/SIBsim4: 7.99% (0.5057 => 0.5461)
>> MultiSource/Applications/SPASS/SPASS: 7.62% (5.9441 => 6.3973)
>> MultiSource/Applications/d/make_dparser: 7.97% (1.2928 => 1.3958)
>> MultiSource/Applications/hbd/hbd: 8.77% (0.4071 => 0.4428)
>> MultiSource/Applications/hexxagon/hexxagon: 7.61% (0.2340 => 0.2518)
>> MultiSource/Applications/kimwitu++/kc: 7.12% (6.3361 => 6.7875)
>> MultiSource/Applications/lambda-0_1_3/lambda: 6.36% (0.3883 => 0.4130)
>> MultiSource/Applications/lemon/lemon: 6.90% (0.5581 => 0.5966)
>> MultiSource/Applications/lua/lua: 8.86% (2.7349 => 2.9771)
>> MultiSource/Applications/minisat/minisat: 8.59% (0.2269 => 0.2464)
>> MultiSource/Applications/oggenc/oggenc: 9.79% (1.2895 => 1.4158)
>> MultiSource/Applications/siod/siod: 6.81% (2.0421 => 2.1811)
>> MultiSource/Applications/spiff/spiff: 7.23% (0.3016 => 0.3234)
>> MultiSource/Applications/treecc/treecc: 6.99% (1.4200 => 1.5192)
>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.30% (2.8998 =>
>> 3.1404)
>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.60% (0.3468 =>
>> 0.3905)
>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.54% (0.3368 =>
>> 0.3622)
>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.80% (2.2166
>> => 2.3895)
>> MultiSource/Benchmarks/MallocBench/gs/gs: 8.62% (1.7770 => 1.9301)
>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>> 8.41% (0.2736 => 0.2966)
>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.62%
>> (0.9226 => 1.0021)
>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.08%
>> (1.1798 => 1.2869)
>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset:
>> 8.55% (6.1594 => 6.6860)
>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.56%
>> (0.7152 => 0.7693)
>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.77%
>> (0.2645 => 0.2877)
>> MultiSource/Benchmarks/PAQ8p/paq8p: 9.02% (0.9480 => 1.0335)
>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.03%
>> (2.7552 => 2.9764)
>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.59% (0.5070 =>
>> 0.5455)
>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.93% (0.3356
>> => 0.3622)
>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.83% (0.7050 =>
>> 0.7461)
>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.48% (0.2573 =>
>> 0.2714)
>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.2502
>> => 0.2673)
>> MultiSource/Benchmarks/Prolangs-C/football/football: 7.83% (0.4802
>> => 0.5178)
>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.49% (0.2013 =>
>> 0.2184)
>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.46% (0.3296
>> => 0.3575)
>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27%
>> (0.2434 => 0.2611)
>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.91% (0.4444
>> => 0.4751)
>> MultiSource/Benchmarks/Ptrdist/bc/bc: 7.62% (0.6691 => 0.7201)
>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.42% (0.2886 => 0.3100)
>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.46% (0.2063 => 0.2217)
>> MultiSource/Benchmarks/mafft/pairlocalalign: 7.33% (1.6698 => 1.7922)
>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.59% (0.2629 =>
>> 0.2881)
>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.98% (0.7748
>> => 0.8366)
>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.05%
>> (0.5265 => 0.5794)
>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.88% (4.8912 => 5.3257)
>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.26% (1.4939 =>
>> 1.6173)
>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding:
>> 6.06% (1.4183 => 1.5042)
>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.12%
>> (0.8908 => 0.9453)
>> _______________________________________________
>> llvm-testresults mailing list
>> llvm-testresults at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>