[LLVMdev] [llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results
Bob Wilson
bob.wilson at apple.com
Sun Jul 24 16:59:38 PDT 2011
On Jul 24, 2011, at 3:02 AM, Duncan Sands wrote:
> A big compile time regression. Any ideas?
>
> Ciao, Duncan.
False alarm. For some reason that I have not yet been able to figure out, these tests run significantly more slowly when I run them during the daytime, which I did for that run. I checked a few of the worst regressions reported here and they all recovered in subsequent runs.
>
> On 22/07/11 19:13, llvm-testresults at cs.uiuc.edu wrote:
>>
>> bwilson__llvm-gcc_PROD__i386 nightly tester results
>>
>> URL http://llvm.org/perf/db_default/simple/nts/253/
>> Nickname bwilson__llvm-gcc_PROD__i386:4
>> Name curlew.apple.com
>>
>> Run ID Order Start Time End Time
>> Current 253 0 2011-07-22 16:22:04 2011-07-22 17:13:53
>> Previous 252 0 2011-07-20 07:01:59 2011-07-20 07:51:50
>>
>>
>> Tests Summary
>>
>> Status Group #
>> Performance Regressions 88
>> Performance Improvements 1
>> Unchanged Tests 872
>> *Total Tests* *961*
>>
>>
>> Changes Detail
>>
>> Performance Regressions Δ Previous Current σ
>> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk.compile 12.51% 0.7325 0.8241 0.0102
>> SingleSource/UnitTests/ObjC++/property-reference.compile 7.39% 0.9252 0.9936 0.0064
>> SingleSource/UnitTests/ObjC++/Hello.compile 7.33% 0.7822 0.8395 0.0015
>> MultiSource/Benchmarks/VersaBench/dbms/dbms.compile 7.21% 1.1218 1.2027 0.0173
>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo.compile 6.93% 0.8243 0.8814 0.0106
>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell.compile 6.48% 1.7091
>> 1.8199 0.0047
>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac.compile 6.45% 1.0109 1.0761 0.0116
>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000.compile 6.44% 6.6061 7.0314
>> 0.0251
>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame.compile 6.34% 4.5856
>> 4.8764 0.0186
>> MultiSource/Applications/hbd/hbd.compile 6.34% 1.7050 1.8131 0.0110
>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc.compile 6.34%
>> 8.0582 8.5687 0.0539
>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan.compile 6.33%
>> 1.0136 1.0778 0.0021
>> External/SPEC/CINT95/134_perl/134_perl.compile 6.31% 6.3453 6.7457 0.0206
>> External/SPEC/CFP2006/433_milc/433_milc.compile 6.29% 3.6706 3.9015 0.0293
>> External/SPEC/CINT2006/462_libquantum/462_libquantum.compile 6.26% 0.9149
>> 0.9722 0.0070
>> MultiSource/Applications/spiff/spiff.compile 6.25% 0.8954 0.9514 0.0059
>> External/SPEC/CINT2000/175_vpr/175_vpr.compile 6.23% 3.0709 3.2621 0.0103
>> External/skidmarks10/skidmarks.compile 6.20% 1.9730 2.0953 0.0087
>> MultiSource/Applications/SIBsim4/SIBsim4.compile 6.19% 1.2870 1.3667 0.0026
>> External/SPEC/CINT2000/186_crafty/186_crafty.compile 6.19% 4.4605 4.7364 0.0167
>> External/SPEC/CINT95/124_m88ksim/124_m88ksim.compile 6.09% 4.7899 5.0818 0.0451
>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl.compile 6.06% 1.1575 1.2277
>> 0.0090
>> External/SPEC/CINT2000/300_twolf/300_twolf.compile 6.03% 5.9226 6.2799 0.0316
>> External/SPEC/CINT2006/464_h264ref/464_h264ref.compile 6.01% 15.1997 16.1135 0.0271
>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode.compile 6.01%
>> 1.3943 1.4781 0.0062
>> External/SPEC/CFP2000/188_ammp/188_ammp.compile 5.96% 3.1941 3.3844 0.0145
>> External/SPEC/CINT2000/164_gzip/164_gzip.compile 5.95% 1.2469 1.3211 0.0059
>> External/SPEC/CINT2006/458_sjeng/458_sjeng.compile 5.94% 2.6209 2.7767 0.0098
>> MultiSource/Benchmarks/Ptrdist/bc/bc.compile 5.93% 1.1847 1.2550 0.0041
>> External/Nurbs/nurbs.compile 5.90% 1.8470 1.9559 0.0087
>> MultiSource/Applications/lemon/lemon.compile 5.90% 1.0516 1.1136 0.0027
>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset.compile 5.88%
>> 14.2650 15.1031 0.0341
>> External/SPEC/CINT2000/255_vortex/255_vortex.compile 5.87% 9.3345 9.8822 0.0331
>> MultiSource/Benchmarks/MallocBench/gs/gs.compile 5.84% 4.3921 4.6488 0.0275
>> External/SPEC/CINT95/132_ijpeg/132_ijpeg.compile 5.79% 4.8337 5.1137 0.0279
>> External/SPEC/CINT2006/400_perlbench/400_perlbench.compile 5.77% 26.7023
>> 28.2429 0.0181
>> MultiSource/Benchmarks/MallocBench/espresso/espresso.compile 5.76% 4.3083
>> 4.5565 0.0220
>> MultiSource/Applications/ClamAV/clamscan.compile 5.72% 15.6832 16.5806 0.0426
>> External/SPEC/CINT95/147_vortex/147_vortex.compile 5.71% 9.3411 9.8746 0.0273
>> External/SPEC/CINT2006/456_hmmer/456_hmmer.compile 5.70% 7.2198 7.6315 0.0233
>> MultiSource/Benchmarks/Prolangs-C/bison/mybison.compile 5.69% 1.4666 1.5500 0.0065
>> MultiSource/Benchmarks/mafft/pairlocalalign.compile 5.68% 8.3147 8.7866 0.0145
>> External/SPEC/CINT2000/254_gap/254_gap.compile 5.67% 11.7409 12.4065 0.0259
>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep.compile 5.66% 1.2889 1.3618 0.0052
>> External/SPEC/CINT2000/197_parser/197_parser.compile 5.65% 3.0761 3.2498 0.0068
>> External/SPEC/CINT95/126_gcc/126_gcc.compile 5.63% 28.6901 30.3046 0.0488
>> MultiSource/Applications/Burg/burg.compile 5.62% 1.3485 1.4243 0.0081
>> External/SPEC/CINT2000/176_gcc/176_gcc.compile 5.62% 32.4644 34.2887 0.0358
>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg.compile 5.60% 4.6491
>> 4.9096 0.0183
>> External/SPEC/CINT2006/403_gcc/403_gcc.compile 5.60% 75.1560 79.3658 0.1151
>> MultiSource/Applications/d/make_dparser.compile 5.60% 3.0244 3.1938 0.0059
>> External/SPEC/CINT95/130_li/130_li.compile 5.60% 1.6850 1.7793 0.0121
>> SingleSource/Benchmarks/Misc-C++/stepanov_container.compile 5.59% 0.9634 1.0173
>> 0.0025
>> External/SPEC/CINT2000/253_perlbmk/253_perlbmk.compile 5.58% 13.0643 13.7938 0.0156
>> MultiSource/Applications/lua/lua.compile 5.56% 3.9109 4.1285 0.0105
>> External/SPEC/CFP2006/444_namd/444_namd.compile 5.54% 6.8800 7.2614 0.0155
>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg.compile 5.52% 4.5839
>> 4.8371 0.0243
>> MultiSource/Applications/treecc/treecc.compile 5.49% 2.1294 2.2464 0.0057
>> External/SPEC/CINT2006/471_omnetpp/471_omnetpp.compile 5.45% 37.9810 40.0522 0.0756
>> External/Povray/povray.compile 5.45% 15.6471 16.4994 0.0367
>> MultiSource/Applications/JM/lencod/lencod.compile 5.43% 16.6604 17.5654 0.0217
>> MultiSource/Applications/sqlite3/sqlite3.compile 5.39% 13.7047 14.4433 0.0256
>> MultiSource/Applications/oggenc/oggenc.compile 5.32% 5.6388 5.9386 0.0096
>> MultiSource/Applications/SPASS/SPASS.compile 5.19% 14.2322 14.9711 0.0342
>> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile 5.19% 225.5995
>> 237.3023 0.6599
>> External/SPEC/CINT95/099_go/099_go.compile 5.15% 4.8824 5.1339 0.0061
>> MultiSource/Applications/kimwitu++/kc.compile 5.14% 19.5797 20.5852 0.0206
>> MultiSource/Applications/JM/ldecod/ldecod.compile 5.13% 7.1410 7.5074 0.0136
>> External/SPEC/CINT2006/401_bzip2/401_bzip2.compile 5.09% 2.1246 2.2328 0.0027
>> External/SPEC/CINT2006/473_astar/473_astar.compile 5.07% 1.2970 1.3628 0.0028
>> SingleSource/Benchmarks/Adobe-C++/loop_unroll.compile 5.07% 3.2894 3.4561 0.0073
>> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding.compile 4.95%
>> 2.5774 2.7051 0.0062
>> MultiSource/Applications/siod/siod.compile 4.95% 2.2539 2.3655 0.0032
>> SingleSource/Benchmarks/Misc-C++-EH/spirit.compile 4.95% 8.5869 9.0116 0.0067
>> MultiSource/Applications/hexxagon/hexxagon.compile 4.93% 1.3692 1.4367 0.0063
>> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant.compile 4.92%
>> 1.8446 1.9353 0.0034
>> MultiSource/Benchmarks/PAQ8p/paq8p.compile 4.87% 2.1966 2.3036 0.0042
>> MultiSource/Benchmarks/mediabench/gsm/toast/toast.compile 4.83% 1.4938 1.5659 0.0091
>> External/SPEC/CINT2006/445_gobmk/445_gobmk.compile 4.82% 20.0066 20.9703 0.0476
>> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4.compile 4.80% 24.0258 25.1794 0.0370
>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm.compile 4.72% 1.4965
>> 1.5671 0.0087
>> External/SPEC/CINT2000/252_eon/252_eon.compile 4.63% 49.1369 51.4099 0.0933
>> External/SPEC/CFP2006/447_dealII/447_dealII.compile 4.57% 145.5494 152.2079 0.1508
>> MultiSource/Benchmarks/Bullet/bullet.compile 4.49% 46.0510 48.1199 0.0419
>> MultiSource/Benchmarks/Prolangs-C++/city/city.compile 4.44% 2.2055 2.3035 0.0105
>> External/SPEC/CFP2006/450_soplex/450_soplex.compile 3.85% 31.6364 32.8541 0.0750
>> MultiSource/Benchmarks/llubenchmark/llu.exec 1.99% 3.5675 3.6385 0.0213
>> External/SPEC/CFP2000/177_mesa/177_mesa.compile 1.42% 14.8597 15.0713 0.0313
>>
>> Performance Improvements Δ Previous Current σ
>> External/SPEC/CINT2006/400_perlbench/400_perlbench.exec -2.54% 9.5618 9.3186 0.0943
>>
>>
>>
>> _______________________________________________
>> llvm-testresults mailing list
>> llvm-testresults at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
More information about the llvm-dev
mailing list