[llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results

Bob Wilson bob.wilson at apple.com
Mon Jan 3 12:58:11 PST 2011 

Ignore the compile-time regressions, for now anyway -- it's daytime.  I  turned off all the things Daniel had suggested turning off, but things still run more slowly during the day.

The 13.98% regression for SingleSource/Benchmarks/McGill/chomp is potentially real.  I'll watch and see if it goes away tomorrow.

On Jan 3, 2011, at 12:48 PM, llvm-testresults at cs.uiuc.edu wrote:

> bwilson__llvm-gcc_PROD__i386 nightly tester results
> 
> URL	http://llvm.org/perf/db_default/simple/nts/65/
> Nickname	bwilson__llvm-gcc_PROD__i386:1
> Name	curlew.apple.com
> Run	ID	Order	Start Time	End Time
> Current	65	122765	2011-01-03 20:05:21	2011-01-03 20:51:12
> Previous	64	122742	2011-01-03 07:59:23	2011-01-03 08:43:17
> 
> Tests Summary
> 
> Status Group	#
> Performance Regressions	95
> Performance Improvements	4
> Existing Failures	2
> Unchanged Tests	846
> Total Tests	947
> 
> Changes Detail
> 
> Performance Regressions	Δ	Previous	Current	σ
> MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish.compile	18.75%	0.3200	0.3800	0.0049
> SingleSource/Benchmarks/McGill/chomp.exec	13.98%	0.9300	1.0600	0.0000
> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail.compile	11.29%	0.6200	0.6900	0.0000
> MultiSource/Benchmarks/PAQ8p/paq8p.compile	11.01%	2.2700	2.5200	0.0320
> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan.compile	10.38%	1.0600	1.1700	0.0136
> SingleSource/Benchmarks/Adobe-C++/loop_unroll.compile	10.28%	3.6000	3.9700	0.0303
> External/SPEC/CINT2000/164_gzip/164_gzip.compile	10.24%	1.2700	1.4000	0.0160
> MultiSource/Benchmarks/mediabench/gsm/toast/toast.compile	9.93%	1.4100	1.5500	0.0280
> External/SPEC/CINT2000/186_crafty/186_crafty.compile	9.61%	4.3700	4.7900	0.0405
> MultiSource/Benchmarks/FreeBench/pifft/pifft.compile	9.47%	0.9500	1.0400	0.0160
> External/Nurbs/nurbs.compile	9.34%	1.8200	1.9900	0.0117
> MultiSource/Benchmarks/Prolangs-C/agrep/agrep.compile	9.16%	1.3100	1.4300	0.0040
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm.compile	9.15%	1.4200	1.5500	0.0240
> MultiSource/Applications/treecc/treecc.compile	9.09%	2.2000	2.4000	0.0248
> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl.compile	9.01%	1.1100	1.2100	0.0000
> External/SPEC/CINT2000/256_bzip2/256_bzip2.compile	8.86%	0.7900	0.8600	0.0040
> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2.compile	8.75%	0.8000	0.8700	0.0080
> MultiSource/Benchmarks/MallocBench/espresso/espresso.compile	8.69%	4.4900	4.8800	0.0194
> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode.compile	8.63%	1.3900	1.5100	0.0040
> MultiSource/Applications/lemon/lemon.compile	8.62%	1.1600	1.2600	0.0040
> SingleSource/Benchmarks/Misc-C++-EH/spirit.compile	8.53%	7.9700	8.6500	0.0531
> MultiSource/Applications/sqlite3/sqlite3.compile	8.41%	14.1500	15.3400	0.1285
> MultiSource/Applications/lua/lua.compile	8.40%	4.0500	4.3900	0.0240
> External/SPEC/CINT2000/254_gap/254_gap.compile	8.39%	12.2700	13.3000	0.1307
> External/SPEC/CINT2000/300_twolf/300_twolf.compile	8.36%	5.8600	6.3500	0.0160
> MultiSource/Benchmarks/Prolangs-C/football/football.compile	8.33%	0.9600	1.0400	0.0136
> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset.compile	8.33%	13.5700	14.7000	0.1301
> MultiSource/Applications/lambda-0_1_3/lambda.compile	8.24%	0.8500	0.9200	0.0040
> MultiSource/Applications/ClamAV/clamscan.compile	8.23%	16.2800	17.6200	0.1116
> MultiSource/Applications/SIBsim4/SIBsim4.compile	8.15%	1.3500	1.4600	0.0160
> MultiSource/Applications/minisat/minisat.compile	8.11%	0.7400	0.8000	0.0040
> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo.compile	8.11%	0.7400	0.8000	0.0075
> External/SPEC/CINT2006/401_bzip2/401_bzip2.compile	8.02%	2.1200	2.2900	0.0160
> MultiSource/Benchmarks/VersaBench/dbms/dbms.compile	8.00%	1.0000	1.0800	0.0000
> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg.compile	7.99%	4.6300	5.0000	0.0240
> MultiSource/Benchmarks/MallocBench/gs/gs.compile	7.95%	4.4000	4.7500	0.0040
> External/SPEC/CINT95/132_ijpeg/132_ijpeg.compile	7.93%	4.7900	5.1700	0.0271
> External/SPEC/CINT95/126_gcc/126_gcc.compile	7.89%	29.2900	31.6000	0.3005
> MultiSource/Applications/hbd/hbd.compile	7.88%	1.6500	1.7800	0.0174
> MultiSource/Benchmarks/Ptrdist/bc/bc.compile	7.81%	1.2800	1.3800	0.0098
> External/SPEC/CINT2000/176_gcc/176_gcc.compile	7.80%	33.2000	35.7900	0.3726
> External/SPEC/CINT2000/197_parser/197_parser.compile	7.76%	3.2200	3.4700	0.0126
> MultiSource/Applications/d/make_dparser.compile	7.74%	3.1000	3.3400	0.0287
> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant.compile	7.73%	1.9400	2.0900	0.0080
> External/SPEC/CINT2006/403_gcc/403_gcc.compile	7.70%	78.5800	84.6300	0.8162
> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg.compile	7.69%	4.5500	4.9000	0.0264
> External/SPEC/CINT95/099_go/099_go.compile	7.63%	5.1100	5.5000	0.0273
> MultiSource/Applications/JM/lencod/lencod.compile	7.59%	16.8700	18.1500	0.0926
> External/SPEC/CINT95/134_perl/134_perl.compile	7.52%	6.3800	6.8600	0.0480
> External/SPEC/CFP2006/433_milc/433_milc.compile	7.52%	3.5900	3.8600	0.0120
> MultiSource/Applications/siod/siod.compile	7.50%	2.4000	2.5800	0.0102
> MultiSource/Benchmarks/Prolangs-C/simulator/simulator.compile	7.50%	0.8000	0.8600	0.0040
> External/SPEC/CINT2006/458_sjeng/458_sjeng.compile	7.49%	2.6700	2.8700	0.0174
> MultiSource/Applications/JM/ldecod/ldecod.compile	7.46%	7.2400	7.7800	0.0542
> MultiSource/Benchmarks/Prolangs-C/bison/mybison.compile	7.38%	1.4900	1.6000	0.0040
> MultiSource/Benchmarks/MallocBench/cfrac/cfrac.compile	7.37%	0.9500	1.0200	0.0040
> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding.compile	7.37%	2.8500	3.0600	0.0117
> External/SPEC/CINT2006/464_h264ref/464_h264ref.compile	7.25%	15.5900	16.7200	0.1936
> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame.compile	7.24%	4.5600	4.8900	0.0200
> MultiSource/Applications/oggenc/oggenc.compile	7.22%	5.8200	6.2400	0.0248
> External/SPEC/CINT2000/253_perlbmk/253_perlbmk.compile	7.15%	13.7000	14.6800	0.1040
> MultiSource/Applications/SPASS/SPASS.compile	7.15%	14.8200	15.8800	0.1139
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4.compile	7.12%	22.7500	24.3700	0.1194
> SingleSource/Benchmarks/Misc-C++/stepanov_container.compile	7.07%	0.9900	1.0600	0.0040
> External/SPEC/CINT2006/400_perlbench/400_perlbench.compile	7.05%	27.6700	29.6200	0.2104
> External/Povray/povray.compile	6.99%	15.8900	17.0000	0.0662
> External/SPEC/CFP2006/444_namd/444_namd.compile	6.96%	6.7500	7.2200	0.0793
> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc.compile	6.95%	7.9100	8.4600	0.0326
> External/SPEC/CINT2006/473_astar/473_astar.compile	6.92%	1.3000	1.3900	0.0000
> MultiSource/Applications/Burg/burg.compile	6.77%	1.3300	1.4200	0.0063
> MultiSource/Benchmarks/mafft/pairlocalalign.compile	6.68%	8.6800	9.2600	0.0520
> External/SPEC/CINT95/147_vortex/147_vortex.compile	6.67%	9.6000	10.2400	0.0248
> External/SPEC/CINT2000/175_vpr/175_vpr.compile	6.67%	3.1500	3.3600	0.0200
> External/SPEC/CINT2006/462_libquantum/462_libquantum.compile	6.67%	0.9000	0.9600	0.0000
> External/SPEC/CINT2006/456_hmmer/456_hmmer.compile	6.59%	7.4300	7.9200	0.0492
> External/skidmarks10/skidmarks.compile	6.53%	1.9900	2.1200	0.0063
> External/SPEC/CINT95/124_m88ksim/124_m88ksim.compile	6.52%	4.6000	4.9000	0.0185
> External/SPEC/CINT2000/255_vortex/255_vortex.compile	6.45%	9.6100	10.2300	0.0223
> External/SPEC/CINT95/130_li/130_li.compile	6.43%	1.7100	1.8200	0.0049
> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell.compile	6.40%	1.7200	1.8300	0.0000
> External/SPEC/CINT2006/445_gobmk/445_gobmk.compile	6.22%	20.4100	21.6800	0.0776
> External/SPEC/CFP2006/447_dealII/447_dealII.compile	6.21%	148.2200	157.4200	1.1367
> MultiSource/Applications/kimwitu++/kc.compile	5.89%	20.1900	21.3800	0.0919
> MultiSource/Benchmarks/Bullet/bullet.compile	5.38%	46.1100	48.5900	0.3583
> External/SPEC/CFP2000/177_mesa/177_mesa.compile	5.26%	12.7300	13.4000	0.1368
> MultiSource/Applications/hexxagon/hexxagon.compile	5.07%	1.3800	1.4500	0.0080
> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile	4.70%	231.5600	242.4400	0.5263
> External/SPEC/CINT2006/471_omnetpp/471_omnetpp.compile	3.76%	38.0200	39.4500	0.0454
> External/SPEC/CFP2006/450_soplex/450_soplex.compile	3.64%	31.5800	32.7300	0.0496
> External/SPEC/CINT2000/252_eon/252_eon.compile	3.10%	49.6900	51.2300	0.0427
> MultiSource/Benchmarks/Prolangs-C++/city/city.compile	2.68%	2.2400	2.3000	0.0000
> MultiSource/Benchmarks/NPB-serial/is/is.exec	2.31%	9.9600	10.1900	0.0224
> MultiSource/Applications/sqlite3/sqlite3.exec	2.21%	4.9800	5.0900	0.0160
> MultiSource/Applications/lua/lua.exec	1.64%	30.5600	31.0600	0.0242
> External/SPEC/CINT2006/464_h264ref/464_h264ref.exec	1.34%	26.9500	27.3100	0.0691
> 
> Performance Improvements	Δ	Previous	Current	σ
> SingleSource/Benchmarks/Misc/richards_benchmark.exec	-14.97%	1.6700	1.4200	0.0560
> SingleSource/Benchmarks/Shootout/methcall.exec	-7.32%	5.6000	5.1900	0.0223
> SingleSource/Benchmarks/Shootout-C++/objinst.exec	-3.33%	10.8000	10.4400	0.0049
> External/SPEC/CINT2000/253_perlbmk/253_perlbmk.exec	-1.41%	9.2400	9.1100	0.0240
> 
> Existing Failures
> External/SPEC/CINT2000/164_gzip/164_gzip.exec
> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.exec
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20110103/d6513776/attachment.html>

More information about the llvm-testresults mailing list