[llvm-testresults] bwilson__llvm-gcc_PROD__i386 nightly tester results

Bob Wilson bob.wilson at apple.com
Fri May 6 09:28:05 PDT 2011


Tracking radar for the nsieve-bits regression:
<rdar://problem/9396858> [regression] 20% slowdown on nsieve-bits for i386 llvm-gcc tester

The compile-time regressions disappeared in the next run.

On May 5, 2011, at 12:37 AM, llvm-testresults at cs.uiuc.edu wrote:

> bwilson__llvm-gcc_PROD__i386 nightly tester results
> 
> URL	http://llvm.org/perf/db_default/simple/nts/182/
> Nickname	bwilson__llvm-gcc_PROD__i386:3
> Name	curlew.apple.com
> Run	ID	Order	Start Time	End Time
> Current	182	0	2011-05-05 06:57:55	2011-05-05 07:42:04
> Previous	181	0	2011-05-03 06:58:27	2011-05-03 07:41:58
> 
> Tests Summary
> 
> Status Group	#
> Performance Regressions	82
> Performance Improvements	1
> Added Tests	4
> Unchanged Tests	878
> Total Tests	965
> 
> Changes Detail
> 
> Performance Regressions	Δ	Previous	Current	σ
> SingleSource/Benchmarks/BenchmarkGame/nsieve-bits.exec	19.72%	0.7542	0.9029	0.0297
> SingleSource/UnitTests/ObjC++/Hello.compile	6.71%	0.7925	0.8457	0.0085
> External/SPEC/CINT2006/464_h264ref/464_h264ref.compile	6.29%	14.9375	15.8772	0.2471
> SingleSource/UnitTests/ObjC++/property-reference.compile	6.17%	0.9356	0.9933	0.0099
> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame.compile	6.11%	4.6862	4.9725	0.0708
> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan.compile	5.95%	1.0367	1.0984	0.0170
> MultiSource/Applications/JM/lencod/lencod.compile	5.94%	16.3274	17.2979	0.2617
> MultiSource/Applications/lemon/lemon.compile	5.92%	1.0606	1.1234	0.0152
> MultiSource/Applications/SIBsim4/SIBsim4.compile	5.91%	1.3082	1.3855	0.0205
> External/SPEC/CINT2006/400_perlbench/400_perlbench.compile	5.84%	26.9293	28.5018	0.3685
> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell.compile	5.80%	1.7105	1.8097	0.0209
> External/SPEC/CINT95/126_gcc/126_gcc.compile	5.77%	28.8852	30.5514	0.3979
> External/SPEC/CINT95/134_perl/134_perl.compile	5.73%	6.4314	6.7999	0.0842
> External/SPEC/CINT2000/176_gcc/176_gcc.compile	5.72%	32.6112	34.4770	0.4507
> MultiSource/Benchmarks/FreeBench/pifft/pifft.compile	5.66%	0.9420	0.9953	0.0153
> MultiSource/Applications/JM/ldecod/ldecod.compile	5.64%	7.0212	7.4172	0.1040
> External/SPEC/CINT2000/254_gap/254_gap.compile	5.63%	11.9860	12.6606	0.1814
> External/SPEC/CINT2006/401_bzip2/401_bzip2.compile	5.62%	2.0918	2.2093	0.0306
> MultiSource/Benchmarks/mafft/pairlocalalign.compile	5.61%	8.5200	8.9978	0.1184
> External/SPEC/CINT2000/186_crafty/186_crafty.compile	5.60%	4.5323	4.7862	0.0618
> External/SPEC/CFP2006/444_namd/444_namd.compile	5.57%	6.7645	7.1413	0.0970
> SingleSource/Benchmarks/Adobe-C++/loop_unroll.compile	5.50%	3.3744	3.5600	0.0383
> External/SPEC/CINT2006/403_gcc/403_gcc.compile	5.49%	75.7625	79.9193	1.1657
> External/SPEC/CINT2000/164_gzip/164_gzip.compile	5.47%	1.2810	1.3511	0.0174
> MultiSource/Benchmarks/Ptrdist/bc/bc.compile	5.40%	1.2141	1.2797	0.0174
> External/SPEC/CINT2000/253_perlbmk/253_perlbmk.compile	5.40%	13.2419	13.9568	0.1896
> External/SPEC/CINT2000/197_parser/197_parser.compile	5.39%	3.1367	3.3059	0.0477
> External/SPEC/CINT95/099_go/099_go.compile	5.37%	4.9601	5.2265	0.0713
> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg.compile	5.36%	4.6660	4.9162	0.0597
> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg.compile	5.36%	4.7329	4.9864	0.0598
> MultiSource/Applications/SPASS/SPASS.compile	5.34%	14.4743	15.2478	0.1887
> MultiSource/Applications/sqlite3/sqlite3.compile	5.34%	13.6869	14.4175	0.1778
> MultiSource/Applications/d/make_dparser.compile	5.31%	3.0291	3.1899	0.0375
> MultiSource/Applications/ClamAV/clamscan.compile	5.31%	15.9169	16.7616	0.1988
> MultiSource/Applications/lua/lua.compile	5.29%	3.9946	4.2060	0.0598
> MultiSource/Benchmarks/Prolangs-C/agrep/agrep.compile	5.29%	1.3279	1.3981	0.0180
> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode.compile	5.24%	1.4229	1.4974	0.0189
> External/SPEC/CINT95/132_ijpeg/132_ijpeg.compile	5.23%	4.9388	5.1973	0.0643
> External/SPEC/CINT2006/458_sjeng/458_sjeng.compile	5.23%	2.6769	2.8170	0.0328
> External/SPEC/CINT2000/175_vpr/175_vpr.compile	5.21%	3.1441	3.3078	0.0399
> External/SPEC/CINT2006/473_astar/473_astar.compile	5.20%	1.3007	1.3683	0.0155
> External/SPEC/CINT2006/456_hmmer/456_hmmer.compile	5.17%	7.3451	7.7248	0.1021
> External/Nurbs/nurbs.compile	5.16%	1.8858	1.9831	0.0201
> MultiSource/Benchmarks/Prolangs-C/bison/mybison.compile	5.12%	1.5085	1.5858	0.0200
> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant.compile	5.12%	1.8826	1.9789	0.0206
> External/SPEC/CINT95/147_vortex/147_vortex.compile	5.11%	9.5370	10.0248	0.1279
> External/SPEC/CINT2000/300_twolf/300_twolf.compile	5.11%	6.0261	6.3339	0.0775
> External/skidmarks10/skidmarks.compile	5.10%	2.0277	2.1312	0.0245
> External/SPEC/CINT2000/255_vortex/255_vortex.compile	5.08%	9.5394	10.0244	0.1306
> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset.compile	5.07%	13.3234	13.9987	0.1394
> External/Povray/povray.compile	5.03%	15.7591	16.5512	0.2005
> MultiSource/Benchmarks/MallocBench/gs/gs.compile	5.02%	4.4554	4.6789	0.0529
> MultiSource/Benchmarks/MallocBench/espresso/espresso.compile	5.01%	4.4098	4.6308	0.0611
> MultiSource/Benchmarks/PAQ8p/paq8p.compile	5.01%	2.2020	2.3123	0.0342
> MultiSource/Applications/hbd/hbd.compile	5.01%	1.7380	1.8250	0.0196
> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc.compile	5.00%	8.1866	8.5962	0.0971
> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding.compile	4.93%	2.6490	2.7796	0.0313
> MultiSource/Applications/treecc/treecc.compile	4.91%	2.1985	2.3064	0.0297
> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl.compile	4.91%	1.1883	1.2466	0.0140
> External/SPEC/CINT2006/471_omnetpp/471_omnetpp.compile	4.90%	38.5538	40.4441	0.5541
> MultiSource/Applications/siod/siod.compile	4.83%	2.3081	2.4195	0.0338
> External/SPEC/CFP2006/433_milc/433_milc.compile	4.79%	3.7178	3.8957	0.0457
> External/SPEC/CINT95/130_li/130_li.compile	4.76%	1.7191	1.8010	0.0222
> MultiSource/Applications/Burg/burg.compile	4.76%	1.3814	1.4472	0.0181
> MultiSource/Applications/kimwitu++/kc.compile	4.72%	19.8298	20.7661	0.2672
> External/SPEC/CINT95/124_m88ksim/124_m88ksim.compile	4.61%	4.8640	5.0884	0.0567
> MultiSource/Applications/hexxagon/hexxagon.compile	4.59%	1.3968	1.4609	0.0161
> MultiSource/Benchmarks/Bullet/bullet.compile	4.52%	45.4182	47.4703	0.5196
> MultiSource/Applications/oggenc/oggenc.compile	4.50%	5.7237	5.9815	0.0815
> MultiSource/Benchmarks/VersaBench/dbms/dbms.compile	4.49%	1.1489	1.2005	0.0112
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4.compile	4.43%	22.0869	23.0643	0.2772
> External/SPEC/CFP2006/450_soplex/450_soplex.compile	4.41%	31.2660	32.6439	0.3578
> External/SPEC/CINT2006/483_xalancbmk/483_xalancbmk.compile	4.38%	229.5873	239.6338	2.5306
> External/SPEC/CFP2000/188_ammp/188_ammp.compile	4.36%	3.2002	3.3396	0.0351
> External/SPEC/CFP2006/447_dealII/447_dealII.compile	4.20%	145.3980	151.5042	1.7782
> MultiSource/Benchmarks/Prolangs-C++/city/city.compile	3.97%	2.2355	2.3242	0.0256
> MultiSource/Benchmarks/mediabench/gsm/toast/toast.compile	3.91%	1.5275	1.5873	0.0152
> External/SPEC/CINT2000/252_eon/252_eon.compile	3.88%	49.7306	51.6607	0.5384
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm.compile	3.86%	1.5277	1.5867	0.0156
> External/SPEC/CINT2006/445_gobmk/445_gobmk.compile	3.85%	20.1682	20.9450	0.1728
> SingleSource/Benchmarks/Shootout/fib2.exec	3.76%	6.2876	6.5241	0.0911
> SingleSource/Benchmarks/Shootout/hash.exec	1.31%	4.8515	4.9149	0.0021
> 
> Performance Improvements	Δ	Previous	Current	σ
> SingleSource/Benchmarks/Misc-C++-EH/spirit.exec	-1.10%	9.0797	8.9797	0.0266
> 
> Added Tests
> SingleSource/UnitTests/ms_struct-bitfield-init-1.compile
> SingleSource/UnitTests/ms_struct-bitfield-init-1.exec
> SingleSource/UnitTests/ms_struct-bitfield.compile
> SingleSource/UnitTests/ms_struct-bitfield.exec
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20110506/02b171e7/attachment.html>


More information about the llvm-testresults mailing list