[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Wed Dec 9 03:57:51 PST 2009
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3622/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 3622, Start Time: 2009-12-09 00:36:52, End Time: 2009-12-09 03:53:08
Comparing To: 3600, Start Time: 2009-12-08 00:36:57, End Time: 2009-12-08 03:50:45
--- Changes Summary ---
New Test Passes: 13
New Test Failures: 0
Added Tests: 9
Removed Tests: 0
Significant Changes: 175
--- Tests Summary ---
Total Tests: 3861
Total Test Failures: 116
Total Test Failures By Type:
CBE: 52
JIT: 25
JIT codegen: 25
LLC-BETA: 7
LLC_BETA compile: 7
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
New Test Failures:
Added Tests:
SingleSource/UnitTests/2009-12-07-StructReturn [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Removed Tests:
Significant Changes in Test Results:
JIT codegen:
MultiSource/Applications/lambda-0_1_3/lambda: -5.45% (0.3507 => 0.3316)
CBE:
MultiSource/Applications/sgefa/sgefa: -8.33% (0.7200 => 0.6600)
LLC-BETA:
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 5.38% (1.8600 => 1.9600)
SingleSource/Benchmarks/CoyoteBench/huffbench: 7.83% (15.3300 => 16.5300)
LLC compile:
Externals/Nurbs/nurbs: -10.54% (0.9562 => 0.8554)
Externals/Povray/povray: -14.11% (10.3062 => 8.8517)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -15.47% (6.4447 => 5.4478)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -14.95% (1.9146 => 1.6283)
Externals/SPEC/CFP2006/433_milc/433_milc: -9.36% (1.1041 => 1.0008)
Externals/SPEC/CFP2006/444_namd/444_namd: -11.22% (2.8956 => 2.5707)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -14.74% (7.3418 => 6.2593)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -14.42% (4.7133 => 4.0337)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -13.51% (0.5131 => 0.4438)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -11.38% (1.9595 => 1.7366)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -15.74% (25.0158 => 21.0778)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -13.01% (2.8450 => 2.4750)
Externals/SPEC/CINT2000/197_parser/197_parser: -15.26% (1.9913 => 1.6874)
Externals/SPEC/CINT2000/252_eon/252_eon: -8.24% (2.9659 => 2.7216)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -15.62% (11.0281 => 9.3055)
Externals/SPEC/CINT2000/254_gap/254_gap: -15.12% (9.2272 => 7.8322)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -10.75% (0.4419 => 0.3944)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -11.79% (3.0739 => 2.7115)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -15.04% (20.1172 => 17.0917)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -7.69% (1.2451 => 1.1493)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -14.32% (12.9689 => 11.1117)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -12.16% (2.6167 => 2.2984)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -14.07% (1.5396 => 1.3230)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -9.09% (0.4872 => 0.4429)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -10.69% (6.7803 => 6.0552)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -15.09% (13.4377 => 11.4095)
Externals/SPEC/CINT2006/473_astar/473_astar: -11.46% (0.3936 => 0.3485)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -16.01% (53.6674 => 45.0748)
MultiSource/Applications/ClamAV/clamscan: -14.45% (10.1560 => 8.6880)
MultiSource/Applications/JM/ldecod/ldecod: -10.79% (4.1218 => 3.6769)
MultiSource/Applications/JM/lencod/lencod: -10.49% (8.5136 => 7.6207)
MultiSource/Applications/SIBsim4/SIBsim4: -10.84% (0.7419 => 0.6615)
MultiSource/Applications/SPASS/SPASS: -14.08% (8.5116 => 7.3128)
MultiSource/Applications/d/make_dparser: -14.27% (1.5359 => 1.3167)
MultiSource/Applications/hbd/hbd: -12.52% (0.5609 => 0.4907)
MultiSource/Applications/hexxagon/hexxagon: -13.95% (0.3047 => 0.2622)
MultiSource/Applications/kimwitu++/kc: -14.84% (9.3025 => 7.9218)
MultiSource/Applications/lambda-0_1_3/lambda: -18.50% (0.5659 => 0.4612)
MultiSource/Applications/lemon/lemon: -14.50% (0.7819 => 0.6685)
MultiSource/Applications/lua/lua: -15.02% (3.8958 => 3.3108)
MultiSource/Applications/minisat/minisat: -12.85% (0.3205 => 0.2793)
MultiSource/Applications/oggenc/oggenc: -13.10% (1.8713 => 1.6262)
MultiSource/Applications/siod/siod: -16.92% (3.0532 => 2.5366)
MultiSource/Applications/spiff/spiff: -14.14% (0.4668 => 0.4008)
MultiSource/Applications/sqlite3/sqlite3: -14.65% (8.3690 => 7.1427)
MultiSource/Applications/treecc/treecc: -15.16% (1.9567 => 1.6601)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.12% (3.9539 => 3.5141)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.07% (0.5037 => 0.4530)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -15.67% (0.4402 => 0.3712)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -12.13% (2.9420 => 2.5852)
MultiSource/Benchmarks/MallocBench/gs/gs: -16.48% (2.5691 => 2.1456)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.27% (0.3564 => 0.3305)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -13.47% (1.2927 => 1.1186)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.71% (1.6650 => 1.5033)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -12.96% (8.7029 => 7.5747)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -14.91% (1.0777 => 0.9170)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.00% (0.3716 => 0.3233)
MultiSource/Benchmarks/PAQ8p/paq8p: -11.80% (1.2995 => 1.1462)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.78% (3.8451 => 3.4306)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -14.60% (0.7122 => 0.6082)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.72% (0.4331 => 0.3737)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -11.64% (0.9715 => 0.8584)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -10.14% (0.3402 => 0.3057)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -17.39% (0.3370 => 0.2784)
MultiSource/Benchmarks/Prolangs-C/football/football: -14.61% (0.6569 => 0.5609)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -14.58% (0.3106 => 0.2653)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -15.23% (0.4406 => 0.3735)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -13.60% (0.3353 => 0.2897)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -14.65% (0.6252 => 0.5336)
MultiSource/Benchmarks/Ptrdist/bc/bc: -13.92% (0.8802 => 0.7577)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.12% (0.4193 => 0.3685)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.04% (0.2821 => 0.2425)
MultiSource/Benchmarks/mafft/pairlocalalign: -10.94% (2.3240 => 2.0697)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.43% (0.3685 => 0.3227)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -14.22% (1.1414 => 0.9791)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -12.63% (0.7175 => 0.6269)
MultiSource/Benchmarks/sim/sim: -12.09% (0.2407 => 0.2116)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.83% (6.5332 => 5.8907)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -10.09% (1.8112 => 1.6285)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -9.80% (1.6553 => 1.4931)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.74% (1.1446 => 1.0331)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -15.04% (0.2693 => 0.2288)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -15.36% (0.2558 => 0.2165)
GCCAS:
Externals/SPEC/CFP2000/183_equake/183_equake: -5.98% (0.2540 => 0.2388)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -9.53% (3.1142 => 2.8175)
Externals/SPEC/CFP2006/433_milc/433_milc: -17.59% (1.6818 => 1.3860)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -17.43% (41.1650 => 33.9907)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -5.53% (46.6151 => 44.0367)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -5.70% (7.3216 => 6.9041)
MultiSource/Applications/ClamAV/clamscan: -14.87% (7.8680 => 6.6977)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.98% (5.0615 => 4.7083)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.83% (1.9008 => 1.7330)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -15.22% (3.0475 => 2.5836)
JIT:
SingleSource/Benchmarks/CoyoteBench/huffbench: 15.32% (14.7500 => 17.0100)
LLC:
SingleSource/Benchmarks/CoyoteBench/huffbench: 7.62% (15.3500 => 16.5200)
LLC-BETA compile:
Externals/Nurbs/nurbs: -11.29% (0.9802 => 0.8695)
Externals/Povray/povray: -12.08% (10.6035 => 9.3225)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -15.37% (6.6664 => 5.6418)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -14.19% (1.9513 => 1.6745)
Externals/SPEC/CFP2006/433_milc/433_milc: -9.15% (1.1311 => 1.0276)
Externals/SPEC/CFP2006/444_namd/444_namd: -8.41% (2.9604 => 2.7113)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -13.64% (7.7234 => 6.6700)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -13.01% (0.5120 => 0.4454)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -11.83% (1.9930 => 1.7573)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -12.35% (2.8760 => 2.5208)
Externals/SPEC/CINT2000/197_parser/197_parser: -15.11% (2.0415 => 1.7331)
Externals/SPEC/CINT2000/252_eon/252_eon: -8.29% (3.1057 => 2.8482)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -15.40% (11.1917 => 9.4681)
Externals/SPEC/CINT2000/254_gap/254_gap: -16.60% (9.4952 => 7.9191)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -10.83% (0.4406 => 0.3929)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -11.93% (3.1244 => 2.7518)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -15.56% (20.5630 => 17.3644)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -8.50% (1.2755 => 1.1671)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -13.55% (13.2192 => 11.4276)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -12.33% (2.6642 => 2.3358)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -13.98% (1.5539 => 1.3366)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -9.19% (0.4949 => 0.4494)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -10.57% (6.8994 => 6.1704)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -14.79% (13.6548 => 11.6358)
Externals/SPEC/CINT2006/473_astar/473_astar: -11.89% (0.4019 => 0.3541)
MultiSource/Applications/ClamAV/clamscan: -14.34% (10.4345 => 8.9386)
MultiSource/Applications/JM/lencod/lencod: -10.07% (8.6477 => 7.7766)
MultiSource/Applications/SIBsim4/SIBsim4: -10.86% (0.7543 => 0.6724)
MultiSource/Applications/SPASS/SPASS: -14.05% (8.6538 => 7.4383)
MultiSource/Applications/d/make_dparser: -13.94% (1.5806 => 1.3603)
MultiSource/Applications/hbd/hbd: -12.79% (0.5708 => 0.4978)
MultiSource/Applications/hexxagon/hexxagon: -14.58% (0.3142 => 0.2684)
MultiSource/Applications/kimwitu++/kc: -14.57% (9.5398 => 8.1497)
MultiSource/Applications/lambda-0_1_3/lambda: -16.91% (0.5720 => 0.4753)
MultiSource/Applications/lemon/lemon: -15.37% (0.7975 => 0.6749)
MultiSource/Applications/lua/lua: -14.82% (3.9836 => 3.3932)
MultiSource/Applications/minisat/minisat: -13.35% (0.3295 => 0.2855)
MultiSource/Applications/oggenc/oggenc: -11.48% (1.8585 => 1.6452)
MultiSource/Applications/siod/siod: -16.26% (3.1086 => 2.6031)
MultiSource/Applications/spiff/spiff: -13.31% (0.4703 => 0.4077)
MultiSource/Applications/sqlite3/sqlite3: -14.49% (8.5294 => 7.2936)
MultiSource/Applications/treecc/treecc: -15.47% (1.9908 => 1.6828)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.13% (4.0210 => 3.6137)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -9.61% (0.5076 => 0.4588)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -13.30% (0.4354 => 0.3775)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -12.74% (3.0139 => 2.6300)
MultiSource/Benchmarks/MallocBench/gs/gs: -15.61% (2.6307 => 2.2200)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.83% (0.3704 => 0.3414)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -13.38% (1.3299 => 1.1519)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.06% (1.7051 => 1.5336)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -14.38% (1.0941 => 0.9368)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.55% (0.3801 => 0.3286)
MultiSource/Benchmarks/PAQ8p/paq8p: -11.80% (1.3301 => 1.1732)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.57% (3.9169 => 3.4636)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -14.05% (0.7175 => 0.6167)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.46% (0.4390 => 0.3799)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -11.65% (0.9809 => 0.8666)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -11.43% (0.3491 => 0.3092)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -17.35% (0.3406 => 0.2815)
MultiSource/Benchmarks/Prolangs-C/football/football: -14.59% (0.6675 => 0.5701)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -14.26% (0.3163 => 0.2712)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -14.67% (0.4457 => 0.3803)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -13.94% (0.3428 => 0.2950)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -14.92% (0.6396 => 0.5442)
MultiSource/Benchmarks/Ptrdist/bc/bc: -14.17% (0.8957 => 0.7688)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.83% (0.4287 => 0.3737)
MultiSource/Benchmarks/mafft/pairlocalalign: -10.50% (2.3507 => 2.1039)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.42% (0.3751 => 0.3285)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -13.41% (1.1645 => 1.0083)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -12.20% (0.7353 => 0.6456)
MultiSource/Benchmarks/sim/sim: -12.74% (0.2441 => 0.2130)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.47% (1.8404 => 1.6662)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -9.77% (1.6804 => 1.5162)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.50% (1.1600 => 1.0498)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -14.66% (0.2749 => 0.2346)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -15.16% (0.2619 => 0.2222)
More information about the llvm-testresults
mailing list