[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Thu Jul 30 03:50:01 PDT 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//935
Name:  grawp.apple.com
Nickname: Grawp:4
Buildstatus: OK

Run: 935, Start Time: 2009-07-30 00:31:15
Comparing To: 918, Start Time: 2009-07-29 00:31:16

--- Changes Summary ---
New Test Passes: 36
New Test Failures: 2
Added Tests: 0
Removed Tests: 0
Significant Changes: 102

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 97

Total Test Failures By Type:
  CBE: 43
  JIT: 24
  JIT codegen: 24
  LLC: 1
  LLC compile: 1
  LLC-BETA: 2
  LLC_BETA compile: 2

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count-2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/function_try_block [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/simple_rethrow [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/simple_throw [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/throw_rethrow_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]

New Test Failures:
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [LLC-BETA, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 MultiSource/Applications/kimwitu++/kc: 6.67% (0.3000 => 0.3200)
 MultiSource/Applications/sgefa/sgefa: 7.35% (0.6800 => 0.7300)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.59% (1.6100 => 1.5200)
 SingleSource/Benchmarks/Dhrystone/dry: 11.54% (0.5200 => 0.5800)
 SingleSource/Benchmarks/Shootout-C++/ary3: -8.91% (4.4900 => 4.0900)
LLC-BETA compile:
 Externals/Nurbs/nurbs: -8.53% (0.6812 => 0.6231)
 Externals/Povray/povray: -7.46% (8.2778 => 7.6600)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -7.27% (5.6128 => 5.2049)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: -6.39% (1.5112 => 1.4147)
 Externals/SPEC/CFP2006/433_milc/433_milc: -7.51% (0.8137 => 0.7526)
 Externals/SPEC/CFP2006/444_namd/444_namd: -9.47% (2.3907 => 2.1642)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: -6.93% (6.1010 => 5.6785)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: -6.64% (3.6847 => 3.4399)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: -5.88% (0.4030 => 0.3793)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: -5.93% (1.5558 => 1.4636)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: -6.30% (19.2407 => 18.0286)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -6.75% (2.2372 => 2.0863)
 Externals/SPEC/CINT2000/197_parser/197_parser: -6.60% (1.5233 => 1.4227)
 Externals/SPEC/CINT2000/252_eon/252_eon: -10.30% (2.4016 => 2.1542)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -5.97% (9.6564 => 9.0795)
 Externals/SPEC/CINT2000/254_gap/254_gap: -5.96% (7.0198 => 6.6013)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -6.44% (5.1179 => 4.7884)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -6.04% (2.3460 => 2.2042)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -7.39% (18.0938 => 16.7573)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: -6.69% (48.3675 => 45.1324)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -6.40% (9.9310 => 9.2955)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -5.47% (2.0700 => 1.9567)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -7.09% (0.4006 => 0.3722)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -6.10% (5.9225 => 5.5610)
 Externals/SPEC/CINT2006/473_astar/473_astar: -9.08% (0.3294 => 0.2995)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -7.25% (40.3918 => 37.4640)
 MultiSource/Applications/ClamAV/clamscan: -6.48% (7.5505 => 7.0611)
 MultiSource/Applications/JM/ldecod/ldecod: -6.68% (3.3391 => 3.1162)
 MultiSource/Applications/JM/lencod/lencod: -6.76% (7.3375 => 6.8413)
 MultiSource/Applications/SIBsim4/SIBsim4: -6.49% (0.5576 => 0.5214)
 MultiSource/Applications/SPASS/SPASS: -6.54% (6.3983 => 5.9798)
 MultiSource/Applications/d/make_dparser: -5.79% (1.3961 => 1.3152)
 MultiSource/Applications/hbd/hbd: -8.38% (0.4536 => 0.4156)
 MultiSource/Applications/hexxagon/hexxagon: -6.90% (0.2622 => 0.2441)
 MultiSource/Applications/kimwitu++/kc: -10.66% (7.1093 => 6.3517)
 MultiSource/Applications/lambda-0_1_3/lambda: -7.61% (0.4142 => 0.3827)
 MultiSource/Applications/lemon/lemon: -6.04% (0.6110 => 0.5741)
 MultiSource/Applications/lua/lua: -7.61% (2.9627 => 2.7371)
 MultiSource/Applications/minisat/minisat: -6.91% (0.2504 => 0.2331)
 MultiSource/Applications/oggenc/oggenc: -7.94% (1.4555 => 1.3400)
 MultiSource/Applications/siod/siod: -6.72% (2.1769 => 2.0307)
 MultiSource/Applications/spiff/spiff: -5.56% (0.3237 => 0.3057)
 MultiSource/Applications/sqlite3/sqlite3: -6.45% (6.5710 => 6.1471)
 MultiSource/Applications/treecc/treecc: -7.23% (1.5163 => 1.4066)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.40% (3.2117 => 3.0063)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: -11.10% (0.4154 => 0.3693)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.69% (0.3646 => 0.3402)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.38% (2.4015 => 2.2484)
 MultiSource/Benchmarks/MallocBench/gs/gs: -7.41% (1.9256 => 1.7829)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.22% (0.3145 => 0.2918)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.94% (1.3425 => 1.2359)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.34% (6.7828 => 6.2171)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.02% (0.7870 => 0.7239)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.93% (0.3030 => 0.2729)
 MultiSource/Benchmarks/PAQ8p/paq8p: -12.59% (1.1142 => 0.9739)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.39% (3.0229 => 2.8296)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.60% (0.5464 => 0.5158)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.79% (0.3667 => 0.3418)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.78% (0.2771 => 0.2583)
 MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.36% (0.2650 => 0.2508)
 MultiSource/Benchmarks/Prolangs-C/football/football: -5.90% (0.5219 => 0.4911)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.84% (0.2262 => 0.2062)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.45% (0.3625 => 0.3355)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.85% (0.2632 => 0.2478)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.36% (0.4775 => 0.4519)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -6.51% (0.7267 => 0.6794)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.3155 => 0.2983)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.22% (0.2288 => 0.2100)
 MultiSource/Benchmarks/mafft/pairlocalalign: -7.31% (1.8679 => 1.7313)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.40% (0.3012 => 0.2729)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.93% (0.8428 => 0.7844)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.70% (0.5853 => 0.5461)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -10.40% (5.5547 => 4.9769)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.84% (1.6471 => 1.5509)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.38% (1.4509 => 1.3729)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.36% (0.9510 => 0.9000)
 SingleSource/Benchmarks/Misc-C++/bigfib: -5.30% (0.2151 => 0.2037)
JIT:
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -5.84% (13.7100 => 12.9100)
 MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -12.90% (0.3100 => 0.2700)
 SingleSource/Benchmarks/McGill/chomp: 9.62% (1.0400 => 1.1400)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 27.72% (2.6700 => 3.4100)
 SingleSource/Benchmarks/Shootout-C++/ary3: -12.03% (4.7400 => 4.1700)
 SingleSource/Benchmarks/Shootout/lists: 6.46% (6.0400 => 6.4300)
LLC-BETA:
 MultiSource/Applications/viterbi/viterbi: 11.08% (7.6700 => 8.5200)
 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.7100 => 0.8100)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 35.05% (0.9700 => 1.3100)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.52% (1.3800 => 1.4700)
 SingleSource/Benchmarks/Dhrystone/dry: 22.22% (0.4500 => 0.5500)
 SingleSource/Benchmarks/Dhrystone/fldry: -5.33% (0.7500 => 0.7100)
 SingleSource/Benchmarks/Misc/flops: 6.61% (13.1600 => 14.0300)
 SingleSource/Benchmarks/Misc/flops-5: 86.51% (2.1500 => 4.0100)
 SingleSource/Benchmarks/Misc/flops-6: 123.90% (2.0500 => 4.5900)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 9.84% (3.0500 => 3.3500)
 SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.26% (0.5700 => 0.5400)
CBE:
 MultiSource/Applications/sgefa/sgefa: 9.09% (0.6600 => 0.7200)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 5.05% (0.9900 => 1.0400)
 SingleSource/Benchmarks/Dhrystone/fldry: 8.50% (2.0000 => 2.1700)



More information about the llvm-testresults mailing list