[llvm-testresults] evchen-ppc32 nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Mar 17 21:29:36 PDT 2010


http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/6461/
Name:  evchen.apple.com
Nickname: evchen-ppc32:1

Run: 6461, Start Time: 2010-03-17 11:53:40, End Time: 2010-03-17 21:29:20
Comparing To: 6420, Start Time: 2010-03-17 00:18:32, End Time: 2010-03-17 04:50:41

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 589
Added Tests: 0
Removed Tests: 0
Significant Changes: 49

--- Tests Summary ---
Total Tests: 3600
Total Test Failures: 693

Total Test Failures By Type:
  CBE: 107
  JIT: 104
  JIT codegen: 106
  LLC: 94
  LLC compile: 94
  LLC-BETA: 94
  LLC_BETA compile: 94

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/Povray/povray [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2000/183_equake/183_equake [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2000/188_ammp/188_ammp [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/164_gzip/164_gzip [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/175_vpr/175_vpr [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/181_mcf/181_mcf [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/186_crafty/186_crafty [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/197_parser/197_parser [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/254_gap/254_gap [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/255_vortex/255_vortex [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/300_twolf/300_twolf [LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/ClamAV/clamscan [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/ldecod/ldecod [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/lencod/lencod [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SIBsim4/SIBsim4 [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SPASS/SPASS [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/aha/aha [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/d/make_dparser [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/hbd/hbd [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/kimwitu++/kc [LLC, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/lemon/lemon [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/lua/lua [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/minisat/minisat [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/oggenc/oggenc [CBE]
MultiSource/Applications/sgefa/sgefa [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/spiff/spiff [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Applications/sqlite3/sqlite3 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/BitBench/five11/five11 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Bullet/bullet [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Fhourstones/fhourstones [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pifft/pifft [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/cfrac/cfrac [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/espresso/espresso [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/gs/gs [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/McCat/04-bisect/bisect [LLC, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/McCat/05-eks/eks [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/McCat/18-imp/imp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/bh/bh [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/mst/mst [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/PAQ8p/paq8p [JIT codegen, LLC, JIT, CBE, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/city/city [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/agrep/agrep [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/allroots/allroots [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Ptrdist/bc/bc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Ptrdist/ft/ft [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/VersaBench/bmm/bmm [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mafft/pairlocalalign [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/sim/sim [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Adobe-C++/stepanov_vector [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/BenchmarkGame/fannkuch [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/BenchmarkGame/puzzle [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/CoyoteBench/almabench [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/CoyoteBench/huffbench [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/McGill/chomp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/McGill/queens [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc/oourafft [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary3 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/matrix [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout/ary3 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout/matrix [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Stanford/IntMM [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Stanford/Oscar [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Stanford/Perm [JIT codegen, JIT]
SingleSource/Benchmarks/Stanford/Queens [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Stanford/Quicksort [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Stanford/RealMM [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2003-05-31-LongShifts [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -6.53% (423632.0000 => 395968.0000)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -18.43% (7120.0000 => 5808.0000)
 MultiSource/Benchmarks/BitBench/uudecode/uudecode: -5.75% (2784.0000 => 2624.0000)
 MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -9.73% (10848.0000 => 9792.0000)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: -11.75% (57744.0000 => 50960.0000)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -57.66% (68656.0000 => 29072.0000)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.46% (134784.0000 => 126080.0000)
 MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -5.31% (3616.0000 => 3424.0000)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.16% (49008.0000 => 46480.0000)
 SingleSource/Benchmarks/Misc/oourafft: -8.17% (13520.0000 => 12416.0000)
 SingleSource/Benchmarks/Shootout-C++/ary2: -11.54% (4160.0000 => 3680.0000)
 SingleSource/Benchmarks/Stanford/Oscar: -5.45% (3232.0000 => 3056.0000)
JIT codegen:
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -77.56% (1.4949 => 0.3355)
CBE:
 MultiSource/Benchmarks/SciMark2-C/scimark2: 6.69% (26.2900 => 28.0500)
 MultiSource/Benchmarks/llubenchmark/llu: -7.33% (12.0100 => 11.1300)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 5.71% (5.6000 => 5.9200)
 SingleSource/Benchmarks/Dhrystone/dry: 31.82% (0.4400 => 0.5800)
 SingleSource/Benchmarks/Misc/ReedSolomon: -10.22% (9.9800 => 8.9600)
 SingleSource/Benchmarks/Misc/ffbench: -41.78% (11.3200 => 6.5900)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 26.01% (21.8000 => 27.4700)
LLC-BETA:
 MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.00% (0.5000 => 0.4300)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.2900 => 0.3200)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.45% (1.8600 => 1.9800)
 SingleSource/Benchmarks/CoyoteBench/fftbench: 10.18% (7.9600 => 8.7700)
 SingleSource/Benchmarks/Dhrystone/dry: -19.79% (5.6100 => 4.5000)
 SingleSource/Benchmarks/Misc/ReedSolomon: -8.22% (35.1600 => 32.2700)
 SingleSource/Benchmarks/Misc/ffbench: -36.19% (11.2200 => 7.1600)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 538.12% (10.7300 => 68.4700)
LLC compile:
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -77.56% (1.6227 => 0.3641)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -9.21% (1.9873 => 1.8043)
GCCAS:
 MultiSource/Applications/siod/siod: 6.51% (1.5638 => 1.6656)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.80% (0.3035 => 0.2768)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -18.20% (0.7428 => 0.6076)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.18% (0.5120 => 0.4855)
JIT:
 MultiSource/Applications/viterbi/viterbi: -5.98% (27.6000 => 25.9500)
 MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -9.37% (12.8100 => 11.6100)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -69.46% (1.6700 => 0.5100)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 23.38% (24.7200 => 30.5000)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 5.36% (6.1600 => 6.4900)
 SingleSource/Benchmarks/Dhrystone/dry: -63.38% (2.1300 => 0.7800)
 SingleSource/Benchmarks/Misc/ReedSolomon: -8.90% (11.2400 => 10.2400)
 SingleSource/Benchmarks/Misc/ffbench: -38.19% (11.1800 => 6.9100)
LLC:
 MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.54% (11.8200 => 12.8300)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 5.43% (30.2200 => 31.8600)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 5.26% (5.3200 => 5.6000)
 SingleSource/Benchmarks/Dhrystone/dry: -10.53% (2.0900 => 1.8700)
 SingleSource/Benchmarks/Misc/ReedSolomon: -9.58% (10.7500 => 9.7200)
 SingleSource/Benchmarks/Misc/ffbench: -39.71% (11.1800 => 6.7400)
LLC-BETA compile:
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.79% (1.0124 => 0.9538)



More information about the llvm-testresults mailing list