[llvm-testresults] evchen-ppc32 nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Fri Feb 12 17:14:35 PST 2010


http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5438/
Name:  evchen.apple.com
Nickname: evchen-ppc32:1

Run: 5438, Start Time: 2010-02-12 12:38:20, End Time: 2010-02-12 17:14:17
Comparing To: 5427, Start Time: 2010-02-12 00:39:48, End Time: 2010-02-12 05:15:04

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 7
Added Tests: 0
Removed Tests: 0
Significant Changes: 175

--- Tests Summary ---
Total Tests: 3618
Total Test Failures: 134

Total Test Failures By Type:
  CBE: 33
  JIT: 23
  JIT codegen: 36
  LLC: 12
  LLC compile: 12
  LLC-BETA: 9
  LLC_BETA compile: 9

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC, LLC compile]
Externals/SPEC/CINT2000/197_parser/197_parser [LLC, LLC compile]
Externals/SPEC/CINT2000/300_twolf/300_twolf [LLC, JIT, LLC compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
JIT codegen:
 MultiSource/Applications/ClamAV/clamscan: 5.71% (9.4840 => 10.0253)
 MultiSource/Applications/JM/ldecod/ldecod: 18.63% (5.2684 => 6.2498)
 MultiSource/Applications/JM/lencod/lencod: 29.13% (11.5292 => 14.8877)
 MultiSource/Applications/SIBsim4/SIBsim4: 35.74% (1.0493 => 1.4243)
 MultiSource/Applications/d/make_dparser: 7.25% (1.8847 => 2.0213)
 MultiSource/Applications/hexxagon/hexxagon: 18.30% (0.4514 => 0.5340)
 MultiSource/Applications/spiff/spiff: 9.33% (0.6880 => 0.7522)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.37% (4.8078 => 5.7389)
 MultiSource/Benchmarks/Bullet/bullet: 5.78% (3.5783 => 3.7850)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 33.38% (0.5659 => 0.7548)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.19% (0.6470 => 0.6806)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.23% (2.7512 => 3.0878)
 MultiSource/Benchmarks/McCat/18-imp/imp: 25.24% (0.2302 => 0.2883)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 172.36% (0.5319 => 1.4487)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.05% (0.8796 => 0.9592)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 39.80% (2.4747 => 3.4596)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.82% (0.4283 => 0.5346)
 MultiSource/Benchmarks/PAQ8p/paq8p: 7.46% (1.4535 => 1.5619)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.30% (0.4038 => 0.4575)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.08% (1.5484 => 1.6425)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.56% (0.4705 => 0.5531)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 8.29% (1.4803 => 1.6030)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 23.04% (0.6783 => 0.8346)
 MultiSource/Benchmarks/mafft/pairlocalalign: 10.02% (1.9877 => 2.1869)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.47% (0.4156 => 0.5256)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.48% (0.9998 => 1.0946)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.12% (0.7746 => 0.9769)
 MultiSource/Benchmarks/sim/sim: 10.34% (0.3772 => 0.4162)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.39% (9.6407 => 10.5455)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.83% (2.6341 => 3.1564)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.58% (0.3072 => 0.3612)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.16% (0.3419 => 0.3903)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.93% (0.3212 => 0.3563)
CBE:
 MultiSource/Benchmarks/McCat/09-vor/vor: -6.45% (0.3100 => 0.2900)
LLC-BETA:
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.07% (0.9900 => 1.0600)
LLC compile:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 14.58% (9.7736 => 11.1988)
 Externals/SPEC/CFP2000/179_art/179_art: 10.44% (0.3046 => 0.3364)
 Externals/SPEC/CFP2000/183_equake/183_equake: 16.55% (0.3227 => 0.3761)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.69% (3.2091 => 3.4239)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 13.79% (0.7497 => 0.8531)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: 17.52% (0.2021 => 0.2375)
 Externals/SPEC/CINT2000/254_gap/254_gap: 7.18% (12.8210 => 13.7417)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 23.83% (0.8407 => 1.0410)
 MultiSource/Applications/ClamAV/clamscan: 7.82% (16.3193 => 17.5962)
 MultiSource/Applications/JM/ldecod/ldecod: 20.35% (6.7093 => 8.0744)
 MultiSource/Applications/JM/lencod/lencod: 32.04% (14.3545 => 18.9531)
 MultiSource/Applications/SIBsim4/SIBsim4: 37.15% (1.0677 => 1.4644)
 MultiSource/Applications/d/make_dparser: 8.40% (2.1868 => 2.3705)
 MultiSource/Applications/hbd/hbd: 5.17% (0.8900 => 0.9360)
 MultiSource/Applications/hexxagon/hexxagon: 19.14% (0.4770 => 0.5683)
 MultiSource/Applications/lemon/lemon: 6.24% (1.1105 => 1.1798)
 MultiSource/Applications/minisat/minisat: 6.32% (0.5002 => 0.5318)
 MultiSource/Applications/spiff/spiff: 8.45% (0.8170 => 0.8860)
 MultiSource/Applications/sqlite3/sqlite3: 5.67% (11.1334 => 11.7648)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.83% (6.4970 => 7.9154)
 MultiSource/Benchmarks/Bullet/bullet: 6.21% (5.2140 => 5.5376)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 34.91% (0.5724 => 0.7722)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.19% (0.6710 => 0.7058)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.46% (4.2612 => 4.7920)
 MultiSource/Benchmarks/MallocBench/gs/gs: 5.94% (3.7047 => 3.9248)
 MultiSource/Benchmarks/McCat/18-imp/imp: 25.01% (0.2315 => 0.2894)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 186.05% (0.5563 => 1.5913)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.14% (1.7550 => 1.9680)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 39.99% (2.9644 => 4.1499)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.02% (1.8169 => 1.9262)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.49% (0.5612 => 0.6874)
 MultiSource/Benchmarks/PAQ8p/paq8p: 5.25% (2.0446 => 2.1520)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.68% (5.9787 => 6.4379)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.74% (1.0936 => 1.2329)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.87% (1.5865 => 1.6955)
 MultiSource/Benchmarks/Prolangs-C/football/football: 8.84% (1.2563 => 1.3673)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.84% (0.4779 => 0.5536)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.65% (0.6315 => 0.6798)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.85% (1.0276 => 1.1699)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 9.30% (1.5427 => 1.6862)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.87% (0.6775 => 0.8460)
 MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (4.9591 => 5.4011)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.79% (0.5641 => 0.6870)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.94% (1.5700 => 1.7103)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 23.80% (1.0300 => 1.2751)
 MultiSource/Benchmarks/sim/sim: 10.89% (0.3819 => 0.4235)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.07% (10.6472 => 11.5068)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.61% (2.7310 => 3.3211)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.96% (0.3096 => 0.3683)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.17% (0.3402 => 0.4054)
 SingleSource/Benchmarks/Misc-C++/bigfib: 5.50% (0.2307 => 0.2434)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.36% (0.3398 => 0.3920)
GCCAS:
 MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.2659 => 0.2813)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.97% (0.6916 => 0.7329)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.65% (3.1189 => 3.2951)
 SingleSource/Benchmarks/Stanford/Puzzle: 7.39% (0.2138 => 0.2296)
JIT:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 5.43% (8.1100 => 8.5500)
 Externals/SPEC/CFP2000/183_equake/183_equake: 5.60% (16.4400 => 17.3600)
 MultiSource/Applications/ClamAV/clamscan: 5.25% (10.4700 => 11.0200)
 MultiSource/Applications/JM/ldecod/ldecod: 16.64% (5.8300 => 6.8000)
 MultiSource/Applications/JM/lencod/lencod: 16.18% (25.2100 => 29.2900)
 MultiSource/Applications/SIBsim4/SIBsim4: 5.35% (5.9800 => 6.3000)
 MultiSource/Applications/d/make_dparser: 5.86% (2.2200 => 2.3500)
 MultiSource/Applications/lambda-0_1_3/lambda: 5.35% (18.1200 => 19.0900)
 MultiSource/Applications/sgefa/sgefa: 6.45% (0.9300 => 0.9900)
 MultiSource/Applications/siod/siod: 5.24% (8.2000 => 8.6300)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (17.7800 => 19.0200)
 MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.56% (12.9500 => 12.1000)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.01% (17.4000 => 19.4900)
 MultiSource/Benchmarks/BitBench/drop3/drop3: -7.25% (0.6900 => 0.6400)
 MultiSource/Benchmarks/BitBench/uudecode/uudecode: 8.70% (0.2300 => 0.2500)
 MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.90% (0.2900 => 0.2700)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 21.11% (0.9000 => 1.0900)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.34% (4.0700 => 4.4500)
 MultiSource/Benchmarks/McCat/18-imp/imp: 14.89% (0.4700 => 0.5400)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 131.43% (0.7000 => 1.6200)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.65% (1.0400 => 1.1300)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 32.38% (3.1500 => 4.1700)
 MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.33% (0.2400 => 0.2600)
 MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -5.00% (0.6000 => 0.5700)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.95% (0.8600 => 0.9800)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.64% (0.4700 => 0.5200)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.29% (1.7000 => 1.7900)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.70% (0.6300 => 0.7100)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 5.12% (2.9300 => 3.0800)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (2.3900 => 2.5200)
 MultiSource/Benchmarks/SciMark2-C/scimark2: -10.86% (28.8100 => 25.6800)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 23.33% (1.8000 => 2.2200)
 MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (73.2600 => 77.6700)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.08% (0.5200 => 0.6400)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.47% (1.1800 => 1.2800)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.98% (0.9100 => 1.1100)
 MultiSource/Benchmarks/sim/sim: -5.90% (7.6300 => 7.1800)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.40% (12.3000 => 13.2100)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.22% (5.3800 => 5.9300)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.11% (4.6100 => 5.0300)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.88% (8.8400 => 9.3600)
 SingleSource/Benchmarks/BenchmarkGame/n-body: 9.73% (1.8500 => 2.0300)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 15.26% (3.8000 => 4.3800)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: 29.60% (1.2500 => 1.6200)
 SingleSource/Benchmarks/Dhrystone/dry: -5.68% (0.8800 => 0.8300)
 SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 66.67% (0.4500 => 0.7500)
 SingleSource/Benchmarks/Misc/ReedSolomon: 16.37% (10.8100 => 12.5800)
 SingleSource/Benchmarks/Misc/flops-8: 5.51% (5.2600 => 5.5500)
 SingleSource/Benchmarks/Shootout-C++/ary2: 10.34% (0.2900 => 0.3200)
 SingleSource/Benchmarks/Shootout-C++/nestedloop: 25.00% (0.3200 => 0.4000)
 SingleSource/Benchmarks/Shootout/lists: 11.89% (9.0000 => 10.0700)
 SingleSource/Benchmarks/Shootout/sieve: 7.32% (12.2900 => 13.1900)
 SingleSource/Benchmarks/Stanford/Puzzle: 9.38% (0.3200 => 0.3500)
LLC:
 Externals/SPEC/CINT2000/252_eon/252_eon: 5.08% (0.5900 => 0.6200)
 MultiSource/Applications/JM/lencod/lencod: 8.41% (12.3700 => 13.4100)
 MultiSource/Applications/kimwitu++/kc: 8.57% (0.3500 => 0.3800)
 MultiSource/Applications/lua/lua: -5.78% (24.5600 => 23.1400)
 MultiSource/Benchmarks/BitBench/drop3/drop3: -5.00% (0.6000 => 0.5700)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.10% (0.9800 => 0.9300)
 MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -5.26% (0.3800 => 0.3600)
 MultiSource/Benchmarks/Olden/em3d/em3d: 19.92% (5.2200 => 6.2600)
 MultiSource/Benchmarks/Prolangs-C++/life/life: 5.25% (4.7600 => 5.0100)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.08% (1.4800 => 1.5700)
 MultiSource/Benchmarks/SciMark2-C/scimark2: -15.85% (30.0900 => 25.3200)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -20.00% (2.1500 => 1.7200)
 MultiSource/Benchmarks/VersaBench/bmm/bmm: 7.07% (16.8300 => 18.0200)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.78% (2.6600 => 3.0000)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.07% (7.0700 => 7.5700)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.24% (4.3700 => 4.7300)
 SingleSource/Benchmarks/BenchmarkGame/n-body: 12.87% (1.7100 => 1.9300)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.56% (4.1400 => 4.3700)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.58% (1.2100 => 1.5800)
 SingleSource/Benchmarks/CoyoteBench/huffbench: -8.88% (37.7300 => 34.3800)
 SingleSource/Benchmarks/Dhrystone/dry: -34.38% (3.2000 => 2.1000)
 SingleSource/Benchmarks/McGill/misr: 12.00% (0.5000 => 0.5600)
 SingleSource/Benchmarks/McGill/queens: 11.07% (2.4400 => 2.7100)
 SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 45.16% (0.3100 => 0.4500)
 SingleSource/Benchmarks/Misc/ReedSolomon: 16.47% (10.3800 => 12.0900)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -6.20% (68.5400 => 64.2900)
 SingleSource/Benchmarks/Misc/mandel-2: -5.13% (1.1700 => 1.1100)
 SingleSource/Benchmarks/Shootout-C++/matrix: 5.63% (7.1000 => 7.5000)
 SingleSource/Benchmarks/Shootout-C++/nestedloop: 37.04% (0.2700 => 0.3700)
 SingleSource/Benchmarks/Shootout/lists: 10.29% (8.8400 => 9.7500)
 SingleSource/Benchmarks/Stanford/Puzzle: 8.00% (0.2500 => 0.2700)



More information about the llvm-testresults mailing list