[llvm-testresults] evchen-ppc32 nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Feb 17 05:28:07 PST 2010


http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5532/
Name:  evchen.apple.com
Nickname: evchen-ppc32:1

Run: 5532, Start Time: 2010-02-17 01:03:14, End Time: 2010-02-17 05:27:39
Comparing To: 5438, Start Time: 2010-02-12 12:38:20, End Time: 2010-02-12 17:14:17

--- Changes Summary ---
New Test Passes: 11
New Test Failures: 170
Added Tests: 0
Removed Tests: 0
Significant Changes: 103

--- Tests Summary ---
Total Tests: 3618
Total Test Failures: 293

Total Test Failures By Type:
  CBE: 33
  JIT: 21
  JIT codegen: 35
  LLC: 52
  LLC compile: 52
  LLC-BETA: 50
  LLC_BETA compile: 50

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC, LLC compile]
Externals/SPEC/CINT2000/197_parser/197_parser [LLC, LLC compile]
Externals/SPEC/CINT2000/300_twolf/300_twolf [LLC, JIT, LLC compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [JIT codegen, JIT]
SingleSource/UnitTests/Vector/Altivec/casts [LLC-BETA, LLC_BETA compile]

New Test Failures:
MultiSource/Applications/hbd/hbd [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/hexxagon/hexxagon [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/kimwitu++/kc [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lambda-0_1_3/lambda [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/minisat/minisat [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Bullet/bullet [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/PAQ8p/paq8p [LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/employ/employ [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/family/family [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/garage/garage [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/objects/objects [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/trees/trees [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Adobe-C++/stepanov_vector [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/CoyoteBench/fftbench [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/bigfib [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/ray [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/stepanov_container [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary3 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists1 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/moments [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/reversefile [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/sieve [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/spellcheck [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/strcat [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/wordfreq [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ConditionalExpr [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count-2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/function_try_block [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/simple_rethrow [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/simple_throw [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/throw_rethrow_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/short_circuit_dtor [LLC, LLC-BETA, LLC compile, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 MultiSource/Applications/viterbi/viterbi: 7.89% (6080.0000 => 6560.0000)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.83% (281264.0000 => 325792.0000)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (6832.0000 => 7744.0000)
 SingleSource/Benchmarks/Shootout/hash: 7.03% (2960.0000 => 3168.0000)
JIT codegen:
 MultiSource/Applications/SPASS/SPASS: -14.27% (11.9450 => 10.2404)
 MultiSource/Applications/hexxagon/hexxagon: -7.36% (0.5340 => 0.4947)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -38.48% (1.9313 => 1.1881)
 MultiSource/Benchmarks/McCat/05-eks/eks: -10.85% (0.3300 => 0.2942)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.42% (1.4487 => 1.3123)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.45% (3.1564 => 3.6125)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -12.09% (0.2365 => 0.2079)
CBE:
 MultiSource/Benchmarks/FreeBench/mason/mason: 37.50% (0.2400 => 0.3300)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.41% (2.1600 => 2.3200)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -12.64% (2.7700 => 2.4200)
 SingleSource/Benchmarks/Shootout-C++/ary3: 13.89% (6.1900 => 7.0500)
 SingleSource/Benchmarks/Shootout-C++/hash2: -6.27% (5.2600 => 4.9300)
 SingleSource/Benchmarks/Shootout-C++/methcall: -20.31% (14.9200 => 11.8900)
LLC-BETA:
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 15.10% (48.9400 => 56.3300)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 6.11% (8.6700 => 9.2000)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -14.94% (63.4600 => 53.9800)
 MultiSource/Applications/lemon/lemon: 5.74% (7.3200 => 7.7400)
 MultiSource/Applications/siod/siod: -6.60% (15.1600 => 14.1600)
 MultiSource/Benchmarks/BitBench/drop3/drop3: 7.24% (3.0400 => 3.2600)
 MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -8.62% (0.5800 => 0.5300)
 MultiSource/Benchmarks/FreeBench/distray/distray: -5.26% (0.3800 => 0.3600)
 MultiSource/Benchmarks/McCat/18-imp/imp: 14.29% (0.5600 => 0.6400)
 MultiSource/Benchmarks/Olden/bisort/bisort: -5.32% (2.6300 => 2.4900)
 MultiSource/Benchmarks/Olden/em3d/em3d: -17.26% (49.6000 => 41.0400)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.88% (0.6800 => 0.6400)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: -6.67% (2.2500 => 2.1000)
 MultiSource/Benchmarks/Ptrdist/anagram/anagram: 41.80% (7.4400 => 10.5500)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.73% (9.8300 => 11.1800)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -13.61% (9.7000 => 8.3800)
 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.41% (2.9800 => 2.6400)
 MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.80% (5.0000 => 4.3600)
 MultiSource/Benchmarks/VersaBench/bmm/bmm: 10.69% (21.7900 => 24.1200)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -10.32% (3.4900 => 3.1300)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 9.69% (8.7700 => 9.6200)
 SingleSource/Benchmarks/CoyoteBench/huffbench: 5.41% (133.5500 => 140.7700)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 443.97% (11.2800 => 61.3600)
 SingleSource/Benchmarks/Misc/richards_benchmark: -10.11% (7.5200 => 6.7600)
 SingleSource/Benchmarks/Misc/salsa20: 16.05% (30.3400 => 35.2100)
 SingleSource/Benchmarks/Shootout-C++/ackermann: 7.56% (35.8400 => 38.5500)
 SingleSource/Benchmarks/Shootout-C++/methcall: 5.95% (27.7100 => 29.3600)
 SingleSource/Benchmarks/Shootout/hash: -8.15% (13.4900 => 12.3900)
 SingleSource/Benchmarks/Shootout/lists: -6.89% (27.5900 => 25.6900)
 SingleSource/Benchmarks/Shootout/methcall: -17.63% (30.9100 => 25.4600)
 SingleSource/Benchmarks/Stanford/Puzzle: -26.17% (1.4900 => 1.1000)
LLC compile:
 MultiSource/Applications/SPASS/SPASS: -5.56% (16.2029 => 15.3015)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.77% (7.9154 => 7.4583)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -40.49% (1.9255 => 1.1459)
 MultiSource/Benchmarks/McCat/05-eks/eks: -15.40% (0.3396 => 0.2873)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -13.49% (1.5913 => 1.3767)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.18% (4.1499 => 3.9349)
 MultiSource/Benchmarks/mafft/pairlocalalign: -11.52% (5.4011 => 4.7791)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.59% (3.3211 => 3.7726)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -14.95% (0.2415 => 0.2054)
GCCAS:
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 10.89% (31.3355 => 34.7491)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 13.78% (5.8166 => 6.6184)
 MultiSource/Applications/sqlite3/sqlite3: 5.85% (8.6073 => 9.1110)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 24.26% (12.5182 => 15.5556)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 27.26% (1.2107 => 1.5407)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (2.2393 => 2.3930)
 SingleSource/Benchmarks/Shootout-C++/hash: 5.08% (0.2301 => 0.2418)
 SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.53% (0.2686 => 0.2942)
JIT:
 MultiSource/Applications/lambda-0_1_3/lambda: -6.02% (19.0900 => 17.9400)
 MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.52% (0.2700 => 0.3200)
 MultiSource/Benchmarks/FreeBench/mason/mason: 43.08% (0.6500 => 0.9300)
 MultiSource/Benchmarks/McCat/05-eks/eks: -10.81% (0.3700 => 0.3300)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.02% (1.6200 => 1.4900)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.79% (1.5200 => 1.7600)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 11.33% (25.6800 => 28.5900)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -22.07% (2.2200 => 1.7300)
 MultiSource/Benchmarks/sim/sim: -5.01% (7.1800 => 6.8200)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -7.40% (64.7700 => 59.9800)
 SingleSource/Benchmarks/Shootout-C++/ary3: 18.59% (6.0800 => 7.2100)
 SingleSource/Benchmarks/Shootout-C++/matrix: 9.52% (7.3500 => 8.0500)
 SingleSource/Benchmarks/Shootout/lists: -10.53% (10.0700 => 9.0100)
 SingleSource/Benchmarks/Shootout/methcall: -43.48% (19.3900 => 10.9600)
 SingleSource/Benchmarks/Shootout/sieve: 6.22% (13.1900 => 14.0100)
 SingleSource/Benchmarks/Stanford/Puzzle: 8.57% (0.3500 => 0.3800)
LLC:
 MultiSource/Applications/JM/lencod/lencod: -5.89% (13.4100 => 12.6200)
 MultiSource/Applications/siod/siod: -12.23% (6.9500 => 6.1000)
 MultiSource/Benchmarks/FreeBench/mason/mason: 53.19% (0.4700 => 0.7200)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.53% (0.9300 => 1.0000)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.09% (0.4400 => 0.4800)
 MultiSource/Benchmarks/NPB-serial/is/is: -6.60% (18.7800 => 17.5400)
 MultiSource/Benchmarks/Olden/mst/mst: 10.64% (0.4700 => 0.5200)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: 11.97% (1.4200 => 1.5900)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.73% (1.5700 => 1.6600)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 12.56% (25.3200 => 28.5000)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -15.02% (2.5300 => 2.1500)
 SingleSource/Benchmarks/BenchmarkGame/n-body: -5.70% (1.9300 => 1.8200)
 SingleSource/Benchmarks/CoyoteBench/huffbench: -7.80% (34.3800 => 31.7000)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -51.16% (64.2900 => 31.4000)
 SingleSource/Benchmarks/Shootout-C++/matrix: -5.33% (7.5000 => 7.1000)
 SingleSource/Benchmarks/Shootout-C++/objinst: 9.61% (15.2000 => 16.6600)
 SingleSource/Benchmarks/Shootout/lists: -10.36% (9.7500 => 8.7400)
 SingleSource/Benchmarks/Shootout/methcall: -44.43% (17.4900 => 9.7200)
 SingleSource/Benchmarks/Shootout/objinst: -13.60% (14.7100 => 12.7100)
 SingleSource/Benchmarks/Shootout/sieve: 6.31% (13.1500 => 13.9800)
 SingleSource/Benchmarks/Stanford/Puzzle: 11.11% (0.2700 => 0.3000)
LLC-BETA compile:
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.49% (1.3509 => 1.4791)



More information about the llvm-testresults mailing list