[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Sat Dec 12 19:55:17 PST 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3720/
Name:  grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4

Run: 3720, Start Time: 2009-12-12 17:04:46, End Time: 2009-12-12 19:51:35
Comparing To: 3716, Start Time: 2009-12-12 13:17:32, End Time: 2009-12-12 16:17:57

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 113

--- Tests Summary ---
Total Tests: 3870
Total Test Failures: 944

Total Test Failures By Type:
  CBE: 68
  JIT: 430
  JIT codegen: 430
  LLC: 1
  LLC compile: 1
  LLC-BETA: 7
  LLC_BETA compile: 7

--- Changes Detail ---
New Test Passes:

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 Externals/SPEC/CFP2006/433_milc/433_milc: -7.98% (11.9000 => 10.9500)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: -11.66% (5.8300 => 5.1500)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -10.64% (5.4500 => 4.8700)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -10.42% (13.7300 => 12.3000)
 MultiSource/Applications/minisat/minisat: -9.20% (9.7800 => 8.8800)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.52% (6.7300 => 5.8200)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.40% (19.5700 => 17.7300)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.78% (8.1900 => 6.5700)
 MultiSource/Benchmarks/NPB-serial/is/is: -7.45% (11.8200 => 10.9400)
 MultiSource/Benchmarks/Olden/health/health: -6.67% (0.4500 => 0.4200)
 MultiSource/Benchmarks/Ptrdist/ft/ft: -7.62% (1.0500 => 0.9700)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.18% (1.9600 => 1.7800)
 MultiSource/Benchmarks/llubenchmark/llu: -23.54% (4.6300 => 3.5400)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.98% (1.2900 => 1.2000)
 SingleSource/Benchmarks/CoyoteBench/lpbench: -7.57% (10.7000 => 9.8900)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.50% (5.0600 => 4.6300)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -6.04% (1.4900 => 1.4000)
 SingleSource/Benchmarks/Shootout-C++/ary3: -15.15% (4.8200 => 4.0900)
 SingleSource/Benchmarks/Shootout-C++/hash: -5.05% (0.9900 => 0.9400)
 SingleSource/Benchmarks/Shootout-C++/hash2: -5.60% (4.6400 => 4.3800)
 SingleSource/Benchmarks/Shootout-C++/heapsort: -12.64% (4.5900 => 4.0100)
 SingleSource/Benchmarks/Shootout-C++/moments: -13.79% (0.2900 => 0.2500)
 SingleSource/Benchmarks/Shootout/ary3: -8.20% (4.3900 => 4.0300)
 SingleSource/Benchmarks/Shootout/heapsort: -6.67% (4.3500 => 4.0600)
LLC-BETA compile:
 Externals/Nurbs/nurbs: -6.21% (0.9294 => 0.8717)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: -5.04% (44.0657 => 41.8462)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -5.15% (2.8944 => 2.7453)
 Externals/SPEC/CINT2000/252_eon/252_eon: -7.49% (4.6918 => 4.3402)
 MultiSource/Applications/hexxagon/hexxagon: -8.52% (0.3499 => 0.3201)
 MultiSource/Applications/lemon/lemon: 5.24% (0.8380 => 0.8819)
 MultiSource/Applications/minisat/minisat: -7.43% (0.3757 => 0.3478)
 MultiSource/Applications/siod/siod: -6.07% (2.3449 => 2.2025)
 MultiSource/Applications/treecc/treecc: -6.30% (1.6823 => 1.5763)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.47% (0.2431 => 0.2225)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.32% (1.8870 => 1.7488)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.93% (1.1262 => 1.0369)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.85% (3.9899 => 3.6768)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -7.95% (0.8298 => 0.7638)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.01% (0.4013 => 0.3491)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.78% (0.9911 => 0.9239)
 MultiSource/Benchmarks/Prolangs-C/football/football: -6.62% (0.7944 => 0.7418)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.73% (0.5144 => 0.4592)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.18% (0.2589 => 0.2429)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.86% (2.1271 => 2.0025)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -13.04% (2.8797 => 2.5043)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.02% (0.3170 => 0.3011)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.64% (0.3353 => 0.3164)
LLC-BETA:
 Externals/SPEC/CFP2000/183_equake/183_equake: -7.71% (11.5400 => 10.6500)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: -5.29% (5.4800 => 5.1900)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -7.40% (13.3800 => 12.3900)
 MultiSource/Applications/ClamAV/clamscan: -7.41% (0.2700 => 0.2500)
 MultiSource/Applications/minisat/minisat: -9.50% (9.5800 => 8.6700)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.28% (6.5600 => 5.8200)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.53% (19.8400 => 17.7500)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.38% (8.1000 => 6.5300)
 MultiSource/Benchmarks/FreeBench/neural/neural: -8.00% (0.2500 => 0.2300)
 MultiSource/Benchmarks/NPB-serial/is/is: -7.84% (11.8600 => 10.9300)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.32% (1.9000 => 1.7800)
 MultiSource/Benchmarks/llubenchmark/llu: -7.81% (3.8400 => 3.5400)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -7.63% (1.3100 => 1.2100)
 SingleSource/Benchmarks/CoyoteBench/lpbench: -13.93% (11.4900 => 9.8900)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.89% (5.1400 => 4.5800)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -6.04% (1.4900 => 1.4000)
 SingleSource/Benchmarks/Shootout-C++/ary3: -10.04% (4.5800 => 4.1200)
 SingleSource/Benchmarks/Shootout-C++/hash: -10.58% (1.0400 => 0.9300)
 SingleSource/Benchmarks/Shootout-C++/moments: -13.79% (0.2900 => 0.2500)
 SingleSource/Benchmarks/Shootout/ary3: -7.47% (4.4200 => 4.0900)
 SingleSource/Benchmarks/Shootout/heapsort: -5.16% (4.2600 => 4.0400)
LLC compile:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: -13.70% (1.7215 => 1.4856)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: -5.73% (5.6719 => 5.3469)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: -7.34% (0.7042 => 0.6525)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -5.28% (2.8671 => 2.7157)
 Externals/SPEC/CINT2000/197_parser/197_parser: -5.64% (2.2987 => 2.1690)
 Externals/SPEC/CINT2000/254_gap/254_gap: -9.38% (8.8676 => 8.0355)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -5.52% (6.8340 => 6.4571)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -5.80% (3.3252 => 3.1325)
 MultiSource/Applications/JM/lencod/lencod: -5.46% (8.6557 => 8.1828)
 MultiSource/Applications/minisat/minisat: -6.06% (0.3598 => 0.3380)
 MultiSource/Applications/siod/siod: -5.30% (2.2812 => 2.1604)
 MultiSource/Applications/spiff/spiff: -6.19% (0.3909 => 0.3667)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.18% (3.5622 => 3.3421)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.30% (0.2446 => 0.2194)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.03% (0.7157 => 0.6797)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.61% (0.3991 => 0.3727)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.87% (1.8660 => 1.7192)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.20% (1.1152 => 1.0238)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -7.96% (0.2399 => 0.2208)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.94% (0.8245 => 0.7508)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -8.68% (0.3768 => 0.3441)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -12.50% (1.0344 => 0.9051)
 MultiSource/Benchmarks/Prolangs-C/football/football: -5.34% (0.7795 => 0.7379)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -9.51% (0.2944 => 0.2664)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.62% (0.3613 => 0.3374)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.10% (0.2526 => 0.2372)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.52% (0.4461 => 0.4170)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.95% (2.7074 => 2.4651)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.34% (0.3297 => 0.3088)
CBE:
 Externals/SPEC/CINT2000/181_mcf/181_mcf: -8.44% (5.6900 => 5.2100)
 Externals/SPEC/CINT2000/197_parser/197_parser: -7.06% (3.5400 => 3.2900)
 MultiSource/Applications/SPASS/SPASS: -7.77% (10.6800 => 9.8500)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.51% (6.6900 => 5.9200)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.31% (20.0800 => 18.2100)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -21.35% (11.4300 => 8.9900)
 MultiSource/Benchmarks/NPB-serial/is/is: -8.69% (11.8500 => 10.8200)
 MultiSource/Benchmarks/Ptrdist/ft/ft: -12.30% (1.2200 => 1.0700)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.01% (2.2200 => 2.0200)
 MultiSource/Benchmarks/llubenchmark/llu: -13.26% (4.4500 => 3.8600)
 SingleSource/Benchmarks/CoyoteBench/lpbench: -7.65% (10.9800 => 10.1400)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -12.33% (2.2700 => 1.9900)
 SingleSource/Benchmarks/Shootout-C++/ary3: -16.08% (4.8500 => 4.0700)
 SingleSource/Benchmarks/Shootout-C++/hash: -11.82% (1.1000 => 0.9700)
 SingleSource/Benchmarks/Shootout-C++/heapsort: -6.84% (5.7000 => 5.3100)
 SingleSource/Benchmarks/Shootout/heapsort: -5.49% (5.6500 => 5.3400)



More information about the llvm-testresults mailing list