[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Fri Feb 12 09:37:33 PST 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5434/
Name:  grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4

Run: 5434, Start Time: 2010-02-12 06:31:57, End Time: 2010-02-12 09:37:21
Comparing To: 5402, Start Time: 2010-02-11 06:07:29, End Time: 2010-02-11 09:08:10

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 164

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 935

Total Test Failures By Type:
  CBE: 63
  JIT: 433
  JIT codegen: 433
  LLC: 1
  LLC compile: 1
  LLC-BETA: 2
  LLC_BETA compile: 2

--- Changes Detail ---
New Test Passes:

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 20.40% (3.4800 => 4.1900)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 5.70% (5.6100 => 5.9300)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -5.42% (5.3500 => 5.0600)
 MultiSource/Applications/ClamAV/clamscan: -7.14% (0.2800 => 0.2600)
 MultiSource/Applications/SIBsim4/SIBsim4: -7.98% (6.1400 => 5.6500)
 MultiSource/Applications/lemon/lemon: 5.45% (2.0200 => 2.1300)
 MultiSource/Applications/sgefa/sgefa: -14.81% (0.8100 => 0.6900)
 MultiSource/Applications/viterbi/viterbi: 16.33% (7.8400 => 9.1200)
 MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.71% (9.8200 => 12.0500)
 MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.2300 => 0.2500)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.88% (0.3400 => 0.3600)
 MultiSource/Benchmarks/Prolangs-C++/life/life: -5.48% (3.6500 => 3.4500)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.91% (1.0100 => 0.9200)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (27.8700 => 30.2800)
 MultiSource/Benchmarks/sim/sim: 8.81% (7.3800 => 8.0300)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -11.26% (4.5300 => 4.0200)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -11.55% (3.5500 => 3.1400)
 SingleSource/Benchmarks/BenchmarkGame/fasta: -8.33% (1.2000 => 1.1000)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.76% (1.1900 => 1.3300)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -8.16% (0.4900 => 0.4500)
 SingleSource/Benchmarks/CoyoteBench/huffbench: 28.78% (15.3900 => 19.8200)
 SingleSource/Benchmarks/Dhrystone/dry: 13.40% (3.2100 => 3.6400)
 SingleSource/Benchmarks/McGill/chomp: -7.38% (1.2200 => 1.1300)
 SingleSource/Benchmarks/McGill/queens: 11.26% (2.9300 => 3.2600)
 SingleSource/Benchmarks/Misc/ReedSolomon: 9.88% (6.4800 => 7.1200)
 SingleSource/Benchmarks/Misc/flops-5: -5.21% (2.1100 => 2.0000)
 SingleSource/Benchmarks/Misc/mandel-2: 9.38% (0.9600 => 1.0500)
 SingleSource/Benchmarks/Misc/oourafft: 6.93% (6.7800 => 7.2500)
 SingleSource/Benchmarks/Shootout/sieve: 24.09% (5.5200 => 6.8500)
 SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.00% (0.5000 => 0.5900)
LLC-BETA compile:
 Externals/Nurbs/nurbs: 5.51% (0.8561 => 0.9033)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 10.89% (6.4550 => 7.1582)
 Externals/SPEC/CFP2000/179_art/179_art: 5.10% (0.2414 => 0.2537)
 Externals/SPEC/CFP2000/183_equake/183_equake: 10.33% (0.2516 => 0.2776)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.34% (1.5591 => 1.6579)
 Externals/SPEC/CFP2006/433_milc/433_milc: 18.38% (1.5821 => 1.8729)
 Externals/SPEC/CFP2006/444_namd/444_namd: 6.82% (3.6078 => 3.8539)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 8.42% (41.7240 => 45.2361)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 7.46% (5.4092 => 5.8125)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 11.16% (0.6919 => 0.7691)
 Externals/SPEC/CINT2000/197_parser/197_parser: 5.21% (2.1707 => 2.2837)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 12.96% (0.5816 => 0.6570)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 9.98% (3.2324 => 3.5549)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 28.12% (0.9020 => 1.1556)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 7.35% (11.2231 => 12.0481)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 5.42% (4.2340 => 4.4633)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 5.07% (1.8525 => 1.9464)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 93.03% (7.3818 => 14.2494)
 Externals/SPEC/CINT2006/473_astar/473_astar: 5.21% (0.5026 => 0.5288)
 MultiSource/Applications/ClamAV/clamscan: 6.33% (8.2060 => 8.7253)
 MultiSource/Applications/JM/ldecod/ldecod: 23.08% (3.6735 => 4.5212)
 MultiSource/Applications/JM/lencod/lencod: 40.63% (8.6760 => 12.2009)
 MultiSource/Applications/SIBsim4/SIBsim4: 57.53% (0.6327 => 0.9967)
 MultiSource/Applications/hexxagon/hexxagon: 11.44% (0.3365 => 0.3750)
 MultiSource/Applications/oggenc/oggenc: 33.85% (2.8067 => 3.7567)
 MultiSource/Applications/spiff/spiff: 6.96% (0.3935 => 0.4209)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.99% (3.4761 => 4.2751)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.21% (0.2287 => 0.2452)
 MultiSource/Benchmarks/Bullet/bullet: 6.27% (9.6888 => 10.2967)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 22.66% (0.6263 => 0.7682)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.30% (0.3823 => 0.4064)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.32% (2.5702 => 2.7583)
 MultiSource/Benchmarks/McCat/18-imp/imp: 13.02% (0.2004 => 0.2265)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 78.25% (0.3835 => 0.6836)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.55% (1.9807 => 2.1303)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 72.59% (1.8397 => 3.1752)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.28% (0.9781 => 1.0297)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (0.4554 => 0.4827)
 MultiSource/Benchmarks/PAQ8p/paq8p: 6.95% (1.4639 => 1.5656)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.17% (0.7445 => 0.8053)
 MultiSource/Benchmarks/Prolangs-C/football/football: 8.86% (0.6818 => 0.7422)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.60% (0.2685 => 0.2916)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.41% (0.6113 => 0.6566)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 10.35% (0.8183 => 0.9030)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.25% (0.4739 => 0.5509)
 MultiSource/Benchmarks/mafft/pairlocalalign: 17.06% (4.8944 => 5.7293)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.16% (0.4454 => 0.4773)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.61% (2.0530 => 2.2092)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.68% (0.6444 => 0.7712)
 MultiSource/Benchmarks/sim/sim: 7.83% (0.2351 => 0.2535)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.99% (8.4305 => 8.9355)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.85% (2.4419 => 2.5848)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.85% (0.2625 => 0.3146)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.91% (0.3049 => 0.3595)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.93% (0.3214 => 0.3533)
LLC-BETA:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 19.46% (3.7000 => 4.4200)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: -6.25% (5.4400 => 5.1000)
 MultiSource/Applications/ClamAV/clamscan: -7.14% (0.2800 => 0.2600)
 MultiSource/Applications/SIBsim4/SIBsim4: -8.13% (6.1500 => 5.6500)
 MultiSource/Applications/sgefa/sgefa: -8.00% (0.7500 => 0.6900)
 MultiSource/Applications/viterbi/viterbi: 13.04% (7.8200 => 8.8400)
 MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.11% (9.7800 => 12.0400)
 MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.2300 => 0.2500)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.88% (0.3400 => 0.3600)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.00% (1.0000 => 0.9200)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 8.81% (27.7000 => 30.1400)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 12.61% (1.1100 => 1.2500)
 MultiSource/Benchmarks/sim/sim: 8.34% (7.4300 => 8.0500)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -11.06% (4.5200 => 4.0200)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -11.05% (3.5300 => 3.1400)
 SingleSource/Benchmarks/BenchmarkGame/fasta: -8.33% (1.2000 => 1.1000)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.76% (1.1900 => 1.3300)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -8.16% (0.4900 => 0.4500)
 SingleSource/Benchmarks/CoyoteBench/huffbench: 29.32% (15.3800 => 19.8900)
 SingleSource/Benchmarks/McGill/chomp: -19.51% (1.2300 => 0.9900)
 SingleSource/Benchmarks/McGill/queens: 12.33% (2.9200 => 3.2800)
 SingleSource/Benchmarks/Misc/ReedSolomon: 9.72% (6.4800 => 7.1100)
 SingleSource/Benchmarks/Misc/flops-5: -5.21% (2.1100 => 2.0000)
 SingleSource/Benchmarks/Misc/mandel-2: 9.38% (0.9600 => 1.0500)
 SingleSource/Benchmarks/Misc/oourafft: 5.56% (6.8300 => 7.2100)
 SingleSource/Benchmarks/Shootout/sieve: 24.64% (5.5200 => 6.8800)
 SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.5100 => 0.5700)
LLC compile:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 9.66% (6.4127 => 7.0321)
 Externals/SPEC/CFP2000/179_art/179_art: 7.16% (0.2389 => 0.2560)
 Externals/SPEC/CFP2000/183_equake/183_equake: 9.70% (0.2505 => 0.2748)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.53% (1.5535 => 1.6549)
 Externals/SPEC/CFP2006/433_milc/433_milc: 19.14% (1.5822 => 1.8851)
 Externals/SPEC/CFP2006/444_namd/444_namd: 6.83% (3.5926 => 3.8379)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 8.18% (41.5671 => 44.9691)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 7.54% (5.3996 => 5.8068)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 12.08% (0.6806 => 0.7628)
 Externals/SPEC/CINT2000/197_parser/197_parser: 5.27% (2.1659 => 2.2800)
 Externals/SPEC/CINT2000/254_gap/254_gap: 5.37% (8.3429 => 8.7905)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 12.81% (0.5763 => 0.6501)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 10.73% (3.2227 => 3.5686)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 25.24% (0.9066 => 1.1354)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 7.78% (11.1850 => 12.0547)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 5.23% (4.2014 => 4.4210)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 83.37% (7.3814 => 13.5353)
 Externals/SPEC/CINT2006/473_astar/473_astar: 5.52% (0.5018 => 0.5295)
 MultiSource/Applications/ClamAV/clamscan: 6.34% (8.1895 => 8.7084)
 MultiSource/Applications/JM/ldecod/ldecod: 22.86% (3.6672 => 4.5056)
 MultiSource/Applications/JM/lencod/lencod: 40.01% (8.6731 => 12.1435)
 MultiSource/Applications/SIBsim4/SIBsim4: 64.38% (0.6286 => 1.0333)
 MultiSource/Applications/hexxagon/hexxagon: 12.95% (0.3320 => 0.3750)
 MultiSource/Applications/oggenc/oggenc: 34.74% (2.7951 => 3.7662)
 MultiSource/Applications/spiff/spiff: 6.29% (0.3943 => 0.4191)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.12% (3.4571 => 4.2565)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.90% (0.2281 => 0.2484)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 23.13% (0.6239 => 0.7682)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.25% (0.3825 => 0.4064)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.22% (2.5689 => 2.7545)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 75.68% (0.3890 => 0.6834)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.57% (1.9747 => 2.1241)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 73.95% (1.8356 => 3.1930)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.51% (0.9790 => 1.0329)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.46% (0.4437 => 0.4768)
 MultiSource/Benchmarks/PAQ8p/paq8p: 7.56% (1.4595 => 1.5698)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.92% (0.7399 => 0.8059)
 MultiSource/Benchmarks/Prolangs-C/football/football: 8.35% (0.6839 => 0.7410)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.98% (0.2673 => 0.2913)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.05% (0.6129 => 0.6561)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 11.78% (0.8159 => 0.9120)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.34% (0.4778 => 0.5463)
 MultiSource/Benchmarks/mafft/pairlocalalign: 16.80% (4.8982 => 5.7209)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.06% (0.4431 => 0.4744)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.20% (2.0529 => 2.2008)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.46% (0.6432 => 0.7748)
 MultiSource/Benchmarks/sim/sim: 8.42% (0.2352 => 0.2550)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.22% (8.4453 => 8.8861)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.67% (2.4474 => 2.5861)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.48% (0.2628 => 0.3140)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.45% (0.3029 => 0.3588)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.91% (0.3228 => 0.3548)

More information about the llvm-testresults mailing list