[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results

[daniel_dunbar at apple.com]

http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/4816/
Name:  grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4

Run: 4816, Start Time: 2010-01-21 05:21:39, End Time: 2010-01-21 07:52:28
Comparing To: 4793, Start Time: 2010-01-20 06:17:01, End Time: 2010-01-20 09:27:38

--- Changes Summary ---
New Test Passes: 34
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 124

--- Tests Summary ---
Total Tests: 3888
Total Test Failures: 1273

Total Test Failures By Type:
  CBE: 405
  JIT: 432
  JIT codegen: 432
  LLC: 1
  LLC compile: 1
  LLC-BETA: 1
  LLC_BETA compile: 1

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/sqlite3/sqlite3 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pifft/pifft [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/Olden/bh/bh [LLC, LLC compile]
MultiSource/Benchmarks/Olden/health/health [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/VersaBench/dbms/dbms [LLC, LLC compile]
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding [LLC-BETA, LLC_BETA compile]
SingleSource/Benchmarks/BenchmarkGame/partialsums [LLC-BETA, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/ray [LLC-BETA, LLC_BETA compile]
SingleSource/Benchmarks/Misc/flops [LLC, LLC compile]
SingleSource/Benchmarks/Misc/mandel [LLC-BETA, LLC_BETA compile]
SingleSource/Benchmarks/Misc/perlin [LLC, LLC compile]
SingleSource/Benchmarks/Misc/whetstone [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2005-07-17-INT-To-FP [LLC-BETA, LLC_BETA compile]

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 Externals/Nurbs/nurbs: 5.45% (5.3200 => 5.6100)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 19.21% (3.0200 => 3.6000)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 5.17% (3.2900 => 3.4600)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -11.61% (5.3400 => 4.7200)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 9.30% (24.8400 => 27.1500)
 MultiSource/Applications/JM/lencod/lencod: 12.64% (11.7100 => 13.1900)
 MultiSource/Applications/SIBsim4/SIBsim4: -7.79% (6.1600 => 5.6800)
 MultiSource/Applications/sgefa/sgefa: -14.81% (0.8100 => 0.6900)
 MultiSource/Benchmarks/BitBench/drop3/drop3: 10.71% (0.5600 => 0.6200)
 MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -6.67% (0.3000 => 0.2800)
 MultiSource/Benchmarks/Ptrdist/ks/ks: 6.94% (1.7300 => 1.8500)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 8.19% (27.7200 => 29.9900)
 MultiSource/Benchmarks/VersaBench/bmm/bmm: -9.35% (2.4600 => 2.2300)
 MultiSource/Benchmarks/sim/sim: -6.76% (7.4000 => 6.9000)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -11.26% (4.5300 => 4.0200)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -11.55% (3.5500 => 3.1400)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -8.16% (0.4900 => 0.4500)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.10% (1.9600 => 1.8600)
 SingleSource/Benchmarks/CoyoteBench/huffbench: 28.43% (16.2500 => 20.8700)
 SingleSource/Benchmarks/McGill/chomp: -16.79% (1.3700 => 1.1400)
 SingleSource/Benchmarks/Misc/flops-5: -5.21% (2.1100 => 2.0000)
 SingleSource/Benchmarks/Misc/mandel-2: 10.42% (0.9600 => 1.0600)
 SingleSource/Benchmarks/Shootout/sieve: 21.01% (5.5200 => 6.6800)
 SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.00% (0.5000 => 0.5400)
LLC-BETA compile:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 6.58% (6.2278 => 6.6376)
 Externals/SPEC/CFP2000/183_equake/183_equake: 6.61% (0.2466 => 0.2629)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 9.86% (1.5375 => 1.6891)
 Externals/SPEC/CFP2006/433_milc/433_milc: 23.85% (1.5529 => 1.9232)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 8.11% (40.7407 => 44.0464)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 15.08% (0.6744 => 0.7761)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 8.22% (0.5679 => 0.6146)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 19.07% (0.9712 => 1.1564)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 9.38% (11.0734 => 12.1117)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 23.55% (7.1357 => 8.8163)
 MultiSource/Applications/ClamAV/clamscan: 15.44% (8.2173 => 9.4861)
 MultiSource/Applications/JM/ldecod/ldecod: 11.18% (3.6162 => 4.0206)
 MultiSource/Applications/JM/lencod/lencod: 13.59% (8.3880 => 9.5276)
 MultiSource/Applications/SIBsim4/SIBsim4: 17.46% (0.6168 => 0.7245)
 MultiSource/Applications/oggenc/oggenc: 14.28% (2.8035 => 3.2038)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.52% (3.4023 => 3.6923)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.27% (2.5319 => 2.8173)
 MultiSource/Benchmarks/McCat/18-imp/imp: 5.70% (0.2019 => 0.2134)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 84.00% (0.3674 => 0.6760)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.53% (1.9177 => 2.0430)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 44.61% (1.7674 => 2.5559)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.53% (0.4328 => 0.4957)
 MultiSource/Benchmarks/PAQ8p/paq8p: 11.16% (1.3993 => 1.5555)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.42% (0.7657 => 0.8072)
 MultiSource/Benchmarks/Prolangs-C/football/football: 6.10% (0.7934 => 0.8418)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.15% (0.2711 => 0.2932)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 12.57% (0.8004 => 0.9010)
 MultiSource/Benchmarks/mafft/pairlocalalign: 9.78% (4.9457 => 5.4292)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.47% (0.4291 => 0.4869)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.80% (1.9878 => 2.1229)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.25% (0.7074 => 0.7516)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.56% (8.4140 => 8.9661)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.68% (2.5015 => 2.7437)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 24.80% (0.2508 => 0.3130)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.55% (0.3025 => 0.3828)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.73% (0.3131 => 0.3686)
LLC-BETA:
 Externals/Nurbs/nurbs: 5.23% (5.3500 => 5.6300)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 18.81% (3.0300 => 3.6000)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -11.61% (5.3400 => 4.7200)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 9.58% (24.8400 => 27.2200)
 MultiSource/Applications/ClamAV/clamscan: 7.69% (0.2600 => 0.2800)
 MultiSource/Applications/JM/lencod/lencod: 12.83% (11.6900 => 13.1900)
 MultiSource/Applications/SIBsim4/SIBsim4: -7.79% (6.1600 => 5.6800)
 MultiSource/Applications/sgefa/sgefa: -14.81% (0.8100 => 0.6900)
 MultiSource/Benchmarks/BitBench/drop3/drop3: 10.71% (0.5600 => 0.6200)
 MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -6.67% (0.3000 => 0.2800)
 MultiSource/Benchmarks/Ptrdist/ks/ks: 7.51% (1.7300 => 1.8600)
 MultiSource/Benchmarks/SciMark2-C/scimark2: 8.32% (27.6600 => 29.9600)
 MultiSource/Benchmarks/VersaBench/bmm/bmm: -9.35% (2.4600 => 2.2300)
 MultiSource/Benchmarks/sim/sim: -6.49% (7.4000 => 6.9200)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -11.04% (4.5300 => 4.0300)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -11.33% (3.5300 => 3.1300)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -8.16% (0.4900 => 0.4500)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.10% (1.9600 => 1.8600)
 SingleSource/Benchmarks/CoyoteBench/huffbench: 28.37% (16.2500 => 20.8600)
 SingleSource/Benchmarks/McGill/chomp: -16.79% (1.3700 => 1.1400)
 SingleSource/Benchmarks/Misc/flops-5: -5.21% (2.1100 => 2.0000)
 SingleSource/Benchmarks/Misc/mandel-2: 10.42% (0.9600 => 1.0600)
 SingleSource/Benchmarks/Shootout/sieve: 19.71% (5.5300 => 6.6200)
 SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.00% (0.5000 => 0.5400)
 SingleSource/UnitTests/Vector/SSE/sse_stepfft: -7.58% (0.6600 => 0.6100)
LLC compile:
 Externals/Nurbs/nurbs: 5.51% (0.8686 => 0.9165)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 6.20% (6.2156 => 6.6007)
 Externals/SPEC/CFP2000/179_art/179_art: 5.16% (0.2305 => 0.2424)
 Externals/SPEC/CFP2000/183_equake/183_equake: 7.33% (0.2456 => 0.2636)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 8.64% (1.5211 => 1.6525)
 Externals/SPEC/CFP2006/433_milc/433_milc: 24.91% (1.5464 => 1.9316)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 8.40% (40.7336 => 44.1561)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 15.95% (0.6702 => 0.7771)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 8.48% (0.5697 => 0.6180)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 18.09% (0.9713 => 1.1470)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 9.17% (11.0965 => 12.1141)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 23.68% (7.1203 => 8.8065)
 MultiSource/Applications/ClamAV/clamscan: 15.31% (8.1832 => 9.4361)
 MultiSource/Applications/JM/ldecod/ldecod: 12.13% (3.5920 => 4.0277)
 MultiSource/Applications/JM/lencod/lencod: 14.49% (8.3280 => 9.5350)
 MultiSource/Applications/SIBsim4/SIBsim4: 16.88% (0.6160 => 0.7200)
 MultiSource/Applications/oggenc/oggenc: 14.33% (2.8002 => 3.2016)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.28% (3.3940 => 3.6750)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 25.96% (0.6881 => 0.8667)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.10% (2.5237 => 2.8291)
 MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.2001 => 0.2146)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 83.08% (0.3677 => 0.6732)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.95% (1.9115 => 2.0443)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 44.75% (1.7616 => 2.5500)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.45% (0.4320 => 0.4901)
 MultiSource/Benchmarks/PAQ8p/paq8p: 10.96% (1.4038 => 1.5576)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.31% (0.7641 => 0.8047)
 MultiSource/Benchmarks/Prolangs-C/football/football: 5.92% (0.7926 => 0.8395)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.21% (0.2716 => 0.2939)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 13.61% (0.7898 => 0.8973)
 MultiSource/Benchmarks/mafft/pairlocalalign: 11.11% (4.9164 => 5.4626)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.61% (0.4251 => 0.4872)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.62% (1.9797 => 2.1107)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.13% (0.7052 => 0.7484)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.28% (8.4254 => 9.1227)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (2.4980 => 2.7323)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 24.17% (0.2511 => 0.3118)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.57% (0.3007 => 0.3836)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.43% (0.3141 => 0.3657)