[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Fri Jan 22 03:11:13 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/4829/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 4829, Start Time: 2010-01-22 00:25:23, End Time: 2010-01-22 03:07:03
Comparing To: 4807, Start Time: 2010-01-21 00:24:31, End Time: 2010-01-21 03:14:36
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 13
Added Tests: 0
Removed Tests: 0
Significant Changes: 181
--- Tests Summary ---
Total Tests: 3888
Total Test Failures: 499
Total Test Failures By Type:
CBE: 404
JIT: 27
JIT codegen: 58
LLC: 2
LLC compile: 3
LLC-BETA: 2
LLC_BETA compile: 3
--- Changes Detail ---
New Test Passes:
New Test Failures:
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/OptimizerEval/optimizer-eval [JIT codegen, LLC compile, LLC_BETA compile]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
JIT codegen:
Externals/Nurbs/nurbs: -8.76% (0.8356 => 0.7624)
MultiSource/Applications/ClamAV/clamscan: -21.47% (5.4803 => 4.3037)
MultiSource/Applications/JM/ldecod/ldecod: -13.88% (3.1695 => 2.7296)
MultiSource/Applications/JM/lencod/lencod: -15.70% (6.8326 => 5.7600)
MultiSource/Applications/SIBsim4/SIBsim4: -15.95% (0.7004 => 0.5887)
MultiSource/Applications/hexxagon/hexxagon: -5.08% (0.2521 => 0.2393)
MultiSource/Applications/oggenc/oggenc: -13.76% (1.4056 => 1.2122)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.11% (2.7671 => 2.4873)
MultiSource/Benchmarks/Bullet/bullet: -5.13% (2.2456 => 2.1303)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -17.20% (0.5007 => 0.4146)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -17.62% (1.9952 => 1.6437)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -48.39% (0.5760 => 0.2973)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.29% (0.5744 => 0.5440)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -40.59% (1.9214 => 1.1415)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -51.27% (0.4644 => 0.2263)
MultiSource/Benchmarks/PAQ8p/paq8p: -16.10% (0.9272 => 0.7779)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.90% (0.2203 => 0.2073)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.13% (0.2779 => 0.2553)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.46% (0.2217 => 0.2096)
MultiSource/Benchmarks/Ptrdist/bc/bc: -15.74% (0.8087 => 0.6814)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.10% (0.3789 => 0.3482)
MultiSource/Benchmarks/mafft/pairlocalalign: -7.18% (0.9730 => 0.9031)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -52.35% (0.4569 => 0.2177)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.42% (0.6390 => 0.5980)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -11.13% (0.5048 => 0.4486)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.77% (5.2282 => 4.7699)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -10.36% (1.7453 => 1.5645)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -17.93% (0.2728 => 0.2239)
CBE:
SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.45% (5.3200 => 5.0300)
LLC-BETA:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -15.40% (3.9600 => 3.3500)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 10.55% (9.6700 => 10.6900)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -10.05% (23.2800 => 20.9400)
MultiSource/Applications/SIBsim4/SIBsim4: 7.82% (5.3700 => 5.7900)
MultiSource/Applications/aha/aha: 5.30% (2.6400 => 2.7800)
MultiSource/Applications/hexxagon/hexxagon: -5.07% (9.6700 => 9.1800)
MultiSource/Applications/sgefa/sgefa: 10.14% (0.6900 => 0.7600)
MultiSource/Benchmarks/SciMark2-C/scimark2: -10.74% (28.2000 => 25.1700)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.65% (4.7800 => 5.0500)
MultiSource/Benchmarks/sim/sim: 6.98% (6.1600 => 6.5900)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.9800 => 3.5700)
SingleSource/Benchmarks/BenchmarkGame/n-body: 5.41% (1.8500 => 1.9500)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.44% (0.4500 => 0.5600)
SingleSource/Benchmarks/CoyoteBench/huffbench: -20.48% (20.6100 => 16.3900)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.68% (4.9600 => 4.4800)
SingleSource/Benchmarks/Misc/flops-8: 5.69% (2.1100 => 2.2300)
SingleSource/Benchmarks/Misc/lowercase: -5.10% (8.6200 => 8.1800)
SingleSource/Benchmarks/Misc/mandel-2: -8.49% (1.0600 => 0.9700)
SingleSource/Benchmarks/Shootout-C++/sieve: -5.06% (2.3700 => 2.2500)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: -7.69% (0.5200 => 0.4800)
LLC compile:
Externals/Nurbs/nurbs: -8.05% (0.9626 => 0.8851)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -7.55% (6.1335 => 5.6702)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -8.08% (1.8415 => 1.6927)
Externals/SPEC/CFP2006/433_milc/433_milc: -56.14% (2.3627 => 1.0362)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -6.46% (7.0723 => 6.6156)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -7.91% (0.5045 => 0.4646)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -14.23% (0.4708 => 0.4038)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -15.23% (1.3786 => 1.1686)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -23.31% (8.2199 => 6.3040)
MultiSource/Applications/ClamAV/clamscan: -13.11% (10.3662 => 9.0068)
MultiSource/Applications/JM/ldecod/ldecod: -13.32% (4.3785 => 3.7951)
MultiSource/Applications/JM/lencod/lencod: -15.14% (9.3575 => 7.9409)
MultiSource/Applications/SIBsim4/SIBsim4: -14.41% (0.7639 => 0.6538)
MultiSource/Applications/oggenc/oggenc: -15.25% (1.9831 => 1.6807)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.32% (3.9865 => 3.5752)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -15.26% (0.5539 => 0.4694)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -14.48% (3.1613 => 2.7037)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -46.10% (0.6369 => 0.3433)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.38% (1.2517 => 1.1719)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -36.38% (2.4425 => 1.5540)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -41.74% (0.5848 => 0.3407)
MultiSource/Benchmarks/PAQ8p/paq8p: -10.73% (1.3510 => 1.2061)
MultiSource/Benchmarks/Prolangs-C/football/football: -5.46% (0.6120 => 0.5786)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.69% (0.3050 => 0.2785)
MultiSource/Benchmarks/Ptrdist/bc/bc: -13.51% (0.9105 => 0.7875)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.94% (0.4092 => 0.3808)
MultiSource/Benchmarks/mafft/pairlocalalign: -9.11% (2.3992 => 2.1807)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.55% (0.5812 => 0.3397)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.64% (1.0888 => 1.0274)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -8.95% (0.7238 => 0.6590)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.09% (6.1455 => 5.6482)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.41% (1.8827 => 1.7056)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -17.97% (0.2910 => 0.2387)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.15% (0.2513 => 0.2258)
JIT:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -14.88% (5.0400 => 4.2900)
Externals/SPEC/CFP2006/433_milc/433_milc: -13.06% (12.2500 => 10.6500)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 8.27% (10.0400 => 10.8700)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.58% (4.4800 => 4.2300)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -13.19% (28.6500 => 24.8700)
MultiSource/Applications/ClamAV/clamscan: -19.38% (6.0900 => 4.9100)
MultiSource/Applications/JM/ldecod/ldecod: -12.86% (3.5000 => 3.0500)
MultiSource/Applications/JM/lencod/lencod: -6.14% (15.8100 => 14.8400)
MultiSource/Applications/aha/aha: 7.07% (2.8300 => 3.0300)
MultiSource/Applications/oggenc/oggenc: -11.24% (1.7800 => 1.5800)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.30% (8.6800 => 8.2200)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.80% (7.1800 => 6.6200)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -13.04% (0.6900 => 0.6000)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -12.33% (2.9200 => 2.5600)
MultiSource/Benchmarks/McCat/18-imp/imp: -7.69% (0.2600 => 0.2400)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -39.71% (0.6800 => 0.4100)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -33.76% (2.3700 => 1.5700)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.23% (0.6900 => 0.4400)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -15.62% (0.3200 => 0.2700)
MultiSource/Benchmarks/PAQ8p/paq8p: -16.30% (119.6100 => 100.1100)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -7.69% (0.2600 => 0.2400)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.56% (0.3600 => 0.3400)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.00% (0.2500 => 0.2300)
MultiSource/Benchmarks/Ptrdist/bc/bc: -6.59% (1.8200 => 1.7000)
MultiSource/Benchmarks/SciMark2-C/scimark2: -11.30% (28.1400 => 24.9600)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.33% (0.7300 => 0.8200)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.56% (1.2600 => 1.1900)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 6.86% (4.8100 => 5.1400)
MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (33.2300 => 30.1000)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -47.06% (0.5100 => 0.2700)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -8.00% (0.7500 => 0.6900)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -10.53% (0.5700 => 0.5100)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (6.7700 => 6.2900)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.37% (3.3500 => 3.1700)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.78% (5.0100 => 4.6200)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.08% (2.9500 => 2.8000)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 15.86% (3.0900 => 3.5800)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.4800 => 0.5700)
SingleSource/Benchmarks/CoyoteBench/huffbench: -20.67% (20.0800 => 15.9300)
SingleSource/Benchmarks/McGill/chomp: 16.30% (0.9200 => 1.0700)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.70% (5.2600 => 4.7500)
SingleSource/Benchmarks/Misc/lowercase: -12.53% (9.1800 => 8.0300)
SingleSource/Benchmarks/Misc/mandel-2: 6.19% (0.9700 => 1.0300)
SingleSource/Benchmarks/Shootout/lists: -14.71% (7.3400 => 6.2600)
LLC:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -14.36% (3.9700 => 3.4000)
Externals/SPEC/CINT2000/254_gap/254_gap: 5.21% (2.1100 => 2.2200)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 10.31% (9.7000 => 10.7000)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -9.94% (23.3400 => 21.0200)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -6.12% (1.9600 => 1.8400)
MultiSource/Applications/SIBsim4/SIBsim4: 6.89% (5.3700 => 5.7400)
MultiSource/Applications/aha/aha: 5.30% (2.6400 => 2.7800)
MultiSource/Applications/hexxagon/hexxagon: -5.07% (9.6700 => 9.1800)
MultiSource/Applications/sgefa/sgefa: 11.59% (0.6900 => 0.7700)
MultiSource/Benchmarks/SciMark2-C/scimark2: -10.76% (28.1700 => 25.1400)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.87% (4.7700 => 5.0500)
MultiSource/Benchmarks/sim/sim: 6.65% (6.1700 => 6.5800)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.46% (2.9800 => 3.5600)
SingleSource/Benchmarks/BenchmarkGame/n-body: 5.41% (1.8500 => 1.9500)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.44% (0.4500 => 0.5600)
SingleSource/Benchmarks/CoyoteBench/huffbench: -20.46% (20.5800 => 16.3700)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.89% (4.7500 => 4.4700)
SingleSource/Benchmarks/Misc/flops-8: 5.21% (2.1100 => 2.2200)
SingleSource/Benchmarks/Misc/mandel-2: -8.49% (1.0600 => 0.9700)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: -7.69% (0.5200 => 0.4800)
LLC-BETA compile:
Externals/Nurbs/nurbs: -7.28% (0.9642 => 0.8940)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -6.59% (6.1296 => 5.7256)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -7.36% (1.8522 => 1.7158)
Externals/SPEC/CFP2006/433_milc/433_milc: -56.09% (2.3609 => 1.0366)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -6.46% (7.1028 => 6.6443)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -8.35% (0.5089 => 0.4664)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -14.35% (0.4718 => 0.4041)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -14.24% (1.3774 => 1.1813)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -22.78% (8.2242 => 6.3507)
MultiSource/Applications/ClamAV/clamscan: -12.35% (10.3582 => 9.0787)
MultiSource/Applications/JM/ldecod/ldecod: -12.66% (4.3832 => 3.8284)
MultiSource/Applications/JM/lencod/lencod: -14.64% (9.3470 => 7.9788)
MultiSource/Applications/SIBsim4/SIBsim4: -14.20% (0.7648 => 0.6562)
MultiSource/Applications/oggenc/oggenc: -14.95% (1.9857 => 1.6888)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.49% (4.0023 => 3.5823)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -14.16% (0.5531 => 0.4748)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -14.08% (3.1632 => 2.7179)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -45.89% (0.6389 => 0.3457)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.42% (1.2500 => 1.1822)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -35.74% (2.4375 => 1.5664)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -41.72% (0.5880 => 0.3427)
MultiSource/Benchmarks/PAQ8p/paq8p: -10.54% (1.3486 => 1.2064)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.36% (0.3051 => 0.2796)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.39% (0.4067 => 0.3807)
MultiSource/Benchmarks/Ptrdist/bc/bc: -13.26% (0.9148 => 0.7935)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.30% (0.4109 => 0.3850)
MultiSource/Benchmarks/mafft/pairlocalalign: -10.31% (2.4212 => 2.1716)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.43% (0.5878 => 0.3443)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.58% (1.0969 => 1.0357)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -9.43% (0.7282 => 0.6595)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.90% (6.1236 => 5.7012)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.99% (1.8860 => 1.7165)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -17.25% (0.2892 => 0.2393)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.04% (0.2546 => 0.2265)
More information about the llvm-testresults
mailing list