[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Thu Jan 21 03:15:14 PST 2010
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/4807/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 4807, Start Time: 2010-01-21 00:24:31, End Time: 2010-01-21 03:14:36
Comparing To: 4779, Start Time: 2010-01-20 00:39:59, End Time: 2010-01-20 04:02:40
--- Changes Summary ---
New Test Passes: 34
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 173
--- Tests Summary ---
Total Tests: 3888
Total Test Failures: 486
Total Test Failures By Type:
CBE: 404
JIT: 25
JIT codegen: 57
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2000/179_art/179_art [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/ClamAV/clamscan [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk [LLC, LLC compile]
MultiSource/Benchmarks/FreeBench/pifft/pifft [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/cfrac/cfrac [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/espresso/espresso [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/McCat/08-main/main [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/VersaBench/dbms/dbms [LLC-BETA, LLC_BETA compile]
SingleSource/Benchmarks/Misc/flops-7 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc/mandel [LLC, LLC compile]
SingleSource/Benchmarks/Misc/whetstone [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C/casts [LLC-BETA, LLC_BETA compile]
New Test Failures:
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.64% (1989984.0000 => 1837936.0000)
JIT codegen:
Externals/Nurbs/nurbs: 9.85% (0.7607 => 0.8356)
MultiSource/Applications/ClamAV/clamscan: 26.82% (4.3214 => 5.4803)
MultiSource/Applications/JM/ldecod/ldecod: 16.35% (2.7241 => 3.1695)
MultiSource/Applications/JM/lencod/lencod: 18.21% (5.7801 => 6.8326)
MultiSource/Applications/SIBsim4/SIBsim4: 17.99% (0.5936 => 0.7004)
MultiSource/Applications/oggenc/oggenc: 16.41% (1.2075 => 1.4056)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.52% (2.4812 => 2.7671)
MultiSource/Benchmarks/Bullet/bullet: 6.03% (2.1178 => 2.2456)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.33% (0.4161 => 0.5007)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.83% (1.6512 => 1.9952)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 93.87% (0.2971 => 0.5760)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.19% (0.5409 => 0.5744)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 69.35% (1.1346 => 1.9214)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 102.44% (0.2294 => 0.4644)
MultiSource/Benchmarks/PAQ8p/paq8p: 18.83% (0.7803 => 0.9272)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.07% (0.2077 => 0.2203)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.43% (0.2563 => 0.2779)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.42% (0.2103 => 0.2217)
MultiSource/Benchmarks/Ptrdist/bc/bc: 18.16% (0.6844 => 0.8087)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.51% (0.3492 => 0.3789)
MultiSource/Benchmarks/mafft/pairlocalalign: 9.52% (0.8884 => 0.9730)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 110.65% (0.2169 => 0.4569)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.70% (0.5989 => 0.6390)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.88% (0.4512 => 0.5048)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.58% (1.5642 => 1.7453)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 21.19% (0.2251 => 0.2728)
CBE:
SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.98% (5.0200 => 5.3200)
LLC-BETA:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 16.81% (3.3900 => 3.9600)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -9.96% (10.7400 => 9.6700)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -8.00% (0.2500 => 0.2300)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 10.65% (21.0400 => 23.2800)
MultiSource/Applications/SIBsim4/SIBsim4: -6.61% (5.7500 => 5.3700)
MultiSource/Applications/aha/aha: -5.04% (2.7800 => 2.6400)
MultiSource/Applications/hexxagon/hexxagon: 5.34% (9.1800 => 9.6700)
MultiSource/Applications/sgefa/sgefa: -9.21% (0.7600 => 0.6900)
MultiSource/Benchmarks/SciMark2-C/scimark2: 11.95% (25.1900 => 28.2000)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -5.35% (5.0500 => 4.7800)
MultiSource/Benchmarks/sim/sim: -6.24% (6.5700 => 6.1600)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -16.53% (3.5700 => 2.9800)
SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.9600 => 1.8500)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -19.64% (0.5600 => 0.4500)
SingleSource/Benchmarks/CoyoteBench/huffbench: 25.82% (16.3800 => 20.6100)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 166.67% (1.8600 => 4.9600)
SingleSource/Benchmarks/Misc/lowercase: 5.12% (8.2000 => 8.6200)
SingleSource/Benchmarks/Misc/mandel-2: 9.28% (0.9700 => 1.0600)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.33% (0.4800 => 0.5200)
LLC compile:
Externals/Nurbs/nurbs: 8.84% (0.8844 => 0.9626)
Externals/SPEC/CFP2000/177_mesa/177_mesa: 7.61% (5.7000 => 6.1335)
Externals/SPEC/CFP2000/188_ammp/188_ammp: 9.21% (1.6862 => 1.8415)
Externals/SPEC/CFP2006/433_milc/433_milc: 128.59% (1.0336 => 2.3627)
Externals/SPEC/CFP2006/447_dealII/447_dealII: 7.68% (6.5676 => 7.0723)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 8.78% (0.4638 => 0.5045)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 16.71% (0.4034 => 0.4708)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 12.68% (1.2235 => 1.3786)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 30.34% (6.3067 => 8.2199)
MultiSource/Applications/ClamAV/clamscan: 14.31% (9.0687 => 10.3662)
MultiSource/Applications/JM/ldecod/ldecod: 15.30% (3.7974 => 4.3785)
MultiSource/Applications/JM/lencod/lencod: 17.80% (7.9437 => 9.3575)
MultiSource/Applications/SIBsim4/SIBsim4: 15.65% (0.6605 => 0.7639)
MultiSource/Applications/oggenc/oggenc: 18.02% (1.6803 => 1.9831)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.43% (3.5777 => 3.9865)
MultiSource/Benchmarks/Bullet/bullet: 5.09% (3.2995 => 3.4673)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.33% (0.4721 => 0.5539)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 84.77% (0.3447 => 0.6369)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.14% (1.1793 => 1.2517)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.18% (1.5639 => 2.4425)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 73.12% (0.3378 => 0.5848)
MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (1.1999 => 1.3510)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.35% (0.2815 => 0.3050)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.5512 => 0.5809)
MultiSource/Benchmarks/Ptrdist/bc/bc: 15.31% (0.7896 => 0.9105)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.77% (0.3797 => 0.4092)
MultiSource/Benchmarks/mafft/pairlocalalign: 12.66% (2.1295 => 2.3992)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 71.60% (0.3387 => 0.5812)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (1.0344 => 1.0888)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.77% (0.6594 => 0.7238)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.58% (1.7026 => 1.8827)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.06% (0.2384 => 0.2910)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.19% (0.2260 => 0.2513)
JIT:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 16.94% (4.3100 => 5.0400)
Externals/SPEC/CFP2006/433_milc/433_milc: 15.13% (10.6400 => 12.2500)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -8.98% (11.0300 => 10.0400)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 12.93% (25.3700 => 28.6500)
MultiSource/Applications/ClamAV/clamscan: 24.03% (4.9100 => 6.0900)
MultiSource/Applications/JM/ldecod/ldecod: 14.75% (3.0500 => 3.5000)
MultiSource/Applications/JM/lencod/lencod: 6.39% (14.8600 => 15.8100)
MultiSource/Applications/aha/aha: -6.60% (3.0300 => 2.8300)
MultiSource/Applications/oggenc/oggenc: 12.66% (1.5800 => 1.7800)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (8.2500 => 8.6800)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.21% (6.7600 => 7.1800)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.00% (0.6000 => 0.6900)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.18% (2.5800 => 2.9200)
MultiSource/Benchmarks/McCat/18-imp/imp: 8.33% (0.2400 => 0.2600)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 65.85% (0.4100 => 0.6800)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.35% (0.6300 => 0.6700)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 50.96% (1.5700 => 2.3700)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 50.00% (0.4600 => 0.6900)
MultiSource/Benchmarks/PAQ8p/paq8p: 20.95% (98.8900 => 119.6100)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.33% (0.2400 => 0.2600)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.88% (0.3400 => 0.3600)
MultiSource/Benchmarks/Ptrdist/bc/bc: 6.43% (1.7100 => 1.8200)
MultiSource/Benchmarks/SciMark2-C/scimark2: 12.51% (25.0100 => 28.1400)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.05% (0.8300 => 0.7300)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.62% (1.1600 => 1.2600)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -6.42% (5.1400 => 4.8100)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 88.89% (0.2700 => 0.5100)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (0.7000 => 0.7500)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.62% (0.5200 => 0.5700)
MultiSource/Benchmarks/sim/sim: -7.51% (7.1900 => 6.6500)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.68% (3.1700 => 3.3500)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.74% (4.6500 => 5.0100)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -13.69% (3.5800 => 3.0900)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -15.79% (0.5700 => 0.4800)
SingleSource/Benchmarks/CoyoteBench/huffbench: 25.97% (15.9400 => 20.0800)
SingleSource/Benchmarks/Dhrystone/fldry: -6.25% (0.6400 => 0.6000)
SingleSource/Benchmarks/McGill/chomp: -18.58% (1.1300 => 0.9200)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.68% (4.8400 => 5.2600)
SingleSource/Benchmarks/Misc/lowercase: 14.32% (8.0300 => 9.1800)
SingleSource/Benchmarks/Misc/mandel-2: -5.83% (1.0300 => 0.9700)
SingleSource/Benchmarks/Shootout/lists: 19.16% (6.1600 => 7.3400)
LLC:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 17.11% (3.3900 => 3.9700)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -9.68% (10.7400 => 9.7000)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 10.83% (21.0600 => 23.3400)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 5.38% (1.8600 => 1.9600)
MultiSource/Applications/SIBsim4/SIBsim4: -6.45% (5.7400 => 5.3700)
MultiSource/Applications/aha/aha: -5.04% (2.7800 => 2.6400)
MultiSource/Applications/hexxagon/hexxagon: 5.34% (9.1800 => 9.6700)
MultiSource/Applications/sgefa/sgefa: -9.21% (0.7600 => 0.6900)
MultiSource/Benchmarks/Olden/tsp/tsp: 111.57% (1.2100 => 2.5600)
MultiSource/Benchmarks/SciMark2-C/scimark2: 12.05% (25.1400 => 28.1700)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -5.54% (5.0500 => 4.7700)
MultiSource/Benchmarks/sim/sim: -6.23% (6.5800 => 6.1700)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -16.29% (3.5600 => 2.9800)
SingleSource/Benchmarks/BenchmarkGame/n-body: -5.13% (1.9500 => 1.8500)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -19.64% (0.5600 => 0.4500)
SingleSource/Benchmarks/CoyoteBench/huffbench: 25.64% (16.3800 => 20.5800)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.32% (4.5100 => 4.7500)
SingleSource/Benchmarks/Misc/lowercase: 5.39% (8.1700 => 8.6100)
SingleSource/Benchmarks/Misc/mandel-2: 9.28% (0.9700 => 1.0600)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.33% (0.4800 => 0.5200)
LLC-BETA compile:
Externals/Nurbs/nurbs: 8.72% (0.8869 => 0.9642)
Externals/SPEC/CFP2000/177_mesa/177_mesa: 8.21% (5.6648 => 6.1296)
Externals/SPEC/CFP2000/188_ammp/188_ammp: 9.22% (1.6959 => 1.8522)
Externals/SPEC/CFP2006/433_milc/433_milc: 128.06% (1.0352 => 2.3609)
Externals/SPEC/CFP2006/447_dealII/447_dealII: 7.68% (6.5960 => 7.1028)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 9.89% (0.4631 => 0.5089)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 17.22% (0.4025 => 0.4718)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 12.23% (1.2273 => 1.3774)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 30.75% (6.2898 => 8.2242)
MultiSource/Applications/JM/ldecod/ldecod: 15.30% (3.8016 => 4.3832)
MultiSource/Applications/JM/lencod/lencod: 17.49% (7.9558 => 9.3470)
MultiSource/Applications/SIBsim4/SIBsim4: 16.39% (0.6571 => 0.7648)
MultiSource/Applications/oggenc/oggenc: 18.06% (1.6819 => 1.9857)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.89% (3.5769 => 4.0023)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 86.32% (0.3429 => 0.6389)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.92% (1.1801 => 1.2500)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.11% (1.5614 => 2.4375)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 73.76% (0.3384 => 0.5880)
MultiSource/Benchmarks/PAQ8p/paq8p: 11.89% (1.2053 => 1.3486)
MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.5821 => 0.6123)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.43% (0.2788 => 0.3051)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.66% (0.3813 => 0.4067)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.10% (0.5514 => 0.5795)
MultiSource/Benchmarks/Ptrdist/bc/bc: 14.36% (0.7999 => 0.9148)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.37% (0.3827 => 0.4109)
MultiSource/Benchmarks/mafft/pairlocalalign: 11.49% (2.1717 => 2.4212)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 71.37% (0.3430 => 0.5878)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.14% (1.0238 => 1.0969)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.21% (0.6668 => 0.7282)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.60% (1.7053 => 1.8860)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 20.70% (0.2396 => 0.2892)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.61% (0.2261 => 0.2546)
More information about the llvm-testresults
mailing list