[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Tue Mar 9 04:05:55 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/6096/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 6096, Start Time: 2010-03-09 00:46:58, End Time: 2010-03-09 04:05:42
Comparing To: 6067, Start Time: 2010-03-08 00:39:21, End Time: 2010-03-08 03:53:04
--- Changes Summary ---
New Test Passes: 2
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 147
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 128
Total Test Failures By Type:
CBE: 46
JIT: 25
JIT codegen: 57
--- Changes Detail ---
New Test Passes:
Externals/Nurbs/nurbs [LLC-BETA, LLC_BETA compile]
New Test Failures:
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1248.0000 => 1184.0000)
JIT codegen:
MultiSource/Applications/JM/ldecod/ldecod: 6.15% (3.8684 => 4.1064)
MultiSource/Applications/JM/lencod/lencod: 6.02% (8.2207 => 8.7159)
MultiSource/Applications/treecc/treecc: 6.41% (0.4163 => 0.4430)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.81% (1.9167 => 2.0663)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -16.76% (0.9767 => 0.8130)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.76% (0.2084 => 0.2204)
CBE:
Externals/SPEC/CFP2006/433_milc/433_milc: 9.18% (9.7000 => 10.5900)
Externals/SPEC/CINT2000/197_parser/197_parser: 18.60% (2.5800 => 3.0600)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 7.66% (4.5700 => 4.9200)
MultiSource/Applications/SPASS/SPASS: 16.83% (7.9600 => 9.3000)
MultiSource/Applications/oggenc/oggenc: 9.52% (0.2100 => 0.2300)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -54.28% (401.0800 => 183.3600)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 12.40% (1.2100 => 1.3600)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 5.45% (0.5500 => 0.5800)
SingleSource/Benchmarks/CoyoteBench/fftbench: 11.65% (2.6600 => 2.9700)
SingleSource/Benchmarks/CoyoteBench/lpbench: 18.42% (10.1500 => 12.0200)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.41% (5.0500 => 6.0300)
SingleSource/Benchmarks/Shootout-C++/methcall: -5.80% (7.0700 => 6.6600)
LLC-BETA:
Externals/SPEC/CFP2006/433_milc/433_milc: 15.27% (9.5600 => 11.0200)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 5.56% (3.4200 => 3.6100)
Externals/SPEC/CINT2006/429_mcf/429_mcf: 6.21% (2.9000 => 3.0800)
MultiSource/Applications/SPASS/SPASS: 12.36% (8.0900 => 9.0900)
MultiSource/Applications/lemon/lemon: 5.03% (1.9900 => 2.0900)
MultiSource/Benchmarks/Olden/health/health: 5.71% (0.3500 => 0.3700)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.08% (1.0700 => 1.2100)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.33% (1.2300 => 1.4800)
SingleSource/Benchmarks/CoyoteBench/fftbench: 11.15% (2.7800 => 3.0900)
SingleSource/Benchmarks/CoyoteBench/lpbench: 19.42% (9.7300 => 11.6200)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.84% (4.4500 => 5.6000)
SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.9400 => 1.0000)
LLC compile:
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -10.96% (11.9061 => 10.6008)
MultiSource/Applications/JM/lencod/lencod: 5.11% (11.1157 => 11.6836)
MultiSource/Applications/SIBsim4/SIBsim4: 5.10% (0.9693 => 1.0187)
MultiSource/Applications/SPASS/SPASS: 5.09% (8.1874 => 8.6042)
MultiSource/Applications/lemon/lemon: 5.13% (0.6866 => 0.7218)
MultiSource/Applications/siod/siod: 5.83% (2.5143 => 2.6608)
MultiSource/Applications/spiff/spiff: 5.09% (0.4581 => 0.4814)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.82% (2.0763 => 2.2387)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -15.48% (1.0294 => 0.8701)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.88% (0.2215 => 0.2456)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.38% (0.2527 => 0.2764)
GCCAS:
Externals/Povray/povray: 10.58% (7.1229 => 7.8765)
Externals/SPEC/CFP2000/177_mesa/177_mesa: 11.53% (4.7594 => 5.3082)
Externals/SPEC/CFP2000/183_equake/183_equake: 16.95% (0.2319 => 0.2712)
Externals/SPEC/CFP2000/188_ammp/188_ammp: 5.13% (2.9008 => 3.0496)
Externals/SPEC/CFP2006/433_milc/433_milc: 6.00% (1.3654 => 1.4473)
Externals/SPEC/CFP2006/444_namd/444_namd: 11.75% (3.0786 => 3.4403)
Externals/SPEC/CFP2006/447_dealII/447_dealII: 9.23% (38.5968 => 42.1581)
Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.04% (3.5640 => 3.7436)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 10.78% (0.5363 => 0.5941)
Externals/SPEC/CINT2000/175_vpr/175_vpr: 14.25% (1.4980 => 1.7114)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 22.21% (17.7364 => 21.6754)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 23.82% (1.9192 => 2.3763)
Externals/SPEC/CINT2000/197_parser/197_parser: 9.31% (1.3938 => 1.5236)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 17.56% (5.6092 => 6.5941)
Externals/SPEC/CINT2000/254_gap/254_gap: 10.59% (5.9246 => 6.5523)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 21.90% (0.4114 => 0.5015)
Externals/SPEC/CINT2000/300_twolf/300_twolf: 18.20% (2.2721 => 2.6857)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 17.65% (11.6654 => 13.7248)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 29.25% (1.0966 => 1.4174)
Externals/SPEC/CINT2006/403_gcc/403_gcc: 14.60% (43.2446 => 49.5570)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 11.98% (8.0166 => 8.9771)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 9.82% (3.2218 => 3.5381)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 7.99% (1.0920 => 1.1792)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 18.96% (7.7508 => 9.2207)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 19.95% (5.2674 => 6.3185)
Externals/SPEC/CINT2006/473_astar/473_astar: 5.10% (0.3768 => 0.3960)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 5.29% (38.7775 => 40.8300)
MultiSource/Applications/ClamAV/clamscan: 21.77% (6.3610 => 7.7460)
MultiSource/Applications/JM/ldecod/ldecod: 21.14% (3.9325 => 4.7640)
MultiSource/Applications/JM/lencod/lencod: 15.84% (7.6735 => 8.8887)
MultiSource/Applications/SIBsim4/SIBsim4: 25.01% (0.7129 => 0.8912)
MultiSource/Applications/SPASS/SPASS: 22.07% (9.7434 => 11.8940)
MultiSource/Applications/d/make_dparser: 23.19% (1.6418 => 2.0226)
MultiSource/Applications/hbd/hbd: 9.60% (0.3468 => 0.3801)
MultiSource/Applications/lemon/lemon: 13.33% (0.4942 => 0.5601)
MultiSource/Applications/oggenc/oggenc: 12.18% (2.2662 => 2.5422)
MultiSource/Applications/siod/siod: 6.62% (0.8852 => 0.9438)
MultiSource/Applications/spiff/spiff: 13.78% (0.2830 => 0.3220)
MultiSource/Applications/sqlite3/sqlite3: 13.79% (4.8692 => 5.5408)
MultiSource/Applications/treecc/treecc: 14.40% (1.0383 => 1.1878)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.09% (4.1562 => 5.0326)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.66% (2.1054 => 2.2667)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.41% (1.8674 => 2.1738)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.47% (1.9169 => 2.1752)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 30.84% (6.7729 => 8.8615)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.04% (0.7668 => 0.8821)
MultiSource/Benchmarks/PAQ8p/paq8p: 5.96% (1.0895 => 1.1544)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.95% (2.5639 => 2.9472)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.98% (0.5509 => 0.6114)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.53% (0.5220 => 0.5561)
MultiSource/Benchmarks/Prolangs-C/football/football: 9.67% (0.4766 => 0.5227)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.98% (0.2153 => 0.2454)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.27% (0.4583 => 0.5191)
MultiSource/Benchmarks/Ptrdist/bc/bc: 20.62% (0.5117 => 0.6172)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.51% (0.3239 => 0.3450)
MultiSource/Benchmarks/mafft/pairlocalalign: 53.58% (5.6469 => 8.6725)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.80% (1.9008 => 2.1631)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.89% (0.6300 => 0.6986)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.46% (1.4021 => 1.5908)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.67% (1.2259 => 1.3445)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.17% (0.8030 => 0.9168)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 25.59% (0.3657 => 0.4593)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.75% (0.3390 => 0.3890)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.49% (0.4285 => 0.4649)
JIT:
MultiSource/Applications/JM/ldecod/ldecod: 6.18% (4.2100 => 4.4700)
MultiSource/Applications/SPASS/SPASS: 14.49% (13.3200 => 15.2500)
MultiSource/Applications/siod/siod: 12.47% (4.3300 => 4.8700)
MultiSource/Applications/treecc/treecc: 8.51% (0.4700 => 0.5100)
MultiSource/Applications/viterbi/viterbi: 5.70% (7.9000 => 8.3500)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.63% (0.7100 => 0.7500)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.00% (0.4000 => 0.3800)
MultiSource/Benchmarks/llubenchmark/llu: 6.48% (3.5500 => 3.7800)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.40% (2.5000 => 2.3400)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 17.46% (1.2600 => 1.4800)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.25% (0.4800 => 0.5100)
SingleSource/Benchmarks/CoyoteBench/fftbench: 12.06% (2.8200 => 3.1600)
SingleSource/Benchmarks/CoyoteBench/huffbench: -5.64% (20.2000 => 19.0600)
SingleSource/Benchmarks/CoyoteBench/lpbench: 11.93% (9.7200 => 10.8800)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.26% (4.8100 => 5.6400)
SingleSource/Benchmarks/Shootout/ary3: 5.91% (4.0600 => 4.3000)
SingleSource/Benchmarks/Shootout/heapsort: 5.97% (4.0200 => 4.2600)
LLC:
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -8.00% (0.2500 => 0.2300)
MultiSource/Applications/JM/lencod/lencod: 6.00% (8.8400 => 9.3700)
MultiSource/Applications/SPASS/SPASS: 20.81% (7.9300 => 9.5800)
MultiSource/Applications/siod/siod: 8.20% (3.1700 => 3.4300)
MultiSource/Applications/spiff/spiff: 7.62% (4.0700 => 4.3800)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.98% (6.0100 => 6.6700)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 16.26% (1.2300 => 1.4300)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.89% (0.4500 => 0.4900)
SingleSource/Benchmarks/CoyoteBench/fftbench: 11.59% (2.7600 => 3.0800)
SingleSource/Benchmarks/CoyoteBench/lpbench: 5.13% (9.7400 => 10.2400)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.20% (4.4700 => 5.0600)
SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.9200 => 0.9900)
SingleSource/Benchmarks/Shootout-C++/heapsort: 7.44% (4.0300 => 4.3300)
LLC-BETA compile:
Externals/SPEC/CINT2000/197_parser/197_parser: 9.84% (1.9060 => 2.0935)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -9.04% (11.7277 => 10.6676)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 5.71% (45.2027 => 47.7853)
MultiSource/Applications/d/make_dparser: 5.21% (1.5104 => 1.5891)
MultiSource/Applications/oggenc/oggenc: 6.40% (2.4214 => 2.5763)
MultiSource/Applications/treecc/treecc: 7.68% (1.7744 => 1.9107)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.06% (2.0910 => 2.2596)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -20.02% (1.0651 => 0.8519)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.54% (0.2240 => 0.2476)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.63% (0.2539 => 0.2758)
More information about the llvm-testresults
mailing list