[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Sat Apr 17 04:53:53 PDT 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/7403/
Nickname: Grawp:5
Name:  grawp.apple.com

Run: 7403, Start Time: 2010-04-17 00:34:17, End Time: 2010-04-17 04:53:39
Comparing To: 7364, Start Time: 2010-04-16 00:34:23, End Time: 2010-04-16 04:42:03

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 387
Significant Changes: 40

--- Tests Summary ---
Total Tests: 3582
Total Test Failures: 99

Total Test Failures By Type:
  CBE: 51
  JIT: 24
  JIT codegen: 24

--- Changes Detail ---
New Test Passes:

New Test Failures:

Added Tests:

Removed Tests:
Externals/Nurbs/nurbs [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/Povray/povray [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/179_art/179_art [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/183_equake/183_equake [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/188_ammp/188_ammp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/444_namd/444_namd [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/450_soplex/450_soplex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/470_lbm/470_lbm [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/181_mcf/181_mcf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/254_gap/254_gap [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/429_mcf/429_mcf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/473_astar/473_astar [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/099_go/099_go [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/124_m88ksim/124_m88ksim [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/126_gcc/126_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/129_compress/129_compress [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/130_li/130_li [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/132_ijpeg/132_ijpeg [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/134_perl/134_perl [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/147_vortex/147_vortex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]

Significant Changes in Test Results:
Bitcode:
 MultiSource/Applications/SPASS/SPASS: 8.72% (1542736.0000 => 1677296.0000)
 MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.55% (3424.0000 => 3888.0000)
 MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.02% (3440.0000 => 3888.0000)
 MultiSource/Benchmarks/McCat/15-trie/trie: 17.60% (3728.0000 => 4384.0000)
 MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.33% (3536.0000 => 3312.0000)
 MultiSource/Benchmarks/Olden/bisort/bisort: 39.07% (3440.0000 => 4784.0000)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.00% (6608.0000 => 8128.0000)
 MultiSource/Benchmarks/Olden/treeadd/treeadd: 13.76% (1744.0000 => 1984.0000)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.92% (544000.0000 => 500928.0000)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.80% (31312.0000 => 35632.0000)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 58.04% (2288.0000 => 3616.0000)
 SingleSource/Benchmarks/Shootout-C++/spellcheck: -8.84% (14848.0000 => 13536.0000)
 SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.15% (17392.0000 => 16496.0000)
 SingleSource/Benchmarks/Shootout/ackermann: -12.77% (1504.0000 => 1312.0000)
 SingleSource/Benchmarks/Shootout/fib2: 5.19% (1232.0000 => 1296.0000)
 SingleSource/Benchmarks/Stanford/Queens: 15.57% (1952.0000 => 2256.0000)
 SingleSource/Benchmarks/Stanford/Treesort: 23.48% (2112.0000 => 2608.0000)
JIT codegen:
 MultiSource/Applications/SPASS/SPASS: 7.42% (4.4901 => 4.8232)
CBE:
 MultiSource/Benchmarks/Olden/treeadd/treeadd: 1731.91% (0.4700 => 8.6100)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 19240.15% (2.5900 => 500.9100)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 12.20% (1.2300 => 1.3800)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -24.82% (1.3700 => 1.0300)
LLC-BETA:
 MultiSource/Applications/ClamAV/clamscan: 8.33% (0.2400 => 0.2600)
 MultiSource/Applications/hexxagon/hexxagon: -6.11% (8.8400 => 8.3000)
 MultiSource/Benchmarks/Olden/treeadd/treeadd: 1161.36% (0.4400 => 5.5500)
 MultiSource/Benchmarks/Ptrdist/ks/ks: 6.47% (1.7000 => 1.8100)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 5.76% (1.3900 => 1.4700)
 SingleSource/Benchmarks/Misc/fbench: -8.26% (2.4200 => 2.2200)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -20.26% (1.5300 => 1.2200)
GCCAS:
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.59% (4.1491 => 4.3809)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.27% (0.3583 => 0.3394)
JIT:
 MultiSource/Benchmarks/Olden/treeadd/treeadd: 1119.15% (0.4700 => 5.7300)
 SingleSource/Benchmarks/McGill/misr: 7.41% (0.2700 => 0.2900)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -13.17% (2.0500 => 1.7800)
 SingleSource/Benchmarks/Shootout/lists: 12.29% (7.1600 => 8.0400)
LLC:
 MultiSource/Applications/hexxagon/hexxagon: -6.23% (8.8300 => 8.2800)
 MultiSource/Benchmarks/Olden/treeadd/treeadd: 1202.33% (0.4300 => 5.6000)
 MultiSource/Benchmarks/Ptrdist/ks/ks: 7.06% (1.7000 => 1.8200)
 SingleSource/Benchmarks/Misc/fbench: -7.88% (2.4100 => 2.2200)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -20.26% (1.5300 => 1.2200)

More information about the llvm-testresults mailing list