[llvm-testresults] Grawp nightly tester results

Sat Apr 24 05:03:42 PDT 2010

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/7607/
Nickname: Grawp:5
Name:  grawp.apple.com

Run: 7607, Start Time: 2010-04-24 00:40:39, End Time: 2010-04-24 05:03:30
Comparing To: 7579, Start Time: 2010-04-23 00:24:57, End Time: 2010-04-23 04:41:52

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 64
Added Tests: 396
Removed Tests: 0
Significant Changes: 26

--- Tests Summary ---
Total Tests: 3987
Total Test Failures: 163

Total Test Failures By Type:
  CBE: 71
  JIT: 26
  JIT codegen: 66

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT codegen]
Externals/SPEC/CFP2000/179_art/179_art [JIT codegen, CBE]
Externals/SPEC/CFP2000/183_equake/183_equake [JIT codegen]
Externals/SPEC/CFP2000/188_ammp/188_ammp [JIT codegen, CBE]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT codegen]
Externals/SPEC/CFP2006/444_namd/444_namd [JIT codegen, CBE]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT codegen, CBE]
Externals/SPEC/CFP2006/450_soplex/450_soplex [JIT codegen, CBE]
Externals/SPEC/CFP2006/470_lbm/470_lbm [JIT codegen]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT codegen, CBE]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT codegen]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT codegen, CBE]
Externals/SPEC/CINT2000/181_mcf/181_mcf [JIT codegen]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT codegen]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT codegen]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT codegen]
Externals/SPEC/CINT2000/254_gap/254_gap [JIT codegen, CBE]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT codegen]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT codegen, CBE]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT codegen, CBE]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT codegen, CBE]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT codegen]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT codegen, CBE]
Externals/SPEC/CINT2006/429_mcf/429_mcf [JIT codegen]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT codegen]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT codegen]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT codegen]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [JIT codegen]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT codegen]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2006/473_astar/473_astar [JIT codegen]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT codegen, CBE]
Externals/SPEC/CINT95/099_go/099_go [JIT codegen, CBE]
Externals/SPEC/CINT95/124_m88ksim/124_m88ksim [JIT codegen, CBE]
Externals/SPEC/CINT95/126_gcc/126_gcc [JIT codegen, CBE]
Externals/SPEC/CINT95/129_compress/129_compress [JIT codegen]
Externals/SPEC/CINT95/130_li/130_li [JIT codegen, CBE]
Externals/SPEC/CINT95/132_ijpeg/132_ijpeg [JIT codegen, CBE]
Externals/SPEC/CINT95/134_perl/134_perl [JIT codegen]
Externals/SPEC/CINT95/147_vortex/147_vortex [JIT codegen]
SingleSource/UnitTests/ObjC/exceptions-2 [JIT codegen, JIT, CBE]

Added Tests:
Externals/Nurbs/nurbs [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/Povray/povray [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/179_art/179_art [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/183_equake/183_equake [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/188_ammp/188_ammp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/444_namd/444_namd [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/450_soplex/450_soplex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/470_lbm/470_lbm [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/181_mcf/181_mcf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/254_gap/254_gap [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/429_mcf/429_mcf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/473_astar/473_astar [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/099_go/099_go [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/124_m88ksim/124_m88ksim [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/126_gcc/126_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/129_compress/129_compress [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/130_li/130_li [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/132_ijpeg/132_ijpeg [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/134_perl/134_perl [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/147_vortex/147_vortex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
SingleSource/UnitTests/ObjC/exceptions-2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 MultiSource/Applications/JM/ldecod/ldecod: -13.19% (672432.0000 => 583728.0000)
 SingleSource/Benchmarks/Dhrystone/dry: -5.68% (1408.0000 => 1328.0000)
 SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1424.0000 => 1344.0000)
 SingleSource/Benchmarks/Misc/ReedSolomon: 5.47% (9952.0000 => 10496.0000)
 SingleSource/Benchmarks/Misc/whetstone: 6.97% (3216.0000 => 3440.0000)
JIT codegen:
 MultiSource/Applications/JM/ldecod/ldecod: -6.12% (3.5758 => 3.3570)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (1.7420 => 1.8527)
 MultiSource/Benchmarks/McCat/05-eks/eks: 6.14% (0.4460 => 0.4734)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -5.41% (1.1960 => 1.1313)
LLC-BETA:
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.05% (0.8700 => 0.9400)
 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -47.76% (0.6700 => 0.3500)
 SingleSource/Benchmarks/Dhrystone/dry: -28.85% (0.5200 => 0.3700)
 SingleSource/Benchmarks/Dhrystone/fldry: -11.94% (0.6700 => 0.5900)
GCCAS:
 MultiSource/Applications/JM/ldecod/ldecod: -11.27% (3.8977 => 3.4584)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 54.99% (0.3086 => 0.4783)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.5361 => 0.5635)
JIT:
 MultiSource/Applications/JM/ldecod/ldecod: -5.83% (3.6000 => 3.3900)
 MultiSource/Benchmarks/McCat/05-eks/eks: 6.82% (0.4400 => 0.4700)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 103.23% (1.2400 => 2.5200)
 MultiSource/Benchmarks/mafft/pairlocalalign: 6.10% (29.5100 => 31.3100)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 7.36% (1.6300 => 1.7500)
 SingleSource/Benchmarks/Dhrystone/dry: -13.33% (0.4500 => 0.3900)
 SingleSource/Benchmarks/Shootout/methcall: 5.25% (6.0900 => 6.4100)
LLC:
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.05% (0.8700 => 0.9400)
 SingleSource/Benchmarks/Dhrystone/dry: -28.85% (0.5200 => 0.3700)
 SingleSource/Benchmarks/Dhrystone/fldry: -11.94% (0.6700 => 0.5900)