[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Tue Feb 2 04:20:22 PST 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5110/
Name:  grawp.apple.com
Nickname: Grawp:4

Run: 5110, Start Time: 2010-02-02 00:48:51, End Time: 2010-02-02 04:19:46
Comparing To: 5106, Start Time: 2010-02-01 00:39:39, End Time: 2010-02-02 00:48:51

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 41
Added Tests: 315
Removed Tests: 0
Significant Changes: 44

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 125

Total Test Failures By Type:
  CBE: 43
  JIT: 25
  JIT codegen: 57

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT codegen]
Externals/SPEC/CFP2000/179_art/179_art [JIT codegen]
Externals/SPEC/CFP2000/183_equake/183_equake [JIT codegen]
Externals/SPEC/CFP2000/188_ammp/188_ammp [JIT codegen]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT codegen]
Externals/SPEC/CFP2006/444_namd/444_namd [CBE, JIT codegen]
Externals/SPEC/CFP2006/447_dealII/447_dealII [CBE, JIT codegen]
Externals/SPEC/CFP2006/450_soplex/450_soplex [CBE, JIT codegen]
Externals/SPEC/CFP2006/470_lbm/470_lbm [JIT codegen]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT codegen]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT codegen]
Externals/SPEC/CINT2000/176_gcc/176_gcc [CBE, JIT codegen]
Externals/SPEC/CINT2000/181_mcf/181_mcf [JIT codegen]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT codegen]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT codegen]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT codegen]
Externals/SPEC/CINT2000/254_gap/254_gap [JIT codegen]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT codegen]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT codegen]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT codegen]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [CBE, JIT codegen]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT codegen]
Externals/SPEC/CINT2006/403_gcc/403_gcc [CBE, JIT codegen]
Externals/SPEC/CINT2006/429_mcf/429_mcf [JIT codegen]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT codegen]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT codegen]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT codegen]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [JIT codegen]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT codegen]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [JIT, CBE, JIT codegen]
Externals/SPEC/CINT2006/473_astar/473_astar [JIT codegen]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT codegen]

Added Tests:
Externals/Nurbs/nurbs [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/Povray/povray [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2000/179_art/179_art [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2000/183_equake/183_equake [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2000/188_ammp/188_ammp [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2006/444_namd/444_namd [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2006/450_soplex/450_soplex [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2006/470_lbm/470_lbm [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/181_mcf/181_mcf [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/254_gap/254_gap [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/429_mcf/429_mcf [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/473_astar/473_astar [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]

Removed Tests:

Significant Changes in Test Results:
JIT codegen:
 MultiSource/Benchmarks/Bullet/bullet: -11.29% (2.4520 => 2.1751)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.04% (5.0941 => 4.8372)
CBE:
 MultiSource/Benchmarks/Fhourstones/fhourstones: 9.32% (1.6100 => 1.7600)
 MultiSource/Benchmarks/Olden/health/health: 5.71% (0.3500 => 0.3700)
 MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.32% (0.4100 => 0.4400)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 8.08% (0.9900 => 1.0700)
 SingleSource/Benchmarks/Dhrystone/dry: 6.90% (0.2900 => 0.3100)
LLC-BETA:
 MultiSource/Applications/kimwitu++/kc: 6.67% (0.3000 => 0.3200)
 MultiSource/Applications/lemon/lemon: 5.13% (1.9500 => 2.0500)
 MultiSource/Benchmarks/Bullet/bullet: -17.44% (9.4600 => 7.8100)
 MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (1.4100 => 1.5600)
 MultiSource/Benchmarks/Olden/health/health: 5.71% (0.3500 => 0.3700)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 11.70% (0.9400 => 1.0500)
 SingleSource/Benchmarks/Shootout/ary3: 34.65% (4.0400 => 5.4400)
 SingleSource/Benchmarks/Shootout/hash: 9.05% (6.8500 => 7.4700)
LLC compile:
 MultiSource/Applications/hbd/hbd: 5.72% (0.5193 => 0.5490)
 MultiSource/Applications/treecc/treecc: 5.27% (1.4429 => 1.5189)
 MultiSource/Benchmarks/Bullet/bullet: -12.33% (3.8982 => 3.4177)
 MultiSource/Benchmarks/mafft/pairlocalalign: -8.12% (2.3189 => 2.1307)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.70% (6.1643 => 5.8129)
GCCAS:
 MultiSource/Applications/lemon/lemon: 6.12% (0.4642 => 0.4926)
 MultiSource/Benchmarks/Bullet/bullet: -9.85% (12.3173 => 11.1037)
 MultiSource/Benchmarks/mafft/pairlocalalign: -10.68% (5.8536 => 5.2285)
JIT:
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.42% (8.2500 => 8.7800)
 MultiSource/Benchmarks/Bullet/bullet: -18.99% (12.8500 => 10.4100)
 MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.38% (2.2300 => 2.3500)
 MultiSource/Benchmarks/Fhourstones/fhourstones: 11.76% (1.5300 => 1.7100)
 MultiSource/Benchmarks/McCat/09-vor/vor: 11.11% (0.2700 => 0.3000)
 MultiSource/Benchmarks/mafft/pairlocalalign: -9.93% (33.6400 => 30.3000)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.51% (6.7200 => 6.3500)
 SingleSource/Benchmarks/McGill/chomp: 6.48% (1.0800 => 1.1500)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.26% (4.7900 => 5.0900)
 SingleSource/Benchmarks/Misc/fbench: 6.78% (2.3600 => 2.5200)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -9.39% (3.0900 => 2.8000)
LLC:
 MultiSource/Applications/kimwitu++/kc: 6.67% (0.3000 => 0.3200)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.78% (5.5300 => 5.9600)
 MultiSource/Benchmarks/Bullet/bullet: -21.04% (9.8400 => 7.7700)
 MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.58% (2.1500 => 2.2700)
 MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (1.4400 => 1.5500)
 SingleSource/Benchmarks/Shootout-C++/methcall: 6.72% (5.3600 => 5.7200)
LLC-BETA compile:
 MultiSource/Benchmarks/Bullet/bullet: -11.58% (3.8553 => 3.4089)
 MultiSource/Benchmarks/mafft/pairlocalalign: -8.04% (2.3376 => 2.1496)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.11% (0.5992 => 0.6298)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.90% (6.1149 => 5.6929)

More information about the llvm-testresults mailing list