[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Sun Apr 25 08:23:24 PDT 2010


http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/7637/
Nickname: Grawp-NO-LTO-PIC:5
Name:  grawp.apple.com

Run: 7637, Start Time: 2010-04-25 04:24:29, End Time: 2010-04-25 08:23:14
Comparing To: 7591, Start Time: 2010-04-23 08:15:57, End Time: 2010-04-23 12:09:28

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 128
Added Tests: 396
Removed Tests: 0
Significant Changes: 9

--- Tests Summary ---
Total Tests: 3987
Total Test Failures: 1005

Total Test Failures By Type:
  CBE: 103
  JIT: 443
  JIT codegen: 443
  LLC: 4
  LLC compile: 4
  LLC-BETA: 4
  LLC_BETA compile: 4

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/Nurbs/nurbs [JIT codegen, JIT]
Externals/Povray/povray [JIT codegen, JIT, CBE]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT codegen, JIT]
Externals/SPEC/CFP2000/179_art/179_art [JIT codegen, JIT, CBE]
Externals/SPEC/CFP2000/183_equake/183_equake [JIT codegen, JIT]
Externals/SPEC/CFP2000/188_ammp/188_ammp [JIT codegen, JIT, CBE]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT codegen, JIT, CBE]
Externals/SPEC/CFP2006/444_namd/444_namd [JIT codegen, JIT, CBE]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT codegen, JIT, CBE]
Externals/SPEC/CFP2006/450_soplex/450_soplex [JIT codegen, JIT, CBE]
Externals/SPEC/CFP2006/470_lbm/470_lbm [JIT codegen, JIT]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT codegen, JIT]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2000/181_mcf/181_mcf [JIT codegen, JIT]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT codegen, JIT]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT codegen, JIT]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen, JIT]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2000/254_gap/254_gap [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT codegen, JIT]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2006/429_mcf/429_mcf [JIT codegen, JIT]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT codegen, JIT]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT codegen, JIT]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [JIT codegen, JIT]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [JIT codegen, JIT, CBE]
Externals/SPEC/CINT2006/473_astar/473_astar [JIT codegen, JIT]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT95/099_go/099_go [JIT codegen, JIT, CBE]
Externals/SPEC/CINT95/124_m88ksim/124_m88ksim [JIT codegen, JIT, CBE]
Externals/SPEC/CINT95/126_gcc/126_gcc [JIT codegen, JIT, CBE]
Externals/SPEC/CINT95/129_compress/129_compress [JIT codegen, JIT, CBE]
Externals/SPEC/CINT95/130_li/130_li [JIT codegen, JIT, CBE]
Externals/SPEC/CINT95/132_ijpeg/132_ijpeg [JIT codegen, JIT, CBE]
Externals/SPEC/CINT95/134_perl/134_perl [JIT codegen, JIT, CBE]
Externals/SPEC/CINT95/147_vortex/147_vortex [JIT codegen, JIT]
SingleSource/UnitTests/ObjC/exceptions-2 [JIT codegen, JIT, CBE]
SingleSource/UnitTests/ObjC/print-class-info [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/ObjC/protocols [LLC, LLC-BETA, LLC compile, LLC_BETA compile]

Added Tests:
Externals/Nurbs/nurbs [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/Povray/povray [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/179_art/179_art [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/183_equake/183_equake [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2000/188_ammp/188_ammp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/444_namd/444_namd [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/450_soplex/450_soplex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CFP2006/470_lbm/470_lbm [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/181_mcf/181_mcf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/254_gap/254_gap [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/429_mcf/429_mcf [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/473_astar/473_astar [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/099_go/099_go [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/124_m88ksim/124_m88ksim [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/126_gcc/126_gcc [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/129_compress/129_compress [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/130_li/130_li [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/132_ijpeg/132_ijpeg [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/134_perl/134_perl [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
Externals/SPEC/CINT95/147_vortex/147_vortex [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
SingleSource/UnitTests/ObjC/exceptions-2 [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]

Removed Tests:

Significant Changes in Test Results:
LLC:
 MultiSource/Applications/hexxagon/hexxagon: -10.07% (15.2900 => 13.7500)
 SingleSource/Benchmarks/Shootout-C++/methcall: 7.23% (7.3300 => 7.8600)
Bitcode:
 SingleSource/Benchmarks/Misc/ReedSolomon: 5.00% (9920.0000 => 10416.0000)
LLC-BETA:
 MultiSource/Applications/hexxagon/hexxagon: -9.70% (15.2500 => 13.7700)
 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -23.88% (1.3400 => 1.0200)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.26% (1.5200 => 1.6000)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.43% (4.0500 => 4.2700)
 SingleSource/Benchmarks/Misc/whetstone: -5.16% (1.5500 => 1.4700)
CBE:
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.47% (5.1200 => 5.4000)



More information about the llvm-testresults mailing list