[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Dec 23 02:37:37 PST 2009 

http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3996/
Name:  grawp.apple.com
Nickname: Grawp:4

Run: 3996, Start Time: 2009-12-23 00:19:02, End Time: 2009-12-23 02:37:10
Comparing To: 3968, Start Time: 2009-12-22 00:19:32, End Time: 2009-12-22 03:28:59

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 686
Added Tests: 0
Removed Tests: 0
Significant Changes: 5

--- Tests Summary ---
Total Tests: 3888
Total Test Failures: 829

Total Test Failures By Type:
  Bitcode: 81
  CBE: 118
  GCCAS: 80
  JIT: 106
  JIT codegen: 120
  LLC: 81
  LLC compile: 81
  LLC-BETA: 81
  LLC_BETA compile: 81

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/Povray/povray [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/175_vpr/175_vpr [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/300_twolf/300_twolf [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT, CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/ClamAV/clamscan [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/JM/ldecod/ldecod [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/JM/lencod/lencod [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/SIBsim4/SIBsim4 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/SPASS/SPASS [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/d/make_dparser [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/lemon/lemon [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/lua/lua [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/oggenc/oggenc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/siod/siod [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/spiff/spiff [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/sqlite3/sqlite3 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/treecc/treecc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/viterbi/viterbi [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pifft/pifft [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/cfrac/cfrac [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/espresso/espresso [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/gs/gs [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/McCat/03-testtrie/testtrie [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/McCat/04-bisect/bisect [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/McCat/15-trie/trie [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/McCat/18-imp/imp [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/security-sha/security-sha [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/agrep/agrep [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/assembler/assembler [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/loader/loader [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/simulator/simulator [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Ptrdist/bc/bc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/VersaBench/dbms/dbms [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/mafft/pairlocalalign [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/BenchmarkGame/fasta [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/CoyoteBench/huffbench [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Dhrystone/dry [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Dhrystone/fldry [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/McGill/misr [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Misc/ffbench [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Misc/lowercase [CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Misc/oourafft [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Shootout/strcat [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
JIT:
 SingleSource/Benchmarks/Misc/fbench: 7.36% (2.3100 => 2.4800)
LLC compile:
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 5.74% (0.2021 => 0.2137)
LLC-BETA:
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 9.82% (2.8500 => 3.1300)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.9600 => 1.0100)
CBE:
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 14.48% (2.9700 => 3.4000)

More information about the llvm-testresults mailing list