[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Fri Jul 17 04:34:51 PDT 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//719
Name:  grawp.apple.com
Nickname: Grawp:3
Buildstatus: OK

Run: 719, Start Time: 2009-07-17 00:30:36
Comparing To: 704, Start Time: 2009-07-16 00:36:03

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 164
Added Tests: 108
Removed Tests: 0
Significant Changes: 6

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 221

Total Test Failures By Type:
  CBE: 163
  JIT: 25
  JIT codegen: 25
  LLC: 2
  LLC compile: 2
  LLC-BETA: 2
  LLC_BETA compile: 2

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/Nurbs/nurbs [CBE]
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE]
Externals/SPEC/CFP2000/179_art/179_art [CBE]
Externals/SPEC/CFP2000/183_equake/183_equake [CBE]
Externals/SPEC/CFP2006/470_lbm/470_lbm [CBE]
Externals/SPEC/CINT2000/164_gzip/164_gzip [CBE]
Externals/SPEC/CINT2000/175_vpr/175_vpr [CBE]
Externals/SPEC/CINT2000/186_crafty/186_crafty [CBE]
Externals/SPEC/CINT2000/197_parser/197_parser [CBE]
Externals/SPEC/CINT2000/252_eon/252_eon [CBE]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [CBE]
Externals/SPEC/CINT2000/254_gap/254_gap [CBE]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [CBE]
Externals/SPEC/CINT2000/300_twolf/300_twolf [CBE]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [CBE]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [CBE]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [CBE]
Externals/SPEC/CINT2006/473_astar/473_astar [CBE]
MultiSource/Applications/ClamAV/clamscan [CBE]
MultiSource/Applications/JM/ldecod/ldecod [CBE]
MultiSource/Applications/JM/lencod/lencod [CBE]
MultiSource/Applications/SPASS/SPASS [CBE]
MultiSource/Applications/kimwitu++/kc [CBE]
MultiSource/Applications/lemon/lemon [CBE]
MultiSource/Applications/oggenc/oggenc [CBE]
MultiSource/Applications/sgefa/sgefa [CBE]
MultiSource/Applications/siod/siod [CBE]
MultiSource/Applications/treecc/treecc [CBE]
MultiSource/Applications/viterbi/viterbi [CBE]
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 [CBE]
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk [CBE]
MultiSource/Benchmarks/BitBench/drop3/drop3 [CBE]
MultiSource/Benchmarks/BitBench/five11/five11 [CBE]
MultiSource/Benchmarks/BitBench/uudecode/uudecode [CBE]
MultiSource/Benchmarks/BitBench/uuencode/uuencode [CBE]
MultiSource/Benchmarks/FreeBench/analyzer/analyzer [CBE]
MultiSource/Benchmarks/FreeBench/neural/neural [CBE]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [CBE]
MultiSource/Benchmarks/FreeBench/pifft/pifft [CBE]
MultiSource/Benchmarks/MallocBench/cfrac/cfrac [CBE]
MultiSource/Benchmarks/MallocBench/espresso/espresso [CBE]
MultiSource/Benchmarks/McCat/01-qbsort/qbsort [CBE]
MultiSource/Benchmarks/McCat/03-testtrie/testtrie [CBE]
MultiSource/Benchmarks/McCat/04-bisect/bisect [CBE]
MultiSource/Benchmarks/McCat/05-eks/eks [CBE]
MultiSource/Benchmarks/McCat/08-main/main [CBE]
MultiSource/Benchmarks/McCat/09-vor/vor [CBE]
MultiSource/Benchmarks/McCat/12-IOtest/iotest [CBE]
MultiSource/Benchmarks/McCat/17-bintr/bintr [CBE]
MultiSource/Benchmarks/McCat/18-imp/imp [CBE]
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan [CBE]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [CBE]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [CBE]
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra [CBE]
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia [CBE]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE]
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft [CBE]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [CBE]
MultiSource/Benchmarks/Olden/bh/bh [CBE]
MultiSource/Benchmarks/Olden/bisort/bisort [CBE]
MultiSource/Benchmarks/Olden/em3d/em3d [CBE]
MultiSource/Benchmarks/Olden/health/health [CBE]
MultiSource/Benchmarks/Olden/mst/mst [CBE]
MultiSource/Benchmarks/Olden/perimeter/perimeter [CBE]
MultiSource/Benchmarks/Olden/power/power [CBE]
MultiSource/Benchmarks/Olden/treeadd/treeadd [CBE]
MultiSource/Benchmarks/Olden/tsp/tsp [CBE]
MultiSource/Benchmarks/Olden/voronoi/voronoi [CBE]
MultiSource/Benchmarks/Prolangs-C++/city/city [CBE]
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc [CBE]
MultiSource/Benchmarks/Prolangs-C/agrep/agrep [CBE]
MultiSource/Benchmarks/Prolangs-C/assembler/assembler [CBE]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [CBE]
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl [CBE]
MultiSource/Benchmarks/Prolangs-C/loader/loader [CBE]
MultiSource/Benchmarks/Prolangs-C/simulator/simulator [CBE]
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail [CBE]
MultiSource/Benchmarks/Ptrdist/anagram/anagram [CBE]
MultiSource/Benchmarks/Ptrdist/bc/bc [CBE]
MultiSource/Benchmarks/Ptrdist/ft/ft [CBE]
MultiSource/Benchmarks/Ptrdist/ks/ks [CBE]
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 [CBE]
MultiSource/Benchmarks/SciMark2-C/scimark2 [CBE]
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc [CBE]
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url [CBE]
MultiSource/Benchmarks/VersaBench/8b10b/8b10b [CBE]
MultiSource/Benchmarks/VersaBench/beamformer/beamformer [CBE]
MultiSource/Benchmarks/VersaBench/dbms/dbms [CBE]
MultiSource/Benchmarks/llubenchmark/llu [CBE]
MultiSource/Benchmarks/mafft/pairlocalalign [CBE]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [CBE]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [CBE]
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode [CBE]
MultiSource/Benchmarks/sim/sim [CBE]
SingleSource/Benchmarks/BenchmarkGame/fasta [CBE]
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits [CBE]
SingleSource/Benchmarks/BenchmarkGame/puzzle [CBE]
SingleSource/Benchmarks/CoyoteBench/huffbench [CBE]
SingleSource/Benchmarks/CoyoteBench/lpbench [CBE]
SingleSource/Benchmarks/Dhrystone/dry [CBE]
SingleSource/Benchmarks/Dhrystone/fldry [CBE]
SingleSource/Benchmarks/McGill/chomp [CBE]
SingleSource/Benchmarks/McGill/misr [CBE]
SingleSource/Benchmarks/Misc/ffbench [CBE]
SingleSource/Benchmarks/Misc/himenobmtxpa [CBE]
SingleSource/Benchmarks/Misc/oourafft [CBE]
SingleSource/Benchmarks/Misc/richards_benchmark [CBE]
SingleSource/Benchmarks/Shootout-C++/heapsort [CBE]
SingleSource/Benchmarks/Shootout-C++/matrix [CBE]
SingleSource/Benchmarks/Shootout/hash [CBE]
SingleSource/Benchmarks/Shootout/heapsort [CBE]
SingleSource/Benchmarks/Shootout/lists [CBE]
SingleSource/Benchmarks/Shootout/matrix [CBE]
SingleSource/Benchmarks/Shootout/methcall [CBE]
SingleSource/Benchmarks/Shootout/objinst [CBE]
SingleSource/Benchmarks/Stanford/Treesort [CBE]
SingleSource/Regression/C/sumarray [CBE]
SingleSource/Regression/C/sumarraymalloc [CBE]
SingleSource/UnitTests/ObjC/constant-strings [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/dot-syntax [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/dot-syntax-1 [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/dot-syntax-2 [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/exceptions [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/ObjC/for-in [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/messages [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/messages-2 [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/predefined-expr-in-method [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/property [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/protocols [JIT, CBE, JIT codegen]
SingleSource/UnitTests/ObjC/synchronized [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/SignlessTypes/cast [CBE]

Added Tests:
SingleSource/UnitTests/ObjC/constant-strings [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/dot-syntax [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/dot-syntax-1 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/dot-syntax-2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/exceptions [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/for-in [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/messages [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/messages-2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/predefined-expr-in-method [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/property [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/protocols [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/UnitTests/ObjC/synchronized [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]

Removed Tests:

Significant Changes in Test Results:
LLC:
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.20% (5.0000 => 4.5900)
Bitcode:
 SingleSource/UnitTests/ObjC/parameter-passing: 27.14% (12320.0000 => 15664.0000)
JIT:
 MultiSource/Applications/sgefa/sgefa: -9.20% (0.8700 => 0.7900)
 SingleSource/Benchmarks/McGill/chomp: 5.56% (1.0800 => 1.1400)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -20.50% (3.1700 => 2.5200)
LLC-BETA:
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 8.70% (0.2300 => 0.2500)



More information about the llvm-testresults mailing list