[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Tue Oct 27 03:19:54 PDT 2009 

http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//2603
Name:  grawp.apple.com
Nickname: Grawp:4
Buildstatus: OK

Run: 2603, Start Time: 2009-10-27 00:35:50
Comparing To: 2586, Start Time: 2009-10-26 00:35:07

--- Changes Summary ---
New Test Passes: 6
New Test Failures: 365
Added Tests: 0
Removed Tests: 0
Significant Changes: 25

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 464

Total Test Failures By Type:
  Bitcode: 42
  CBE: 80
  GCCAS: 42
  JIT: 66
  JIT codegen: 66
  LLC: 42
  LLC compile: 42
  LLC-BETA: 42
  LLC_BETA compile: 42

--- Changes Detail ---
New Test Passes:
SingleSource/Benchmarks/Misc-C++/ray [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]

New Test Failures:
Externals/Povray/povray [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CFP2006/433_milc/433_milc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/164_gzip/164_gzip [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/186_crafty/186_crafty [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/255_vortex/255_vortex [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/ClamAV/clamscan [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/JM/ldecod/ldecod [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/JM/lencod/lencod [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/SIBsim4/SIBsim4 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/d/make_dparser [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/lemon/lemon [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/lua/lua [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/oggenc/oggenc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/siod/siod [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/sqlite3/sqlite3 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Applications/viterbi/viterbi [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/cfrac/cfrac [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MallocBench/gs/gs [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/security-sha/security-sha [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/McGill/misr [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Misc/ffbench [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Misc/oourafft [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -12.66% (48160.0000 => 42064.0000)
 MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.49% (7264.0000 => 6720.0000)
 SingleSource/Benchmarks/Shootout/strcat: 7.59% (1264.0000 => 1360.0000)
 SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 5.88% (816.0000 => 864.0000)
 SingleSource/Regression/C/PR640: 10.13% (1264.0000 => 1392.0000)
JIT codegen:
 Externals/Nurbs/nurbs: -5.30% (0.7948 => 0.7527)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.06% (0.2330 => 0.2212)
CBE:
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 12.59% (2.9400 => 3.3100)
 MultiSource/Benchmarks/llubenchmark/llu: -7.92% (3.6600 => 3.3700)
 SingleSource/Benchmarks/Dhrystone/fldry: 7.64% (3.0100 => 3.2400)
LLC-BETA:
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 5.24% (2.8600 => 3.0100)
 MultiSource/Applications/sgefa/sgefa: 8.57% (0.7000 => 0.7600)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.61% (0.8900 => 1.0200)
LLC compile:
 Externals/Nurbs/nurbs: -5.56% (0.8413 => 0.7945)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -31.59% (0.2928 => 0.2003)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.03% (0.2444 => 0.2321)
GCCAS:
 MultiSource/Applications/spiff/spiff: 5.56% (0.2664 => 0.2812)
JIT:
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 6.62% (3.0200 => 3.2200)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -28.12% (0.3200 => 0.2300)
 MultiSource/Benchmarks/mafft/pairlocalalign: -16.83% (38.6900 => 32.1800)
 SingleSource/Benchmarks/CoyoteBench/huffbench: 7.30% (18.2300 => 19.5600)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -9.35% (3.1000 => 2.8100)
LLC:
 MultiSource/Applications/kimwitu++/kc: 6.67% (0.3000 => 0.3200)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.61% (0.8900 => 1.0200)
LLC-BETA compile:
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -31.85% (0.2992 => 0.2039)

More information about the llvm-testresults mailing list