[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Thu Nov 19 03:50:56 PST 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3141/
Name:  grawp.apple.com
Nickname: Grawp:4
Buildstatus: OK

Run: 3141, Start Time: 2009-11-19 00:36:52
Comparing To: 3116, Start Time: 2009-11-18 00:08:04

--- Changes Summary ---
New Test Passes: 3
New Test Failures: 19
Added Tests: 0
Removed Tests: 0
Significant Changes: 87

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 121

Total Test Failures By Type:
  CBE: 55
  JIT: 25
  JIT codegen: 25
  LLC: 4
  LLC compile: 4
  LLC-BETA: 4
  LLC_BETA compile: 4

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE]
MultiSource/Applications/ClamAV/clamscan [CBE]
MultiSource/Benchmarks/PAQ8p/paq8p [CBE]

New Test Failures:
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count-2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/throw_rethrow_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C/2004-03-15-IndirectGoto [JIT, CBE, JIT codegen]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.96% (72176.0000 => 76480.0000)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -8.82% (69984.0000 => 63808.0000)
 MultiSource/Applications/spiff/spiff: 11.82% (52400.0000 => 58592.0000)
 MultiSource/Applications/sqlite3/sqlite3: -11.57% (1160304.0000 => 1026016.0000)
 MultiSource/Applications/viterbi/viterbi: 6.30% (5840.0000 => 6208.0000)
 MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 5.14% (3424.0000 => 3600.0000)
 MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.69% (4496.0000 => 4752.0000)
 MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.76% (4016.0000 => 4368.0000)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -12.53% (47776.0000 => 41792.0000)
 MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.28% (7248.0000 => 6720.0000)
 SingleSource/Benchmarks/Shootout/strcat: 7.59% (1264.0000 => 1360.0000)
 SingleSource/Regression/C/2004-03-15-IndirectGoto: -5.45% (880.0000 => 832.0000)
 SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 5.88% (816.0000 => 864.0000)
 SingleSource/UnitTests/SignlessTypes/cast-bug: 5.00% (640.0000 => 672.0000)
JIT codegen:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 7.14% (1.2656 => 1.3560)
 MultiSource/Applications/spiff/spiff: 6.12% (0.3039 => 0.3225)
 MultiSource/Applications/sqlite3/sqlite3: -6.47% (5.3181 => 4.9740)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.04% (0.5055 => 0.5714)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.69% (0.8298 => 0.9019)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -30.32% (0.2978 => 0.2075)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.3624 => 0.3830)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.89% (1.5889 => 1.6825)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 32.88% (1.4340 => 1.9055)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.24% (0.9660 => 1.3740)
CBE:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -11.51% (3.9100 => 3.4600)
 MultiSource/Applications/sgefa/sgefa: 7.58% (0.6600 => 0.7100)
 SingleSource/Benchmarks/Dhrystone/fldry: -6.54% (1.0700 => 1.0000)
LLC-BETA:
 Externals/Povray/povray: 6.32% (4.4300 => 4.7100)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -12.95% (3.8600 => 3.3600)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -8.00% (0.2500 => 0.2300)
 MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.3900 => 0.4100)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -13.59% (1.0300 => 0.8900)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.40% (1.1700 => 1.0600)
 SingleSource/Benchmarks/BenchmarkGame/fasta: 8.33% (1.0800 => 1.1700)
 SingleSource/Benchmarks/Misc/salsa20: -6.27% (10.2100 => 9.5700)
LLC compile:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.33% (1.5906 => 1.6913)
 Externals/SPEC/CFP2006/444_namd/444_namd: 5.14% (2.4861 => 2.6139)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 6.62% (0.4290 => 0.4574)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 6.14% (2.6139 => 2.7743)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 5.04% (1.1113 => 1.1673)
 MultiSource/Applications/JM/ldecod/ldecod: 6.12% (3.5775 => 3.7964)
 MultiSource/Applications/spiff/spiff: 12.68% (0.3605 => 0.4062)
 MultiSource/Applications/sqlite3/sqlite3: -7.29% (7.1232 => 6.6037)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.71% (3.2452 => 3.5277)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.64% (0.8275 => 0.9073)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -31.24% (0.2987 => 0.2054)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.3560 => 0.3766)
 MultiSource/Benchmarks/mafft/pairlocalalign: 7.04% (2.0238 => 2.1662)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.64% (1.5639 => 1.6677)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 32.70% (1.4050 => 1.8644)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.20% (0.9572 => 1.3420)
GCCAS:
 MultiSource/Applications/spiff/spiff: 6.46% (0.2602 => 0.2770)
 MultiSource/Applications/sqlite3/sqlite3: -7.49% (5.0009 => 4.6264)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.89% (0.7870 => 0.7249)
JIT:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -11.02% (5.0800 => 4.5200)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -6.06% (0.3300 => 0.3100)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.73% (0.5500 => 0.6200)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.89% (0.9000 => 0.9800)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -27.27% (0.3300 => 0.2400)
 MultiSource/Benchmarks/Ptrdist/ks/ks: -12.89% (2.2500 => 1.9600)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.07% (1.3800 => 1.4500)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.05% (2.9900 => 3.4700)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.16% (4.9000 => 5.3000)
 SingleSource/Benchmarks/BenchmarkGame/fasta: 9.01% (1.1100 => 1.2100)
 SingleSource/Benchmarks/McGill/chomp: 25.00% (0.9200 => 1.1500)
 SingleSource/Benchmarks/Misc-C++/ray: 5.47% (5.4800 => 5.7800)
 SingleSource/UnitTests/Vector/build2: 5.91% (1.8600 => 1.9700)
LLC:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -12.44% (3.8600 => 3.3800)
 MultiSource/Benchmarks/Olden/health/health: 5.56% (0.3600 => 0.3800)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -13.59% (1.0300 => 0.8900)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.62% (1.1600 => 1.0600)
 SingleSource/Benchmarks/BenchmarkGame/fasta: 8.33% (1.0800 => 1.1700)
 SingleSource/Benchmarks/Misc/salsa20: -5.64% (10.1000 => 9.5300)
LLC-BETA compile:
 Externals/SPEC/CFP2006/444_namd/444_namd: 5.63% (2.5013 => 2.6421)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.96% (0.4329 => 0.4587)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 5.38% (2.6377 => 2.7795)
 MultiSource/Applications/JM/ldecod/ldecod: 5.72% (3.6011 => 3.8072)
 MultiSource/Applications/spiff/spiff: 13.40% (0.3634 => 0.4121)
 MultiSource/Applications/sqlite3/sqlite3: -8.02% (7.2124 => 6.6340)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.82% (3.3021 => 3.5602)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.19% (0.8321 => 0.9086)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -31.47% (0.3022 => 0.2071)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.56% (0.3576 => 0.3775)
 MultiSource/Benchmarks/mafft/pairlocalalign: 6.24% (2.0368 => 2.1638)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.64% (1.5801 => 1.6692)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 32.71% (1.4043 => 1.8637)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.84% (0.9519 => 1.3407)



More information about the llvm-testresults mailing list