[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Mon Sep 28 04:02:52 PDT 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//2048
Name:  grawp.apple.com
Nickname: Grawp:4
Buildstatus: OK

Run: 2048, Start Time: 2009-09-28 00:38:47
Comparing To: 2026, Start Time: 2009-09-27 00:30:15

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 121

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 93

Total Test Failures By Type:
  CBE: 43
  JIT: 24
  JIT codegen: 24
  LLC-BETA: 1
  LLC_BETA compile: 1

--- Changes Detail ---
New Test Passes:

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
JIT codegen:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 10.14% (1.0843 => 1.1942)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.11% (4.7708 => 5.0147)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 6.78% (0.3671 => 0.3920)
 Externals/SPEC/CINT2000/252_eon/252_eon: 5.41% (1.4429 => 1.5209)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 9.09% (0.3156 => 0.3443)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 5.64% (1.6824 => 1.7773)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 5.50% (0.6132 => 0.6469)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 5.88% (4.2005 => 4.4476)
 MultiSource/Applications/SPASS/SPASS: 11.63% (3.8721 => 4.3224)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.01% (0.4269 => 0.4483)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.87% (0.7220 => 0.7644)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.93% (0.2983 => 0.3160)
 MultiSource/Benchmarks/mafft/pairlocalalign: 7.39% (0.7771 => 0.8345)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.65% (1.3833 => 1.4614)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.15% (0.9138 => 0.9609)
CBE:
 SingleSource/Benchmarks/Shootout-C++/ary3: -7.52% (4.3900 => 4.0600)
 SingleSource/Benchmarks/Shootout/strcat: -8.33% (0.2400 => 0.2200)
LLC-BETA:
 MultiSource/Applications/ClamAV/clamscan: -7.41% (0.2700 => 0.2500)
 MultiSource/Benchmarks/Ptrdist/ft/ft: -9.52% (1.0500 => 0.9500)
 SingleSource/Benchmarks/CoyoteBench/lpbench: -5.11% (10.3700 => 9.8400)
LLC compile:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 7.90% (1.3898 => 1.4996)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 7.92% (0.3220 => 0.3475)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 5.07% (9.2182 => 9.6855)
 MultiSource/Applications/SPASS/SPASS: 7.43% (5.9474 => 6.3893)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.38% (0.7308 => 0.7774)
 MultiSource/Benchmarks/mafft/pairlocalalign: 14.71% (1.7641 => 2.0236)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.00% (1.3913 => 1.4609)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.12% (0.9055 => 0.9519)
GCCAS:
 Externals/Nurbs/nurbs: 11.75% (0.6383 => 0.7133)
 Externals/Povray/povray: 15.82% (6.8751 => 7.9624)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 13.32% (4.4107 => 4.9981)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 19.95% (1.0771 => 1.2920)
 Externals/SPEC/CFP2006/433_milc/433_milc: 14.97% (1.2307 => 1.4149)
 Externals/SPEC/CFP2006/444_namd/444_namd: 13.98% (2.3215 => 2.6461)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 20.08% (33.3477 => 40.0453)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 10.93% (3.4484 => 3.8252)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 22.01% (0.4484 => 0.5471)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 29.55% (1.3254 => 1.7170)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 27.79% (15.1972 => 19.4212)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 16.58% (1.7426 => 2.0316)
 Externals/SPEC/CINT2000/197_parser/197_parser: 24.38% (1.0737 => 1.3355)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 19.63% (5.1371 => 6.1454)
 Externals/SPEC/CINT2000/254_gap/254_gap: 15.78% (5.1596 => 5.9740)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 27.43% (0.2789 => 0.3554)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 28.80% (1.8654 => 2.4026)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 14.91% (11.3515 => 13.0436)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 41.46% (0.8702 => 1.2310)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 15.77% (41.0820 => 47.5588)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 21.09% (7.5418 => 9.1321)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 23.80% (2.9053 => 3.5967)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 12.00% (0.9426 => 1.0557)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 15.68% (0.3182 => 0.3681)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 26.66% (6.4904 => 8.2205)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 15.17% (7.0440 => 8.1125)
 Externals/SPEC/CINT2006/473_astar/473_astar: 8.63% (0.3509 => 0.3812)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 10.27% (38.9575 => 42.9575)
 MultiSource/Applications/ClamAV/clamscan: 25.45% (5.9433 => 7.4561)
 MultiSource/Applications/JM/ldecod/ldecod: 15.72% (3.2757 => 3.7907)
 MultiSource/Applications/JM/lencod/lencod: 14.91% (6.9275 => 7.9603)
 MultiSource/Applications/SIBsim4/SIBsim4: 31.43% (0.5628 => 0.7397)
 MultiSource/Applications/SPASS/SPASS: 28.07% (7.9739 => 10.2125)
 MultiSource/Applications/d/make_dparser: 27.98% (1.5799 => 2.0220)
 MultiSource/Applications/hbd/hbd: 7.71% (0.3529 => 0.3801)
 MultiSource/Applications/hexxagon/hexxagon: 6.37% (0.2887 => 0.3071)
 MultiSource/Applications/kimwitu++/kc: 5.27% (6.6186 => 6.9673)
 MultiSource/Applications/lemon/lemon: 16.96% (0.4447 => 0.5201)
 MultiSource/Applications/lua/lua: 7.00% (2.0257 => 2.1675)
 MultiSource/Applications/minisat/minisat: 8.74% (0.3205 => 0.3485)
 MultiSource/Applications/oggenc/oggenc: 14.67% (1.8555 => 2.1277)
 MultiSource/Applications/spiff/spiff: 12.73% (0.2372 => 0.2674)
 MultiSource/Applications/sqlite3/sqlite3: 18.85% (4.8134 => 5.7206)
 MultiSource/Applications/treecc/treecc: 26.61% (0.9361 => 1.1852)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.05% (3.6682 => 4.6237)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.44% (0.3659 => 0.3968)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.59% (0.2869 => 0.3144)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.12% (1.9024 => 2.2091)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.37% (1.4708 => 1.7263)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.88% (1.6326 => 1.9408)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 24.14% (6.7296 => 8.3538)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.39% (0.6036 => 0.7025)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.49% (2.0894 => 2.6219)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.71% (0.4382 => 0.5158)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.30% (0.2080 => 0.2315)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.88% (0.4241 => 0.4957)
 MultiSource/Benchmarks/Prolangs-C/football/football: 20.85% (0.3991 => 0.4823)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.19% (0.2993 => 0.3268)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.25% (0.3649 => 0.4534)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 24.22% (0.4995 => 0.6205)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.76% (0.2571 => 0.3079)
 MultiSource/Benchmarks/mafft/pairlocalalign: 64.75% (4.5478 => 7.4923)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.30% (1.4984 => 1.7277)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.98% (0.5687 => 0.6596)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.83% (9.6520 => 10.3109)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.50% (1.2843 => 1.4192)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 18.66% (1.1115 => 1.3189)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 17.34% (0.7253 => 0.8511)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 50.80% (0.3256 => 0.4910)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 53.39% (0.3643 => 0.5588)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.05% (0.3545 => 0.3972)
JIT:
 Externals/SPEC/CINT2006/403_gcc/403_gcc: -6.45% (42.0300 => 39.3200)
 MultiSource/Applications/SPASS/SPASS: -11.55% (14.6300 => 12.9400)
 MultiSource/Applications/d/make_dparser: -5.59% (1.4300 => 1.3500)
 MultiSource/Applications/lemon/lemon: -9.59% (179.5900 => 162.3600)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.07% (8.4800 => 8.0500)
 MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (1.0000 => 1.0500)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 13.04% (0.2300 => 0.2600)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.91% (0.5500 => 0.4900)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.45% (0.3100 => 0.2900)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -13.68% (0.9500 => 0.8200)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -15.38% (0.2600 => 0.2200)
 MultiSource/Benchmarks/mafft/pairlocalalign: -13.38% (39.8500 => 34.5200)
 SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.33% (0.2400 => 0.2600)
 SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (4.4500 => 4.2200)
LLC:
 MultiSource/Applications/SPASS/SPASS: -6.28% (8.7600 => 8.2100)
LLC-BETA compile:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 7.08% (1.4143 => 1.5144)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.46% (0.3771 => 0.3977)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 8.16% (0.3235 => 0.3499)
 MultiSource/Applications/SPASS/SPASS: 7.85% (5.9810 => 6.4506)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.78% (0.7341 => 0.7839)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.00% (0.3048 => 0.3231)
 MultiSource/Benchmarks/mafft/pairlocalalign: 12.57% (1.8275 => 2.0572)



More information about the llvm-testresults mailing list