[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Mon Oct 19 09:44:28 PDT 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//2458
Name:  grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4
Buildstatus: OK

Run: 2458, Start Time: 2009-10-19 06:44:35
Comparing To: 2437, Start Time: 2009-10-18 06:41:33

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 179

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 926

Total Test Failures By Type:
  CBE: 66
  JIT: 428
  JIT codegen: 428
  LLC: 1
  LLC compile: 1
  LLC-BETA: 1
  LLC_BETA compile: 1

--- Changes Detail ---
New Test Passes:

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 8.33% (0.2400 => 0.2600)
 MultiSource/Applications/kimwitu++/kc: -6.25% (0.3200 => 0.3000)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.62% (1.0300 => 0.9000)
 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -48.48% (2.6400 => 1.3600)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -22.76% (1.4500 => 1.1200)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -21.74% (0.6900 => 0.5400)
 SingleSource/Benchmarks/Dhrystone/fldry: 10.39% (3.3700 => 3.7200)
LLC-BETA compile:
 Externals/Nurbs/nurbs: 11.35% (0.6826 => 0.7601)
 Externals/Povray/povray: 10.72% (7.1958 => 7.9675)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 9.54% (5.5945 => 6.1281)
 Externals/SPEC/CFP2000/183_equake/183_equake: 13.49% (0.2009 => 0.2280)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 10.68% (1.2236 => 1.3543)
 Externals/SPEC/CFP2006/433_milc/433_milc: 12.29% (1.2412 => 1.3937)
 Externals/SPEC/CFP2006/444_namd/444_namd: 13.27% (2.8358 => 3.2121)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 10.57% (33.7335 => 37.2990)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 10.98% (4.2761 => 4.7455)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 10.65% (0.5106 => 0.5650)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 11.00% (1.4771 => 1.6396)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 10.65% (17.3233 => 19.1689)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 11.99% (2.1845 => 2.4464)
 Externals/SPEC/CINT2000/197_parser/197_parser: 9.34% (1.6346 => 1.7872)
 Externals/SPEC/CINT2000/252_eon/252_eon: 12.87% (2.9203 => 3.2960)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 10.57% (7.0971 => 7.8476)
 Externals/SPEC/CINT2000/254_gap/254_gap: 10.32% (6.6348 => 7.3193)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 11.92% (5.2611 => 5.8881)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 10.07% (0.4556 => 0.5015)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 12.64% (2.4730 => 2.7855)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 11.14% (13.6871 => 15.2124)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 11.14% (0.7274 => 0.8084)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 10.76% (40.0190 => 44.3237)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 9.94% (8.6990 => 9.5641)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 10.26% (3.4941 => 3.8527)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 10.87% (1.3231 => 1.4669)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 11.41% (0.3698 => 0.4120)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 12.65% (5.6318 => 6.3443)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 9.11% (8.3955 => 9.1607)
 Externals/SPEC/CINT2006/473_astar/473_astar: 11.46% (0.4023 => 0.4484)
 MultiSource/Applications/ClamAV/clamscan: 9.76% (6.4767 => 7.1089)
 MultiSource/Applications/JM/ldecod/ldecod: 11.68% (2.9560 => 3.3014)
 MultiSource/Applications/JM/lencod/lencod: 12.95% (6.7205 => 7.5907)
 MultiSource/Applications/SIBsim4/SIBsim4: 10.76% (0.5166 => 0.5722)
 MultiSource/Applications/SPASS/SPASS: 11.23% (6.7166 => 7.4707)
 MultiSource/Applications/d/make_dparser: 10.25% (1.3050 => 1.4388)
 MultiSource/Applications/hbd/hbd: 11.55% (0.4365 => 0.4869)
 MultiSource/Applications/hexxagon/hexxagon: 9.52% (0.2689 => 0.2945)
 MultiSource/Applications/kimwitu++/kc: 12.68% (8.2467 => 9.2921)
 MultiSource/Applications/lambda-0_1_3/lambda: 10.34% (0.5000 => 0.5517)
 MultiSource/Applications/lemon/lemon: 9.50% (0.6696 => 0.7332)
 MultiSource/Applications/lua/lua: 10.76% (1.9196 => 2.1261)
 MultiSource/Applications/minisat/minisat: 10.51% (0.2759 => 0.3049)
 MultiSource/Applications/oggenc/oggenc: 10.74% (2.2162 => 2.4543)
 MultiSource/Applications/siod/siod: 11.93% (1.6611 => 1.8593)
 MultiSource/Applications/spiff/spiff: 9.27% (0.3009 => 0.3288)
 MultiSource/Applications/sqlite3/sqlite3: 10.04% (6.6307 => 7.2967)
 MultiSource/Applications/treecc/treecc: 9.10% (1.2334 => 1.3457)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.68% (2.9732 => 3.2906)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.74% (0.5109 => 0.5760)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.56% (0.3068 => 0.3392)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.42% (2.0373 => 2.2496)
 MultiSource/Benchmarks/MallocBench/gs/gs: 11.00% (2.0833 => 2.3125)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.17% (0.3049 => 0.3359)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.09% (1.6081 => 1.7865)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.28% (1.4392 => 1.6016)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.82% (5.8575 => 6.7839)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.09% (0.7574 => 0.8338)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.21% (0.3285 => 0.3719)
 MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (1.0390 => 1.1777)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.69% (3.2220 => 3.5986)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.28% (0.5914 => 0.6522)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.50% (0.2723 => 0.3009)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.45% (0.7303 => 0.8066)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.76% (0.2891 => 0.3202)
 MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.85% (0.2055 => 0.2278)
 MultiSource/Benchmarks/Prolangs-C/football/football: 11.86% (0.5270 => 0.5895)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.87% (0.4113 => 0.4519)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.72% (0.2733 => 0.3026)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.78% (0.4693 => 0.5152)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 10.68% (0.5638 => 0.6240)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.58% (0.3764 => 0.4087)
 MultiSource/Benchmarks/mafft/pairlocalalign: 9.19% (3.9227 => 4.2832)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.29% (0.3296 => 0.3701)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.74% (1.6678 => 1.8470)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.09% (0.5715 => 0.6406)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.69% (6.0917 => 6.8040)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.81% (1.9920 => 2.2073)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.04% (1.5136 => 1.6656)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.35% (1.0683 => 1.1789)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.94% (0.2142 => 0.2312)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.87% (0.2468 => 0.2687)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.25% (0.2801 => 0.3060)
LLC-BETA:
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -6.84% (9.2100 => 8.5800)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.14% (0.2800 => 0.2600)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.62% (1.0300 => 0.9000)
 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -22.44% (1.5600 => 1.2100)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -22.30% (1.4800 => 1.1500)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -21.74% (0.6900 => 0.5400)
LLC compile:
 Externals/Nurbs/nurbs: 10.55% (0.6832 => 0.7553)
 Externals/Povray/povray: 11.32% (7.1099 => 7.9149)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 9.28% (5.5450 => 6.0595)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 10.62% (1.2138 => 1.3427)
 Externals/SPEC/CFP2006/433_milc/433_milc: 11.61% (1.2403 => 1.3843)
 Externals/SPEC/CFP2006/444_namd/444_namd: 12.30% (2.8399 => 3.1893)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 10.70% (33.4907 => 37.0742)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 10.97% (4.2391 => 4.7043)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 10.07% (0.5065 => 0.5575)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 10.60% (1.4733 => 1.6295)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 10.53% (17.2579 => 19.0755)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 12.12% (2.1576 => 2.4192)
 Externals/SPEC/CINT2000/197_parser/197_parser: 8.56% (1.6316 => 1.7712)
 Externals/SPEC/CINT2000/252_eon/252_eon: 13.74% (2.8436 => 3.2344)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 11.22% (7.0005 => 7.7857)
 Externals/SPEC/CINT2000/254_gap/254_gap: 10.45% (6.5997 => 7.2895)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 11.85% (5.2252 => 5.8444)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 10.32% (0.4486 => 0.4949)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 12.08% (2.4576 => 2.7544)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 9.29% (13.7807 => 15.0609)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 10.75% (0.7201 => 0.7975)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 10.56% (39.8240 => 44.0303)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 10.59% (8.6092 => 9.5213)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 10.37% (3.4699 => 3.8297)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 11.67% (1.3093 => 1.4621)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 11.63% (0.3672 => 0.4099)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 12.83% (5.5812 => 6.2975)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 8.73% (8.3591 => 9.0886)
 Externals/SPEC/CINT2006/473_astar/473_astar: 11.33% (0.3980 => 0.4431)
 MultiSource/Applications/ClamAV/clamscan: 9.58% (6.4284 => 7.0443)
 MultiSource/Applications/JM/ldecod/ldecod: 11.26% (2.9533 => 3.2858)
 MultiSource/Applications/JM/lencod/lencod: 13.28% (6.6521 => 7.5357)
 MultiSource/Applications/SIBsim4/SIBsim4: 10.29% (0.5143 => 0.5672)
 MultiSource/Applications/SPASS/SPASS: 11.48% (6.6631 => 7.4277)
 MultiSource/Applications/d/make_dparser: 10.55% (1.2991 => 1.4362)
 MultiSource/Applications/hbd/hbd: 13.50% (0.4267 => 0.4843)
 MultiSource/Applications/hexxagon/hexxagon: 9.61% (0.2685 => 0.2943)
 MultiSource/Applications/kimwitu++/kc: 11.80% (8.2164 => 9.1860)
 MultiSource/Applications/lambda-0_1_3/lambda: 10.04% (0.4992 => 0.5493)
 MultiSource/Applications/lemon/lemon: 8.34% (0.6712 => 0.7272)
 MultiSource/Applications/lua/lua: 10.90% (1.9098 => 2.1179)
 MultiSource/Applications/minisat/minisat: 10.61% (0.2733 => 0.3023)
 MultiSource/Applications/oggenc/oggenc: 10.76% (2.1989 => 2.4354)
 MultiSource/Applications/siod/siod: 11.54% (1.6592 => 1.8507)
 MultiSource/Applications/spiff/spiff: 9.46% (0.2981 => 0.3263)
 MultiSource/Applications/sqlite3/sqlite3: 9.99% (6.5521 => 7.2066)
 MultiSource/Applications/treecc/treecc: 9.35% (1.2302 => 1.3452)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.71% (2.9569 => 3.2736)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.03% (0.5031 => 0.5737)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.02% (0.3065 => 0.3372)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.96% (2.0120 => 2.2326)
 MultiSource/Benchmarks/MallocBench/gs/gs: 10.19% (2.0723 => 2.2835)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.86% (0.3052 => 0.3353)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.87% (1.5949 => 1.7682)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.57% (1.4215 => 1.5860)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.04% (5.7652 => 6.6902)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.18% (0.7532 => 0.8299)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.04% (0.3263 => 0.3721)
 MultiSource/Benchmarks/PAQ8p/paq8p: 13.52% (1.0237 => 1.1621)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.39% (3.1901 => 3.5854)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.68% (0.5908 => 0.6421)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.27% (0.2715 => 0.3021)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.70% (0.7288 => 0.7995)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.2877 => 0.3196)
 MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.37% (0.2041 => 0.2273)
 MultiSource/Benchmarks/Prolangs-C/football/football: 7.95% (0.5286 => 0.5706)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.87% (0.4075 => 0.4477)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.45% (0.2708 => 0.2964)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.01% (0.4665 => 0.5132)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 11.48% (0.5610 => 0.6254)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.94% (0.3711 => 0.4117)
 MultiSource/Benchmarks/mafft/pairlocalalign: 10.27% (3.8731 => 4.2710)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.57% (0.3354 => 0.3675)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.12% (1.6458 => 1.8288)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.78% (0.5731 => 0.6349)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.32% (5.9494 => 6.6823)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.30% (1.9895 => 2.1944)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.32% (1.5046 => 1.6598)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.24% (1.0663 => 1.1755)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.10% (0.2141 => 0.2293)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.07% (0.2466 => 0.2665)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.17% (0.2782 => 0.3037)
CBE:
 MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.45% (0.3100 => 0.3300)



More information about the llvm-testresults mailing list