[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Thu Mar 18 09:19:11 PDT 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/6494/
Name: grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4
Run: 6494, Start Time: 2010-03-18 06:28:03, End Time: 2010-03-18 09:18:56
Comparing To: 6433, Start Time: 2010-03-17 06:22:49, End Time: 2010-03-17 09:15:17
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 208
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 934
Total Test Failures By Type:
CBE: 64
JIT: 433
JIT codegen: 433
LLC: 1
LLC compile: 1
LLC-BETA: 1
LLC_BETA compile: 1
--- Changes Detail ---
New Test Passes:
New Test Failures:
Added Tests:
Removed Tests:
Significant Changes in Test Results:
LLC:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 7.14% (3.7800 => 4.0500)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.17% (1.2000 => 1.3700)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.19% (1.1300 => 1.2000)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -12.26% (1.0600 => 0.9300)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.56% (1.8000 => 1.7000)
SingleSource/Benchmarks/CoyoteBench/huffbench: 6.14% (21.3200 => 22.6300)
SingleSource/Benchmarks/Dhrystone/dry: 24.23% (2.9300 => 3.6400)
SingleSource/Benchmarks/Misc/fbench: 8.70% (2.3000 => 2.5000)
SingleSource/Benchmarks/Misc/ffbench: 12.63% (0.9500 => 1.0700)
SingleSource/Benchmarks/Misc/fp-convert: 5.11% (4.7000 => 4.9400)
SingleSource/Benchmarks/Misc/lowercase: 5.40% (8.7100 => 9.1800)
SingleSource/Benchmarks/Misc/mandel-2: -9.52% (1.0500 => 0.9500)
LLC-BETA compile:
Externals/Nurbs/nurbs: -9.17% (0.9433 => 0.8568)
Externals/Povray/povray: -9.19% (9.7814 => 8.8824)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -8.78% (7.5375 => 6.8755)
Externals/SPEC/CFP2000/179_art/179_art: -8.49% (0.2743 => 0.2510)
Externals/SPEC/CFP2000/183_equake/183_equake: -10.05% (0.2916 => 0.2623)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -8.38% (1.7524 => 1.6056)
Externals/SPEC/CFP2006/433_milc/433_milc: -8.35% (1.9404 => 1.7784)
Externals/SPEC/CFP2006/444_namd/444_namd: -9.10% (4.1112 => 3.7371)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -8.90% (49.4611 => 45.0572)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -9.18% (6.0979 => 5.5381)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -9.70% (0.7976 => 0.7202)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -9.65% (2.0640 => 1.8648)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -9.61% (23.5066 => 21.2465)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -10.49% (2.8914 => 2.5880)
Externals/SPEC/CINT2000/197_parser/197_parser: -7.62% (2.7382 => 2.5295)
Externals/SPEC/CINT2000/252_eon/252_eon: -8.99% (4.6560 => 4.2374)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -9.94% (9.8624 => 8.8818)
Externals/SPEC/CINT2000/254_gap/254_gap: -9.25% (9.3205 => 8.4588)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -10.59% (6.9655 => 6.2277)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -8.93% (0.6830 => 0.6220)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -9.99% (3.7280 => 3.3557)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -9.94% (18.8187 => 16.9481)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.64% (1.1593 => 1.0939)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -9.69% (52.0452 => 47.0020)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -8.68% (12.5085 => 11.4227)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -9.74% (4.7220 => 4.2619)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -8.18% (2.0210 => 1.8557)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -9.61% (0.5035 => 0.4551)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -6.20% (13.5964 => 12.7530)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -9.44% (10.2747 => 9.3046)
Externals/SPEC/CINT2006/473_astar/473_astar: -9.88% (0.5555 => 0.5006)
MultiSource/Applications/ClamAV/clamscan: -8.40% (9.2553 => 8.4780)
MultiSource/Applications/JM/ldecod/ldecod: -8.49% (4.8921 => 4.4766)
MultiSource/Applications/JM/lencod/lencod: -7.84% (12.9729 => 11.9556)
MultiSource/Applications/SIBsim4/SIBsim4: -7.33% (0.9640 => 0.8933)
MultiSource/Applications/SPASS/SPASS: -10.34% (9.3772 => 8.4072)
MultiSource/Applications/d/make_dparser: -9.28% (1.7374 => 1.5762)
MultiSource/Applications/hbd/hbd: -12.00% (0.5866 => 0.5162)
MultiSource/Applications/hexxagon/hexxagon: -8.16% (0.3748 => 0.3442)
MultiSource/Applications/kimwitu++/kc: -11.70% (11.4677 => 10.1262)
MultiSource/Applications/lambda-0_1_3/lambda: -9.54% (0.6414 => 0.5802)
MultiSource/Applications/lemon/lemon: -10.07% (0.9484 => 0.8529)
MultiSource/Applications/lua/lua: -9.49% (2.5889 => 2.3432)
MultiSource/Applications/minisat/minisat: -10.73% (0.3887 => 0.3470)
MultiSource/Applications/oggenc/oggenc: -7.44% (3.9479 => 3.6542)
MultiSource/Applications/sgefa/sgefa: -6.31% (0.2217 => 0.2077)
MultiSource/Applications/siod/siod: -10.83% (2.2324 => 1.9906)
MultiSource/Applications/spiff/spiff: -7.90% (0.4328 => 0.3986)
MultiSource/Applications/sqlite3/sqlite3: -8.88% (8.4824 => 7.7292)
MultiSource/Applications/treecc/treecc: -9.12% (1.6546 => 1.5037)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.03% (4.4429 => 4.0862)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.99% (0.2753 => 0.2478)
MultiSource/Benchmarks/Bullet/bullet: -9.61% (10.7539 => 9.7209)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -9.06% (0.8336 => 0.7581)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.09% (0.4248 => 0.3862)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -8.89% (2.8676 => 2.6128)
MultiSource/Benchmarks/MallocBench/gs/gs: -9.21% (2.9030 => 2.6356)
MultiSource/Benchmarks/McCat/18-imp/imp: -9.07% (0.2403 => 0.2185)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.55% (0.6809 => 0.6431)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.70% (2.2306 => 2.0366)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (3.5434 => 3.3375)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -11.97% (8.4975 => 7.4805)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -10.04% (1.0880 => 0.9788)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.90% (0.5229 => 0.4816)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -8.06% (0.9844 => 0.9051)
MultiSource/Benchmarks/PAQ8p/paq8p: -11.58% (1.6512 => 1.4600)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.50% (4.1025 => 3.6717)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.62% (0.8477 => 0.7746)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -9.63% (0.3581 => 0.3236)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.73% (1.0505 => 0.9483)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -7.50% (0.4533 => 0.4193)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -10.69% (0.2778 => 0.2481)
MultiSource/Benchmarks/Prolangs-C/football/football: -8.14% (0.7784 => 0.7150)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -9.49% (0.3034 => 0.2746)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.83% (0.5443 => 0.4908)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.11% (0.3743 => 0.3402)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.63% (0.6895 => 0.6300)
MultiSource/Benchmarks/Ptrdist/bc/bc: -9.60% (0.9294 => 0.8402)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.57% (0.6630 => 0.6062)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -11.99% (0.2693 => 0.2370)
MultiSource/Benchmarks/mafft/pairlocalalign: -8.07% (6.1118 => 5.6185)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.34% (0.5141 => 0.4558)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -9.18% (2.3117 => 2.0995)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -8.44% (0.7951 => 0.7280)
MultiSource/Benchmarks/sim/sim: -9.05% (0.2674 => 0.2432)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.80% (9.0819 => 8.1916)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.53% (2.9000 => 2.6525)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -8.75% (2.1241 => 1.9382)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.85% (1.5126 => 1.3788)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.65% (0.3294 => 0.3108)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.94% (0.3831 => 0.3565)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.54% (0.3623 => 0.3386)
LLC-BETA:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 6.82% (3.8100 => 4.0700)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -5.91% (7.2700 => 6.8400)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.01% (1.2100 => 1.4400)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.43% (1.0500 => 0.9300)
SingleSource/Benchmarks/CoyoteBench/huffbench: 5.85% (21.3500 => 22.6000)
SingleSource/Benchmarks/Dhrystone/dry: 8.44% (3.0800 => 3.3400)
SingleSource/Benchmarks/Misc/fbench: 8.77% (2.2800 => 2.4800)
SingleSource/Benchmarks/Misc/ffbench: 11.58% (0.9500 => 1.0600)
SingleSource/Benchmarks/Misc/fp-convert: 5.11% (4.7000 => 4.9400)
SingleSource/Benchmarks/Misc/lowercase: 5.39% (8.7200 => 9.1900)
SingleSource/Benchmarks/Misc/mandel-2: -9.52% (1.0500 => 0.9500)
LLC compile:
Externals/Nurbs/nurbs: -9.91% (0.9456 => 0.8519)
Externals/Povray/povray: -9.48% (9.7927 => 8.8647)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -8.60% (7.4549 => 6.8137)
Externals/SPEC/CFP2000/179_art/179_art: -9.56% (0.2752 => 0.2489)
Externals/SPEC/CFP2000/183_equake/183_equake: -9.14% (0.2909 => 0.2643)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -9.07% (1.7614 => 1.6016)
Externals/SPEC/CFP2006/433_milc/433_milc: -8.85% (1.9426 => 1.7707)
Externals/SPEC/CFP2006/444_namd/444_namd: -8.69% (4.0867 => 3.7317)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -8.40% (49.1714 => 45.0412)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -9.50% (6.1155 => 5.5346)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -8.18% (0.7856 => 0.7213)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -9.85% (2.0689 => 1.8651)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -9.53% (23.4725 => 21.2358)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -10.18% (2.8857 => 2.5919)
Externals/SPEC/CINT2000/197_parser/197_parser: -6.93% (2.7316 => 2.5423)
Externals/SPEC/CINT2000/252_eon/252_eon: -8.70% (4.6430 => 4.2389)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -9.77% (9.8535 => 8.8912)
Externals/SPEC/CINT2000/254_gap/254_gap: -9.29% (9.2837 => 8.4208)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -10.41% (6.9586 => 6.2345)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -9.26% (0.6858 => 0.6223)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -10.43% (3.7387 => 3.3489)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -9.78% (18.5145 => 16.7047)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -6.54% (1.1612 => 1.0852)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -9.30% (51.8749 => 47.0501)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -8.58% (12.4813 => 11.4102)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -9.47% (4.6943 => 4.2497)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -8.12% (2.0285 => 1.8638)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -9.14% (0.5024 => 0.4565)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -6.20% (13.5908 => 12.7481)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -9.12% (10.2463 => 9.3119)
Externals/SPEC/CINT2006/473_astar/473_astar: -10.61% (0.5587 => 0.4994)
MultiSource/Applications/ClamAV/clamscan: -8.46% (9.2510 => 8.4685)
MultiSource/Applications/JM/ldecod/ldecod: -8.67% (4.8989 => 4.4743)
MultiSource/Applications/JM/lencod/lencod: -8.07% (12.9911 => 11.9426)
MultiSource/Applications/SIBsim4/SIBsim4: -7.33% (0.9618 => 0.8913)
MultiSource/Applications/SPASS/SPASS: -10.02% (9.3444 => 8.4084)
MultiSource/Applications/d/make_dparser: -8.71% (1.7323 => 1.5814)
MultiSource/Applications/hbd/hbd: -11.27% (0.5854 => 0.5194)
MultiSource/Applications/hexxagon/hexxagon: -8.91% (0.3750 => 0.3416)
MultiSource/Applications/kimwitu++/kc: -11.56% (11.4422 => 10.1194)
MultiSource/Applications/lambda-0_1_3/lambda: -9.65% (0.6466 => 0.5842)
MultiSource/Applications/lemon/lemon: -10.01% (0.9565 => 0.8608)
MultiSource/Applications/lua/lua: -9.98% (2.5949 => 2.3360)
MultiSource/Applications/minisat/minisat: -10.38% (0.3873 => 0.3471)
MultiSource/Applications/oggenc/oggenc: -7.78% (3.9669 => 3.6584)
MultiSource/Applications/sgefa/sgefa: -7.21% (0.2219 => 0.2059)
MultiSource/Applications/siod/siod: -10.64% (2.2331 => 1.9955)
MultiSource/Applications/spiff/spiff: -11.06% (0.4486 => 0.3990)
MultiSource/Applications/sqlite3/sqlite3: -9.51% (8.5277 => 7.7167)
MultiSource/Applications/treecc/treecc: -9.27% (1.6541 => 1.5008)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.24% (4.4478 => 4.0815)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.63% (0.2712 => 0.2478)
MultiSource/Benchmarks/Bullet/bullet: -10.33% (10.8639 => 9.7420)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.38% (0.8317 => 0.7620)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.62% (0.4223 => 0.3859)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -9.54% (2.8898 => 2.6141)
MultiSource/Benchmarks/MallocBench/gs/gs: -9.16% (2.9085 => 2.6420)
MultiSource/Benchmarks/McCat/18-imp/imp: -8.32% (0.2391 => 0.2192)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.12% (0.6841 => 0.6422)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -9.30% (2.2400 => 2.0316)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (3.5438 => 3.3422)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -11.99% (8.4944 => 7.4761)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -10.01% (1.0850 => 0.9764)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.24% (0.5047 => 0.4631)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -7.99% (0.9875 => 0.9086)
MultiSource/Benchmarks/PAQ8p/paq8p: -11.73% (1.6534 => 1.4594)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.79% (4.1068 => 3.6635)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.64% (0.8448 => 0.7718)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -10.57% (0.3594 => 0.3214)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.56% (1.0489 => 0.9486)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -8.04% (0.4528 => 0.4164)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -10.75% (0.2790 => 0.2490)
MultiSource/Benchmarks/Prolangs-C/football/football: -7.60% (0.7794 => 0.7202)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.67% (0.3023 => 0.2761)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.07% (0.5461 => 0.4911)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.49% (0.3698 => 0.3384)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.07% (0.6850 => 0.6297)
MultiSource/Benchmarks/Ptrdist/bc/bc: -9.50% (0.9272 => 0.8391)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.80% (0.6554 => 0.6043)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.89% (0.2630 => 0.2370)
MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (6.1175 => 5.6067)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.14% (0.5022 => 0.4563)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -8.73% (2.3086 => 2.1071)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -9.09% (0.7986 => 0.7260)
MultiSource/Benchmarks/sim/sim: -11.94% (0.2746 => 0.2418)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.85% (9.0641 => 8.1712)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.27% (2.9075 => 2.6671)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -9.02% (2.1258 => 1.9341)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.01% (1.5138 => 1.3774)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.67% (0.3315 => 0.3094)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.63% (0.3831 => 0.3577)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -7.29% (0.3621 => 0.3357)
CBE:
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -6.36% (1.1000 => 1.0300)
More information about the llvm-testresults
mailing list