[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Sat Dec 12 16:21:58 PST 2009
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3716/
Name: grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4
Run: 3716, Start Time: 2009-12-12 13:17:32, End Time: 2009-12-12 16:17:57
Comparing To: 3667, Start Time: 2009-12-10 06:14:32, End Time: 2009-12-10 09:06:55
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 2
Added Tests: 9
Removed Tests: 0
Significant Changes: 147
--- Tests Summary ---
Total Tests: 3870
Total Test Failures: 944
Total Test Failures By Type:
CBE: 68
JIT: 430
JIT codegen: 430
LLC: 1
LLC compile: 1
LLC-BETA: 7
LLC_BETA compile: 7
--- Changes Detail ---
New Test Passes:
New Test Failures:
SingleSource/Benchmarks/Misc/lowercase [JIT, JIT codegen]
Added Tests:
SingleSource/Benchmarks/Misc/lowercase [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Removed Tests:
Significant Changes in Test Results:
LLC:
Externals/SPEC/CFP2006/433_milc/433_milc: 8.97% (10.9200 => 11.9000)
Externals/SPEC/CINT2000/181_mcf/181_mcf: 13.20% (5.1500 => 5.8300)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 11.68% (4.8800 => 5.4500)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 12.73% (12.1800 => 13.7300)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 9.48% (3.2700 => 3.5800)
Externals/SPEC/CINT2006/429_mcf/429_mcf: 5.98% (3.0100 => 3.1900)
MultiSource/Applications/minisat/minisat: 12.28% (8.7100 => 9.7800)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.83% (5.8100 => 6.7300)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.19% (17.7600 => 19.5700)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.66% (6.5700 => 8.1900)
MultiSource/Benchmarks/NPB-serial/is/is: 8.24% (10.9200 => 11.8200)
MultiSource/Benchmarks/Olden/bisort/bisort: 5.81% (0.8600 => 0.9100)
MultiSource/Benchmarks/Olden/health/health: 7.14% (0.4200 => 0.4500)
MultiSource/Benchmarks/Ptrdist/ft/ft: 10.53% (0.9500 => 1.0500)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.11% (1.7800 => 1.9600)
MultiSource/Benchmarks/llubenchmark/llu: 30.42% (3.5500 => 4.6300)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.40% (1.1900 => 1.2900)
SingleSource/Benchmarks/CoyoteBench/lpbench: 8.08% (9.9000 => 10.7000)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.70% (4.5300 => 5.0600)
SingleSource/Benchmarks/Misc/ffbench: 6.25% (0.9600 => 1.0200)
SingleSource/Benchmarks/Shootout-C++/ackermann: 6.43% (1.4000 => 1.4900)
SingleSource/Benchmarks/Shootout-C++/ary3: 19.01% (4.0500 => 4.8200)
SingleSource/Benchmarks/Shootout-C++/hash: 6.45% (0.9300 => 0.9900)
SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (4.3800 => 4.6400)
SingleSource/Benchmarks/Shootout-C++/heapsort: 14.18% (4.0200 => 4.5900)
SingleSource/Benchmarks/Shootout-C++/moments: 16.00% (0.2500 => 0.2900)
SingleSource/Benchmarks/Shootout/ary3: 8.66% (4.0400 => 4.3900)
SingleSource/Benchmarks/Shootout/heapsort: 7.67% (4.0400 => 4.3500)
LLC-BETA compile:
Externals/Nurbs/nurbs: 7.58% (0.8639 => 0.9294)
Externals/Povray/povray: 5.54% (8.7288 => 9.2121)
Externals/SPEC/CFP2000/183_equake/183_equake: 5.29% (0.2477 => 0.2608)
Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.65% (41.7072 => 44.0657)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 6.43% (2.7195 => 2.8944)
Externals/SPEC/CINT2000/252_eon/252_eon: 7.89% (4.3488 => 4.6918)
Externals/SPEC/CINT2000/254_gap/254_gap: 5.52% (8.1047 => 8.5524)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 6.48% (0.5605 => 0.5968)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 5.77% (17.1358 => 18.1240)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 5.05% (10.9551 => 11.5088)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 5.71% (1.7747 => 1.8761)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 7.30% (10.2592 => 11.0085)
MultiSource/Applications/SPASS/SPASS: 5.99% (8.4220 => 8.9263)
MultiSource/Applications/hexxagon/hexxagon: 9.45% (0.3197 => 0.3499)
MultiSource/Applications/minisat/minisat: 8.84% (0.3452 => 0.3757)
MultiSource/Applications/siod/siod: 6.88% (2.1940 => 2.3449)
MultiSource/Applications/treecc/treecc: 6.91% (1.5736 => 1.6823)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.85% (0.2213 => 0.2431)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.12% (1.7453 => 1.8870)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.83% (1.0348 => 1.1262)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.82% (0.4181 => 0.4508)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.47% (3.6448 => 3.9899)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.21% (0.7529 => 0.8298)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.49% (0.3505 => 0.4013)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.96% (0.9180 => 0.9911)
MultiSource/Benchmarks/Prolangs-C/football/football: 6.20% (0.7480 => 0.7944)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.44% (0.3401 => 0.3620)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.32% (0.5955 => 0.6272)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.91% (0.4638 => 0.5144)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.2418 => 0.2589)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.13% (1.9855 => 2.1271)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.19% (0.6933 => 0.7293)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.18% (2.5001 => 2.8797)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.56% (0.3003 => 0.3170)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.24% (0.3156 => 0.3353)
LLC-BETA:
Externals/SPEC/CFP2000/183_equake/183_equake: 8.46% (10.6400 => 11.5400)
Externals/SPEC/CFP2000/188_ammp/188_ammp: 5.83% (22.6500 => 23.9700)
Externals/SPEC/CINT2000/181_mcf/181_mcf: 6.82% (5.1300 => 5.4800)
Externals/SPEC/CINT2000/197_parser/197_parser: 5.44% (3.3100 => 3.4900)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 5.25% (4.7600 => 5.0100)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 8.87% (12.2900 => 13.3800)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 8.54% (3.2800 => 3.5600)
MultiSource/Applications/ClamAV/clamscan: 8.00% (0.2500 => 0.2700)
MultiSource/Applications/minisat/minisat: 11.40% (8.6000 => 9.5800)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.49% (5.7800 => 6.5600)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.77% (17.7500 => 19.8400)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 23.66% (6.5500 => 8.1000)
MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.2300 => 0.2500)
MultiSource/Benchmarks/NPB-serial/is/is: 8.61% (10.9200 => 11.8600)
MultiSource/Benchmarks/Ptrdist/ft/ft: 11.46% (0.9600 => 1.0700)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.06% (2.3700 => 2.4900)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.15% (1.7900 => 1.9000)
MultiSource/Benchmarks/llubenchmark/llu: 9.40% (3.5100 => 3.8400)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.17% (1.2000 => 1.3100)
SingleSource/Benchmarks/CoyoteBench/lpbench: 16.06% (9.9000 => 11.4900)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.47% (4.5300 => 5.1400)
SingleSource/Benchmarks/Misc/ffbench: 7.29% (0.9600 => 1.0300)
SingleSource/Benchmarks/Shootout-C++/ackermann: 6.43% (1.4000 => 1.4900)
SingleSource/Benchmarks/Shootout-C++/ary3: 13.09% (4.0500 => 4.5800)
SingleSource/Benchmarks/Shootout-C++/hash: 11.83% (0.9300 => 1.0400)
SingleSource/Benchmarks/Shootout-C++/methcall: 5.34% (5.8000 => 6.1100)
SingleSource/Benchmarks/Shootout-C++/moments: 16.00% (0.2500 => 0.2900)
SingleSource/Benchmarks/Shootout/ary3: 9.41% (4.0400 => 4.4200)
SingleSource/Benchmarks/Shootout/heapsort: 5.45% (4.0400 => 4.2600)
LLC compile:
Externals/SPEC/CFP2000/188_ammp/188_ammp: 15.90% (1.4853 => 1.7215)
Externals/SPEC/CFP2006/450_soplex/450_soplex: 6.05% (5.3485 => 5.6719)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 7.56% (0.6547 => 0.7042)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 5.39% (21.1465 => 22.2855)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 6.40% (2.6946 => 2.8671)
Externals/SPEC/CINT2000/197_parser/197_parser: 6.24% (2.1637 => 2.2987)
Externals/SPEC/CINT2000/254_gap/254_gap: 11.13% (7.9796 => 8.8676)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 6.78% (6.4000 => 6.8340)
Externals/SPEC/CINT2000/300_twolf/300_twolf: 7.30% (3.0990 => 3.3252)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 5.24% (16.5363 => 17.4030)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 6.94% (10.0973 => 10.7978)
MultiSource/Applications/JM/lencod/lencod: 5.63% (8.1940 => 8.6557)
MultiSource/Applications/minisat/minisat: 7.18% (0.3357 => 0.3598)
MultiSource/Applications/siod/siod: 6.26% (2.1469 => 2.2812)
MultiSource/Applications/spiff/spiff: 6.80% (0.3660 => 0.3909)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.94% (3.3310 => 3.5622)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.15% (0.2181 => 0.2446)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.81% (0.6764 => 0.7157)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.84% (0.3701 => 0.3991)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.49% (1.7043 => 1.8660)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.30% (1.0203 => 1.1152)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.19% (0.4114 => 0.4492)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 9.05% (0.2200 => 0.2399)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.70% (0.7448 => 0.8245)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.24% (0.3418 => 0.3768)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.51% (0.9033 => 1.0344)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.66% (0.4208 => 0.4446)
MultiSource/Benchmarks/Prolangs-C/football/football: 6.10% (0.7347 => 0.7795)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.59% (0.2662 => 0.2944)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.99% (0.3377 => 0.3613)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.87% (0.2386 => 0.2526)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.44% (0.4152 => 0.4461)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.73% (2.4451 => 2.7074)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.36% (0.3071 => 0.3297)
CBE:
Externals/SPEC/CFP2006/433_milc/433_milc: 5.25% (10.4800 => 11.0300)
Externals/SPEC/CINT2000/181_mcf/181_mcf: 9.42% (5.2000 => 5.6900)
Externals/SPEC/CINT2000/197_parser/197_parser: 6.95% (3.3100 => 3.5400)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 5.95% (4.3700 => 4.6300)
MultiSource/Applications/SPASS/SPASS: 8.76% (9.8200 => 10.6800)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.20% (5.9100 => 6.6900)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.51% (18.1700 => 20.0800)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 27.42% (8.9700 => 11.4300)
MultiSource/Benchmarks/NPB-serial/is/is: 9.52% (10.8200 => 11.8500)
MultiSource/Benchmarks/Olden/bisort/bisort: 5.06% (0.7900 => 0.8300)
MultiSource/Benchmarks/Ptrdist/ft/ft: 22.00% (1.0000 => 1.2200)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.90% (2.0200 => 2.2200)
MultiSource/Benchmarks/llubenchmark/llu: 15.28% (3.8600 => 4.4500)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.29% (1.4300 => 1.5200)
SingleSource/Benchmarks/CoyoteBench/lpbench: 7.86% (10.1800 => 10.9800)
SingleSource/Benchmarks/Shootout-C++/ackermann: 15.23% (1.9700 => 2.2700)
SingleSource/Benchmarks/Shootout-C++/ary3: 19.16% (4.0700 => 4.8500)
SingleSource/Benchmarks/Shootout-C++/hash: 13.40% (0.9700 => 1.1000)
SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (5.3100 => 5.7000)
SingleSource/Benchmarks/Shootout/ary3: 5.91% (4.0600 => 4.3000)
SingleSource/Benchmarks/Shootout/heapsort: 6.60% (5.3000 => 5.6500)
More information about the llvm-testresults
mailing list