[llvm-testresults] Geryon-X86-64-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Wed Dec 9 05:41:44 PST 2009
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3627/
Name: clattner2.apple.com
Nickname: Geryon-X86-64-PIC:4
Run: 3627, Start Time: 2009-12-09 02:25:10, End Time: 2009-12-09 05:37:49
Comparing To: 3607, Start Time: 2009-12-08 02:21:42, End Time: 2009-12-08 05:37:51
--- Changes Summary ---
New Test Passes: 1
New Test Failures: 7
Added Tests: 9
Removed Tests: 0
Significant Changes: 187
--- Tests Summary ---
Total Tests: 3843
Total Test Failures: 144
Total Test Failures By Type:
CBE: 56
JIT: 26
JIT codegen: 26
LLC: 5
LLC compile: 5
LLC-BETA: 13
LLC_BETA compile: 13
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen]
New Test Failures:
SingleSource/UnitTests/2009-12-07-StructReturn [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Added Tests:
SingleSource/UnitTests/2009-12-07-StructReturn [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Removed Tests:
Significant Changes in Test Results:
Bitcode:
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.09% (5984.0000 => 6528.0000)
CBE:
Externals/SPEC/CFP2000/183_equake/183_equake: -6.61% (9.2300 => 8.6200)
SingleSource/Benchmarks/Shootout-C++/ary3: -5.61% (3.7400 => 3.5300)
LLC-BETA:
Externals/SPEC/CFP2000/183_equake/183_equake: -5.31% (9.2200 => 8.7300)
Externals/SPEC/CINT2000/252_eon/252_eon: -7.41% (0.2700 => 0.2500)
MultiSource/Benchmarks/FreeBench/mason/mason: -8.00% (0.2500 => 0.2300)
SingleSource/Benchmarks/CoyoteBench/huffbench: 8.90% (14.6000 => 15.9000)
SingleSource/Benchmarks/Shootout-C++/ary3: -6.43% (3.7300 => 3.4900)
LLC compile:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -18.97% (6.4351 => 5.2146)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -14.76% (2.2669 => 1.9322)
Externals/SPEC/CFP2006/433_milc/433_milc: -9.82% (1.2703 => 1.1456)
Externals/SPEC/CFP2006/444_namd/444_namd: -13.36% (2.6584 => 2.3032)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -17.72% (9.1361 => 7.5173)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -18.46% (5.0954 => 4.1546)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -13.41% (0.4801 => 0.4157)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -12.33% (2.1427 => 1.8784)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -16.36% (29.7211 => 24.8583)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -13.08% (3.2259 => 2.8038)
Externals/SPEC/CINT2000/197_parser/197_parser: -16.97% (2.8470 => 2.3640)
Externals/SPEC/CINT2000/252_eon/252_eon: -9.41% (5.3379 => 4.8357)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -17.20% (12.1334 => 10.0465)
Externals/SPEC/CINT2000/254_gap/254_gap: -18.27% (9.4217 => 7.7001)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -16.73% (15.4075 => 12.8298)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -11.27% (0.4143 => 0.3676)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -12.85% (3.2068 => 2.7948)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -18.03% (20.8763 => 17.1124)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -9.79% (1.1848 => 1.0688)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -15.66% (68.2841 => 57.5934)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -16.77% (15.1216 => 12.5850)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -12.77% (2.8764 => 2.5092)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -9.67% (3.7559 => 3.3926)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -15.58% (0.3504 => 0.2958)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -11.71% (7.2388 => 6.3911)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -14.69% (17.4906 => 14.9207)
Externals/SPEC/CINT2006/473_astar/473_astar: -15.48% (0.4024 => 0.3401)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -20.20% (62.6255 => 49.9778)
MultiSource/Applications/ClamAV/clamscan: -14.16% (11.6618 => 10.0103)
MultiSource/Applications/JM/ldecod/ldecod: -13.22% (3.8218 => 3.3166)
MultiSource/Applications/JM/lencod/lencod: -11.48% (9.0517 => 8.0127)
MultiSource/Applications/SIBsim4/SIBsim4: -12.90% (0.7421 => 0.6464)
MultiSource/Applications/SPASS/SPASS: -12.39% (13.0321 => 11.4176)
MultiSource/Applications/d/make_dparser: -16.23% (1.7876 => 1.4974)
MultiSource/Applications/hbd/hbd: -13.97% (0.5940 => 0.5110)
MultiSource/Applications/hexxagon/hexxagon: -15.25% (0.3711 => 0.3145)
MultiSource/Applications/kimwitu++/kc: -14.28% (19.1908 => 16.4501)
MultiSource/Applications/lambda-0_1_3/lambda: -22.34% (0.5488 => 0.4262)
MultiSource/Applications/lemon/lemon: -14.17% (0.8633 => 0.7410)
MultiSource/Applications/lua/lua: -17.99% (4.7898 => 3.9281)
MultiSource/Applications/minisat/minisat: -14.14% (0.3345 => 0.2872)
MultiSource/Applications/oggenc/oggenc: -13.77% (2.4139 => 2.0816)
MultiSource/Applications/siod/siod: -19.84% (3.1992 => 2.5644)
MultiSource/Applications/spiff/spiff: -15.07% (0.3987 => 0.3386)
MultiSource/Applications/sqlite3/sqlite3: -16.37% (10.6719 => 8.9244)
MultiSource/Applications/treecc/treecc: -19.05% (2.5680 => 2.0787)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.14% (3.4770 => 3.0200)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -12.49% (0.5059 => 0.4427)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -15.51% (0.4088 => 0.3454)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -13.92% (2.9534 => 2.5422)
MultiSource/Benchmarks/MallocBench/gs/gs: -21.23% (2.4304 => 1.9144)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.16% (0.3579 => 0.3287)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.63% (1.2827 => 1.0566)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.09% (1.6902 => 1.5197)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.11% (12.7684 => 11.4771)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -14.22% (1.2371 => 1.0612)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.00% (0.3701 => 0.3109)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -23.78% (0.3566 => 0.2718)
MultiSource/Benchmarks/PAQ8p/paq8p: -12.87% (1.7996 => 1.5680)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.43% (3.9585 => 3.5059)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -15.79% (0.6974 => 0.5873)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -11.96% (0.5375 => 0.4732)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.48% (1.4238 => 1.2746)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -7.96% (0.6823 => 0.6280)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -18.83% (0.3340 => 0.2711)
MultiSource/Benchmarks/Prolangs-C/football/football: -12.65% (0.8934 => 0.7804)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -14.35% (0.3177 => 0.2721)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -17.24% (0.4796 => 0.3969)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -13.36% (0.3646 => 0.3159)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -14.90% (0.7425 => 0.6319)
MultiSource/Benchmarks/Ptrdist/bc/bc: -12.44% (1.5059 => 1.3185)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.58% (0.7400 => 0.6469)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.50% (0.3021 => 0.2583)
MultiSource/Benchmarks/mafft/pairlocalalign: -11.11% (2.3869 => 2.1218)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.56% (0.3733 => 0.3115)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.85% (1.3626 => 1.1330)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -13.42% (0.7766 => 0.6724)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -12.76% (17.2149 => 15.0184)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -7.25% (1.9803 => 1.8367)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.26% (1.2086 => 1.1088)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -17.41% (0.2849 => 0.2353)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -18.49% (0.2829 => 0.2306)
SingleSource/Benchmarks/Misc-C++/bigfib: -17.89% (0.2744 => 0.2253)
GCCAS:
Externals/SPEC/CFP2000/188_ammp/188_ammp: -9.67% (2.8136 => 2.5416)
Externals/SPEC/CFP2006/433_milc/433_milc: -25.53% (1.6528 => 1.2309)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -6.40% (21.8794 => 20.4798)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -5.08% (61.6131 => 58.4831)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -5.13% (6.8603 => 6.5086)
MultiSource/Applications/ClamAV/clamscan: -16.32% (8.1742 => 6.8405)
MultiSource/Applications/oggenc/oggenc: -6.30% (2.9318 => 2.7471)
MultiSource/Applications/sqlite3/sqlite3: -14.06% (8.4956 => 7.3014)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.38% (4.2668 => 3.8665)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -12.66% (1.9952 => 1.7427)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -17.12% (1.7310 => 1.4347)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -14.87% (2.8400 => 2.4178)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -12.33% (2.0075 => 1.7599)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.59% (40.1340 => 37.8889)
JIT:
MultiSource/Benchmarks/mafft/pairlocalalign: 11.68% (26.9700 => 30.1200)
SingleSource/Benchmarks/CoyoteBench/huffbench: 7.87% (14.9900 => 16.1700)
SingleSource/Benchmarks/Shootout/sieve: -11.10% (7.3000 => 6.4900)
LLC:
MultiSource/Benchmarks/FreeBench/mason/mason: -8.00% (0.2500 => 0.2300)
SingleSource/Benchmarks/CoyoteBench/huffbench: 8.84% (14.5900 => 15.8800)
SingleSource/Benchmarks/Shootout/ary3: -5.91% (3.7200 => 3.5000)
LLC-BETA compile:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -18.85% (6.6247 => 5.3762)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -14.07% (2.3001 => 1.9764)
Externals/SPEC/CFP2006/433_milc/433_milc: -10.01% (1.3079 => 1.1770)
Externals/SPEC/CFP2006/444_namd/444_namd: -13.41% (2.6960 => 2.3346)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -17.00% (9.5003 => 7.8849)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -12.91% (0.4874 => 0.4245)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -12.20% (2.1702 => 1.9055)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -12.54% (3.2663 => 2.8566)
Externals/SPEC/CINT2000/197_parser/197_parser: -16.88% (2.8881 => 2.4006)
Externals/SPEC/CINT2000/252_eon/252_eon: -9.21% (5.4822 => 4.9772)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -16.92% (12.3307 => 10.2448)
Externals/SPEC/CINT2000/254_gap/254_gap: -18.07% (9.5509 => 7.8248)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -16.93% (15.5266 => 12.8977)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -11.93% (0.4224 => 0.3720)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -12.95% (3.2296 => 2.8113)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -17.13% (21.1737 => 17.5473)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -9.19% (1.2021 => 1.0916)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -16.97% (15.1824 => 12.6065)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -12.51% (2.8988 => 2.5361)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -9.85% (3.7362 => 3.3683)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -14.22% (0.3565 => 0.3058)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -11.42% (7.3251 => 6.4888)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -14.51% (17.7007 => 15.1331)
Externals/SPEC/CINT2006/473_astar/473_astar: -14.67% (0.4062 => 0.3466)
MultiSource/Applications/ClamAV/clamscan: -13.95% (11.8117 => 10.1637)
MultiSource/Applications/JM/lencod/lencod: -11.56% (9.2167 => 8.1509)
MultiSource/Applications/SIBsim4/SIBsim4: -12.35% (0.7621 => 0.6680)
MultiSource/Applications/SPASS/SPASS: -12.21% (13.1549 => 11.5488)
MultiSource/Applications/d/make_dparser: -15.67% (1.8235 => 1.5378)
MultiSource/Applications/hbd/hbd: -13.43% (0.5959 => 0.5159)
MultiSource/Applications/hexxagon/hexxagon: -14.85% (0.3785 => 0.3223)
MultiSource/Applications/kimwitu++/kc: -13.54% (19.2499 => 16.6437)
MultiSource/Applications/lambda-0_1_3/lambda: -22.13% (0.5603 => 0.4363)
MultiSource/Applications/lemon/lemon: -14.46% (0.8795 => 0.7523)
MultiSource/Applications/lua/lua: -17.59% (4.8906 => 4.0302)
MultiSource/Applications/minisat/minisat: -15.96% (0.3478 => 0.2923)
MultiSource/Applications/oggenc/oggenc: -13.53% (2.4505 => 2.1189)
MultiSource/Applications/siod/siod: -19.54% (3.2634 => 2.6257)
MultiSource/Applications/spiff/spiff: -15.84% (0.4073 => 0.3428)
MultiSource/Applications/sqlite3/sqlite3: -16.39% (10.8844 => 9.1000)
MultiSource/Applications/treecc/treecc: -19.71% (2.6088 => 2.0946)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -12.75% (3.5052 => 3.0584)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -12.81% (0.5143 => 0.4484)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -15.05% (0.4153 => 0.3528)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -14.12% (2.9916 => 2.5691)
MultiSource/Benchmarks/MallocBench/gs/gs: -21.33% (2.5020 => 1.9682)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.81% (0.3650 => 0.3365)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.26% (1.3107 => 1.0845)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.27% (1.7171 => 1.5407)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -14.22% (1.2538 => 1.0755)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.06% (0.3798 => 0.3188)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.68% (0.3547 => 0.2778)
MultiSource/Benchmarks/PAQ8p/paq8p: -12.95% (1.8394 => 1.6012)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.18% (4.0092 => 3.5609)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -15.53% (0.7091 => 0.5990)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.43% (0.5383 => 0.4714)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.05% (1.4373 => 1.2929)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -9.02% (0.6877 => 0.6257)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -18.20% (0.3351 => 0.2741)
MultiSource/Benchmarks/Prolangs-C/football/football: -12.47% (0.8933 => 0.7819)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -14.87% (0.3235 => 0.2754)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -16.76% (0.4863 => 0.4048)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -12.81% (0.3661 => 0.3192)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -14.60% (0.7467 => 0.6377)
MultiSource/Benchmarks/Ptrdist/bc/bc: -12.20% (1.5140 => 1.3293)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -13.43% (0.7399 => 0.6405)
MultiSource/Benchmarks/mafft/pairlocalalign: -10.73% (2.4158 => 2.1567)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.28% (0.3782 => 0.3204)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -17.10% (1.4097 => 1.1686)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -11.93% (0.7905 => 0.6962)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.17% (5.2478 => 4.9765)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.79% (1.9974 => 1.8618)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.30% (1.2182 => 1.1415)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -17.57% (0.2954 => 0.2435)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -17.97% (0.2871 => 0.2355)
SingleSource/Benchmarks/Misc-C++/bigfib: -17.63% (0.2785 => 0.2294)
More information about the llvm-testresults
mailing list