[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Wed Dec 9 09:39:32 PST 2009
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3632/
Name: grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4
Run: 3632, Start Time: 2009-12-09 06:30:54, End Time: 2009-12-09 09:24:53
Comparing To: 3610, Start Time: 2009-12-08 06:20:14, End Time: 2009-12-08 09:17:16
--- Changes Summary ---
New Test Passes: 5
New Test Failures: 4
Added Tests: 9
Removed Tests: 0
Significant Changes: 175
--- Tests Summary ---
Total Tests: 3861
Total Test Failures: 942
Total Test Failures By Type:
CBE: 68
JIT: 429
JIT codegen: 429
LLC: 1
LLC compile: 1
LLC-BETA: 7
LLC_BETA compile: 7
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2000/255_vortex/255_vortex [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
New Test Failures:
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [LLC-BETA, LLC_BETA compile]
SingleSource/UnitTests/2009-12-07-StructReturn [JIT, JIT codegen]
Added Tests:
SingleSource/UnitTests/2009-12-07-StructReturn [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
Removed Tests:
Significant Changes in Test Results:
LLC:
Externals/SPEC/CINT2000/252_eon/252_eon: -5.08% (0.5900 => 0.5600)
LLC-BETA compile:
Externals/Nurbs/nurbs: -14.30% (0.9772 => 0.8375)
Externals/Povray/povray: -14.47% (9.9275 => 8.4908)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -15.52% (7.2162 => 6.0962)
Externals/SPEC/CFP2000/179_art/179_art: -12.07% (0.2560 => 0.2251)
Externals/SPEC/CFP2000/183_equake/183_equake: -8.88% (0.2657 => 0.2421)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -14.41% (1.7189 => 1.4712)
Externals/SPEC/CFP2006/433_milc/433_milc: -11.71% (1.7145 => 1.5138)
Externals/SPEC/CFP2006/444_namd/444_namd: -11.73% (3.8566 => 3.4043)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -15.14% (47.6071 => 40.3996)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -15.14% (6.3143 => 5.3580)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -14.57% (0.7527 => 0.6430)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -11.31% (2.0641 => 1.8307)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -11.01% (3.0083 => 2.6770)
Externals/SPEC/CINT2000/197_parser/197_parser: -14.88% (2.5181 => 2.1433)
Externals/SPEC/CINT2000/252_eon/252_eon: -9.20% (4.6432 => 4.2159)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -15.24% (10.4130 => 8.8265)
Externals/SPEC/CINT2000/254_gap/254_gap: -15.25% (9.2775 => 7.8630)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -13.52% (0.6296 => 0.5445)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -11.95% (3.4993 => 3.0813)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -15.17% (19.7719 => 16.7721)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -13.14% (1.0724 => 0.9315)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -14.62% (55.8268 => 47.6645)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -14.65% (12.4436 => 10.6205)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -13.51% (4.8544 => 4.1984)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -13.28% (1.9956 => 1.7306)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -14.37% (0.5435 => 0.4654)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -10.56% (7.8176 => 6.9923)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -15.40% (11.8468 => 10.0227)
MultiSource/Applications/ClamAV/clamscan: -14.34% (9.2775 => 7.9473)
MultiSource/Applications/JM/lencod/lencod: -11.19% (9.1659 => 8.1404)
MultiSource/Applications/SIBsim4/SIBsim4: -12.66% (0.7258 => 0.6339)
MultiSource/Applications/SPASS/SPASS: -14.77% (9.6082 => 8.1890)
MultiSource/Applications/d/make_dparser: -14.00% (1.9081 => 1.6410)
MultiSource/Applications/hbd/hbd: -12.27% (0.5965 => 0.5233)
MultiSource/Applications/hexxagon/hexxagon: -15.28% (0.3671 => 0.3110)
MultiSource/Applications/kimwitu++/kc: -15.03% (12.8128 => 10.8869)
MultiSource/Applications/lambda-0_1_3/lambda: -17.89% (0.7363 => 0.6046)
MultiSource/Applications/lemon/lemon: -15.40% (0.9635 => 0.8151)
MultiSource/Applications/lua/lua: -15.08% (2.8712 => 2.4383)
MultiSource/Applications/minisat/minisat: -14.77% (0.3926 => 0.3346)
MultiSource/Applications/oggenc/oggenc: -13.16% (3.1283 => 2.7167)
MultiSource/Applications/siod/siod: -16.24% (2.5405 => 2.1278)
MultiSource/Applications/spiff/spiff: -15.00% (0.4241 => 0.3605)
MultiSource/Applications/sqlite3/sqlite3: -14.34% (10.3478 => 8.8635)
MultiSource/Applications/treecc/treecc: -15.53% (1.8046 => 1.5243)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.03% (3.7037 => 3.2952)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.59% (0.2502 => 0.2162)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -13.73% (0.2324 => 0.2005)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.34% (0.7444 => 0.6674)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -14.35% (0.4251 => 0.3641)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -13.75% (2.8091 => 2.4229)
MultiSource/Benchmarks/MallocBench/gs/gs: -17.13% (3.0247 => 2.5065)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.71% (0.3962 => 0.3617)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -13.85% (2.1652 => 1.8654)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.85% (1.9156 => 1.7077)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -13.97% (1.1722 => 1.0085)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.96% (0.4958 => 0.4117)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -15.49% (0.2492 => 0.2106)
MultiSource/Benchmarks/PAQ8p/paq8p: -11.45% (1.5325 => 1.3571)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.49% (4.0317 => 3.5686)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -14.68% (0.8617 => 0.7352)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.98% (0.3971 => 0.3376)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -15.65% (1.0482 => 0.8842)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -10.69% (0.4707 => 0.4204)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -16.92% (0.4610 => 0.3830)
MultiSource/Benchmarks/Prolangs-C/football/football: -14.93% (0.8447 => 0.7186)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -15.06% (0.3081 => 0.2617)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -17.71% (0.5844 => 0.4809)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -16.79% (0.3954 => 0.3290)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -15.38% (0.6776 => 0.5734)
MultiSource/Benchmarks/Ptrdist/bc/bc: -13.70% (0.8946 => 0.7720)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.57% (0.5124 => 0.4480)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.99% (0.2808 => 0.2359)
MultiSource/Benchmarks/mafft/pairlocalalign: -12.25% (5.4720 => 4.8016)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.22% (0.4696 => 0.4075)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -14.00% (2.2482 => 1.9334)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -12.06% (0.7722 => 0.6791)
MultiSource/Benchmarks/sim/sim: -14.01% (0.2549 => 0.2192)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -12.53% (2.7742 => 2.4266)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -14.72% (2.1441 => 1.8285)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -13.97% (1.4851 => 1.2776)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -14.56% (0.2932 => 0.2505)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -14.23% (0.3395 => 0.2912)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -17.22% (0.3652 => 0.3023)
LLC-BETA:
MultiSource/Applications/sgefa/sgefa: 8.00% (0.7500 => 0.8100)
LLC compile:
Externals/Nurbs/nurbs: -14.88% (0.9569 => 0.8145)
Externals/Povray/povray: -14.39% (9.6720 => 8.2805)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -15.98% (7.0682 => 5.9386)
Externals/SPEC/CFP2000/179_art/179_art: -13.17% (0.2528 => 0.2195)
Externals/SPEC/CFP2000/183_equake/183_equake: -8.35% (0.2623 => 0.2404)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -13.89% (1.6910 => 1.4561)
Externals/SPEC/CFP2006/433_milc/433_milc: -11.40% (1.6706 => 1.4801)
Externals/SPEC/CFP2006/444_namd/444_namd: -11.99% (3.8353 => 3.3753)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -15.71% (45.8443 => 38.6440)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -15.26% (6.1180 => 5.1843)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -14.79% (0.7412 => 0.6316)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -11.37% (2.0371 => 1.8054)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -15.90% (24.5282 => 20.6279)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -11.27% (2.9788 => 2.6431)
Externals/SPEC/CINT2000/197_parser/197_parser: -15.88% (2.4886 => 2.0934)
Externals/SPEC/CINT2000/252_eon/252_eon: -9.66% (4.5288 => 4.0914)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -15.43% (10.2789 => 8.6929)
Externals/SPEC/CINT2000/254_gap/254_gap: -15.79% (9.1577 => 7.7118)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -13.31% (0.6213 => 0.5386)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -11.71% (3.4375 => 3.0351)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -15.69% (19.2615 => 16.2387)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -13.75% (1.0680 => 0.9212)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -14.80% (54.3059 => 46.2683)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -14.41% (12.2088 => 10.4493)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -13.98% (4.7819 => 4.1134)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -12.85% (1.9797 => 1.7253)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -12.95% (0.5259 => 0.4578)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -10.94% (7.6673 => 6.8285)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -15.93% (11.6919 => 9.8288)
Externals/SPEC/CINT2006/473_astar/473_astar: -15.02% (0.5566 => 0.4730)
MultiSource/Applications/ClamAV/clamscan: -14.53% (9.1492 => 7.8196)
MultiSource/Applications/JM/ldecod/ldecod: -12.94% (3.9422 => 3.4319)
MultiSource/Applications/JM/lencod/lencod: -11.60% (9.0262 => 7.9791)
MultiSource/Applications/SIBsim4/SIBsim4: -11.29% (0.6998 => 0.6208)
MultiSource/Applications/SPASS/SPASS: -14.76% (9.4820 => 8.0829)
MultiSource/Applications/d/make_dparser: -14.06% (1.8714 => 1.6083)
MultiSource/Applications/hbd/hbd: -12.91% (0.5904 => 0.5142)
MultiSource/Applications/hexxagon/hexxagon: -15.07% (0.3609 => 0.3065)
MultiSource/Applications/kimwitu++/kc: -15.23% (12.5424 => 10.6327)
MultiSource/Applications/lambda-0_1_3/lambda: -18.02% (0.7210 => 0.5911)
MultiSource/Applications/lemon/lemon: -14.37% (0.9432 => 0.8077)
MultiSource/Applications/lua/lua: -14.99% (2.8174 => 2.3951)
MultiSource/Applications/minisat/minisat: -14.24% (0.3835 => 0.3289)
MultiSource/Applications/oggenc/oggenc: -13.96% (3.0887 => 2.6575)
MultiSource/Applications/siod/siod: -17.10% (2.5058 => 2.0772)
MultiSource/Applications/spiff/spiff: -15.81% (0.4220 => 0.3553)
MultiSource/Applications/sqlite3/sqlite3: -14.58% (10.1687 => 8.6859)
MultiSource/Applications/treecc/treecc: -15.64% (1.7805 => 1.5021)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.79% (3.6548 => 3.2605)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.42% (0.2476 => 0.2119)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.73% (0.7355 => 0.6566)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -14.26% (0.4188 => 0.3591)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -13.80% (2.7708 => 2.3884)
MultiSource/Benchmarks/MallocBench/gs/gs: -17.29% (2.9377 => 2.4298)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.49% (0.3873 => 0.3544)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -13.88% (2.1120 => 1.8188)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -11.42% (1.8778 => 1.6634)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -11.65% (8.5328 => 7.5390)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -13.54% (1.1536 => 0.9974)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.49% (0.4737 => 0.4098)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -14.59% (0.2434 => 0.2079)
MultiSource/Benchmarks/PAQ8p/paq8p: -11.94% (1.5063 => 1.3264)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.81% (3.9854 => 3.5148)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -14.83% (0.8522 => 0.7258)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.75% (0.3956 => 0.3333)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -14.97% (1.0323 => 0.8778)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -11.25% (0.4638 => 0.4116)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -16.61% (0.4540 => 0.3786)
MultiSource/Benchmarks/Prolangs-C/football/football: -14.82% (0.8359 => 0.7120)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -16.37% (0.3085 => 0.2580)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -18.14% (0.5806 => 0.4753)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -15.05% (0.3826 => 0.3250)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -15.99% (0.6709 => 0.5636)
MultiSource/Benchmarks/Ptrdist/bc/bc: -14.44% (0.8846 => 0.7569)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -13.22% (0.5128 => 0.4450)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.81% (0.2761 => 0.2297)
MultiSource/Benchmarks/mafft/pairlocalalign: -12.07% (5.3665 => 4.7190)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.46% (0.4612 => 0.3991)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -14.66% (2.1956 => 1.8737)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -12.08% (0.7580 => 0.6664)
MultiSource/Benchmarks/sim/sim: -13.90% (0.2518 => 0.2168)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -12.69% (9.1370 => 7.9771)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -12.49% (2.7280 => 2.3872)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -14.94% (2.1148 => 1.7989)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -14.80% (1.4726 => 1.2547)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -15.10% (0.2801 => 0.2378)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -14.32% (0.3346 => 0.2867)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -16.25% (0.3557 => 0.2979)
CBE:
SingleSource/Benchmarks/Shootout-C++/hash2: 6.11% (4.5800 => 4.8600)
More information about the llvm-testresults
mailing list