[llvm-testresults] Geryon-X86-64-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Nov 4 05:29:05 PST 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/2782/
Name:  clattner2.apple.com
Nickname: Geryon-X86-64-PIC:3
Buildstatus: OK

Run: 2782, Start Time: 2009-11-04 02:18:22
Comparing To: 2758, Start Time: 2009-11-03 02:33:58

--- Changes Summary ---
New Test Passes: 77
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 171

--- Tests Summary ---
Total Tests: 3834
Total Test Failures: 130

Total Test Failures By Type:
  CBE: 58
  JIT: 26
  JIT codegen: 26
  LLC: 5
  LLC compile: 5
  LLC-BETA: 5
  LLC_BETA compile: 5

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2006/433_milc/433_milc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/197_parser/197_parser [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/kimwitu++/kc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/bh/bh [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/health/health [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/mst/mst [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/power/power [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/voronoi/voronoi [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/SPEC/CINT2000/197_parser/197_parser: 58.55% (254288.0000 => 403168.0000)
 MultiSource/Benchmarks/Olden/bh/bh: 306.89% (7200.0000 => 29296.0000)
 MultiSource/Benchmarks/Olden/health/health: 132.07% (6736.0000 => 15632.0000)
 MultiSource/Benchmarks/Olden/mst/mst: 26.00% (3200.0000 => 4032.0000)
 MultiSource/Benchmarks/Olden/power/power: 188.89% (2736.0000 => 7904.0000)
 MultiSource/Benchmarks/Olden/voronoi/voronoi: 318.66% (3344.0000 => 14000.0000)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2631.15% (148864.0000 => 4065696.0000)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.77% (39920.0000 => 37216.0000)
 SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.77% (10144.0000 => 12048.0000)
 SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.79% (11808.0000 => 13200.0000)
JIT codegen:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 19.18% (1.3553 => 1.6153)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 20.79% (0.3573 => 0.4316)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 17.49% (0.9563 => 1.1236)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 8.43% (19.7057 => 21.3669)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 13.96% (2.5173 => 2.8687)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 15.59% (5.3132 => 6.1415)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 9.25% (11.4326 => 12.4903)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 11.59% (0.3554 => 0.3966)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 10.14% (2.0724 => 2.2826)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 8.84% (8.1731 => 8.8958)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 7.80% (41.4047 => 44.6336)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 6.41% (2.4027 => 2.5568)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 19.44% (1.1267 => 1.3457)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 114.32% (1.2818 => 2.7472)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 8.70% (4.6263 => 5.0288)
 MultiSource/Applications/ClamAV/clamscan: 8.19% (4.8480 => 5.2449)
 MultiSource/Applications/JM/lencod/lencod: 7.57% (6.0704 => 6.5297)
 MultiSource/Applications/SPASS/SPASS: 38.78% (6.0686 => 8.4220)
 MultiSource/Applications/hexxagon/hexxagon: 19.79% (0.2572 => 0.3081)
 MultiSource/Applications/siod/siod: 9.60% (1.0485 => 1.1492)
 MultiSource/Applications/spiff/spiff: 10.89% (0.3159 => 0.3503)
 MultiSource/Applications/sqlite3/sqlite3: 5.16% (6.3024 => 6.6274)
 MultiSource/Applications/treecc/treecc: 5.68% (0.4630 => 0.4893)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.56% (1.1151 => 1.2329)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 50.82% (6.6431 => 10.0188)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.28% (0.2452 => 0.2704)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.95% (0.5809 => 0.6968)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 38.37% (0.2898 => 0.4010)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.30% (1.1549 => 1.2508)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 77.51% (0.3420 => 0.6071)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.40% (0.2571 => 0.2864)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 64.71% (0.7608 => 1.2531)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.81% (0.2293 => 0.2518)
 MultiSource/Benchmarks/mafft/pairlocalalign: 11.12% (0.9428 => 1.0476)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.26% (0.4738 => 0.5224)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.21% (2.7963 => 3.0539)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.48% (1.5239 => 1.6836)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.53% (0.9668 => 1.0396)
CBE:
 Externals/SPEC/CFP2000/183_equake/183_equake: -5.65% (9.0200 => 8.5100)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.92% (3.9000 => 4.5600)
LLC-BETA:
 Externals/SPEC/CFP2006/470_lbm/470_lbm: -10.17% (11.8000 => 10.6000)
 SingleSource/Benchmarks/Misc-C++/ray: 6.81% (3.8200 => 4.0800)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.09% (3.3800 => 3.8900)
LLC compile:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 16.80% (1.6590 => 1.9377)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 21.52% (0.3494 => 0.4246)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 11.08% (1.7097 => 1.8992)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 8.42% (23.1565 => 25.1074)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 13.94% (2.5317 => 2.8845)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 8.94% (9.3398 => 10.1750)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 10.20% (11.5939 => 12.7766)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 12.61% (0.3474 => 0.3912)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 9.38% (2.5291 => 2.7663)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 6.48% (16.2750 => 17.3299)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 7.06% (53.9371 => 57.7459)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 11.74% (11.3113 => 12.6387)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 12.56% (2.2272 => 2.5070)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 101.45% (1.5750 => 3.1729)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 8.24% (5.8733 => 6.3574)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 13.51% (13.4726 => 15.2924)
 MultiSource/Applications/ClamAV/clamscan: 7.46% (9.2525 => 9.9429)
 MultiSource/Applications/JM/lencod/lencod: 6.89% (7.3508 => 7.8575)
 MultiSource/Applications/SPASS/SPASS: 28.83% (8.5268 => 10.9854)
 MultiSource/Applications/hbd/hbd: 5.28% (0.4905 => 0.5164)
 MultiSource/Applications/hexxagon/hexxagon: 20.46% (0.2542 => 0.3062)
 MultiSource/Applications/lemon/lemon: 8.62% (0.6788 => 0.7373)
 MultiSource/Applications/spiff/spiff: 9.19% (0.3428 => 0.3743)
 MultiSource/Applications/sqlite3/sqlite3: 5.22% (8.6083 => 9.0576)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.57% (1.3925 => 1.5258)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 46.58% (7.7842 => 11.4103)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.56% (0.8822 => 1.0283)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.71% (3.1396 => 3.4760)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 32.28% (0.3541 => 0.4684)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.36% (1.1451 => 1.2408)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 78.97% (0.3367 => 0.6026)
 MultiSource/Benchmarks/Prolangs-C/football/football: 31.04% (0.6019 => 0.7887)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.91% (0.2813 => 0.3120)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.97% (0.5460 => 0.6332)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 61.56% (0.8020 => 1.2957)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.24% (0.2294 => 0.2529)
 MultiSource/Benchmarks/mafft/pairlocalalign: 7.16% (1.9835 => 2.1256)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.05% (0.6275 => 0.6843)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.33% (2.7782 => 3.0373)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.14% (1.5045 => 1.6721)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.67% (0.9497 => 1.0225)
GCCAS:
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.68% (67.7291 => 71.5743)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.23% (4.2850 => 4.5091)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 5.64% (43.4335 => 45.8816)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.89% (33.8213 => 35.8143)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.07% (1.7070 => 1.7936)
JIT:
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 7.65% (21.8300 => 23.5000)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 5.13% (7.8000 => 8.2000)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 6.96% (12.2200 => 13.0700)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 7.55% (14.1800 => 15.2500)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 7.20% (45.4200 => 48.6900)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 21.95% (6.6500 => 8.1100)
 MultiSource/Applications/ClamAV/clamscan: 7.50% (5.3300 => 5.7300)
 MultiSource/Applications/SPASS/SPASS: 14.63% (15.7200 => 18.0200)
 MultiSource/Applications/lemon/lemon: 7.65% (186.9400 => 201.2400)
 MultiSource/Applications/treecc/treecc: 5.88% (0.5100 => 0.5400)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (1.4600 => 1.5700)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 47.14% (7.1700 => 10.5500)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.54% (0.2600 => 0.2900)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.67% (0.6100 => 0.7300)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 35.48% (0.3100 => 0.4200)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.20% (1.2200 => 1.3200)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 72.97% (0.3700 => 0.6400)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.4200 => 0.4500)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 30.97% (1.5500 => 2.0300)
 MultiSource/Benchmarks/Ptrdist/ks/ks: 15.26% (1.9000 => 2.1900)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.26% (0.5400 => 0.5900)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.19% (4.2000 => 4.4600)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.27% (2.7100 => 2.8800)
 SingleSource/Benchmarks/Misc-C++/ray: 7.67% (3.7800 => 4.0700)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.00% (3.6000 => 4.1400)
 SingleSource/Benchmarks/Shootout/lists: 19.37% (5.4200 => 6.4700)
LLC:
 SingleSource/Benchmarks/Dhrystone/dry: -7.46% (0.6700 => 0.6200)
 SingleSource/Benchmarks/Misc-C++/ray: 6.84% (3.8000 => 4.0600)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.04% (3.4500 => 3.9000)
 SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (3.7300 => 3.5200)
 SingleSource/Benchmarks/Shootout/ary3: -6.67% (3.7500 => 3.5000)
LLC-BETA compile:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 16.55% (1.6718 => 1.9485)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 20.75% (0.3523 => 0.4254)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 10.56% (1.7223 => 1.9042)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 8.03% (23.2854 => 25.1559)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 13.23% (2.5405 => 2.8765)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 10.53% (9.2951 => 10.2738)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 10.45% (11.6116 => 12.8252)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 12.55% (0.3531 => 0.3974)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 9.49% (2.5383 => 2.7791)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 7.04% (16.3903 => 17.5449)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 7.21% (54.1928 => 58.1009)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 11.21% (11.3831 => 12.6590)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 12.27% (2.2358 => 2.5102)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 101.07% (1.5841 => 3.1852)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 8.01% (5.9222 => 6.3966)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 13.13% (13.5367 => 15.3146)
 MultiSource/Applications/ClamAV/clamscan: 7.07% (9.2850 => 9.9411)
 MultiSource/Applications/JM/lencod/lencod: 6.76% (7.4004 => 7.9007)
 MultiSource/Applications/SPASS/SPASS: 28.33% (8.5873 => 11.0204)
 MultiSource/Applications/hbd/hbd: 5.26% (0.4979 => 0.5241)
 MultiSource/Applications/hexxagon/hexxagon: 20.08% (0.2555 => 0.3068)
 MultiSource/Applications/lemon/lemon: 8.26% (0.6825 => 0.7389)
 MultiSource/Applications/minisat/minisat: 6.74% (0.2817 => 0.3007)
 MultiSource/Applications/spiff/spiff: 8.85% (0.3434 => 0.3738)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.31% (1.3964 => 1.5403)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 46.57% (7.8578 => 11.5169)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.90% (0.8863 => 1.0272)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.31% (3.1593 => 3.4849)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 33.78% (0.3552 => 0.4752)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.19% (1.1439 => 1.2490)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 80.24% (0.3370 => 0.6074)
 MultiSource/Benchmarks/Prolangs-C/football/football: 30.86% (0.6036 => 0.7899)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.28% (0.2811 => 0.3128)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.83% (0.5496 => 0.6311)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 60.59% (0.8122 => 1.3043)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.85% (0.2294 => 0.2520)
 MultiSource/Benchmarks/mafft/pairlocalalign: 7.39% (1.9864 => 2.1331)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.44% (0.6386 => 0.6861)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.39% (2.7794 => 3.0405)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.83% (1.5069 => 1.6701)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.36% (0.9552 => 1.0255)



More information about the llvm-testresults mailing list