[llvm-testresults] Geryon-X86-64 nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Jan 27 02:09:17 PST 2010


http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/4954/
Name:  clattner2.apple.com
Nickname: Geryon-X86-64:4

Run: 4954, Start Time: 2010-01-26 23:01:21, End Time: 2010-01-27 02:05:29
Comparing To: 4935, Start Time: 2010-01-25 23:08:56, End Time: 2010-01-26 02:14:31

--- Changes Summary ---
New Test Passes: 2
New Test Failures: 13
Added Tests: 0
Removed Tests: 0
Significant Changes: 156

--- Tests Summary ---
Total Tests: 3879
Total Test Failures: 176

Total Test Failures By Type:
  CBE: 53
  JIT: 29
  JIT codegen: 60
  LLC: 8
  LLC compile: 8
  LLC-BETA: 9
  LLC_BETA compile: 9

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC-BETA, LLC_BETA compile]

New Test Failures:
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/lencod/lencod [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/SPEC/CFP2006/433_milc/433_milc: -19.09% (214352.0000 => 173424.0000)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -6.65% (414544.0000 => 386960.0000)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -10.30% (1667664.0000 => 1495936.0000)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -38.26% (1213520.0000 => 749168.0000)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 7.24% (66720.0000 => 71552.0000)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -5.28% (2878048.0000 => 2726176.0000)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -33.65% (53344.0000 => 35392.0000)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -10.64% (1733280.0000 => 1548880.0000)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -8.63% (10372752.0000 => 9478016.0000)
 MultiSource/Applications/ClamAV/clamscan: -8.37% (1485760.0000 => 1361392.0000)
 MultiSource/Applications/JM/ldecod/ldecod: -5.49% (646128.0000 => 610640.0000)
 MultiSource/Applications/SIBsim4/SIBsim4: -5.69% (94800.0000 => 89408.0000)
 MultiSource/Applications/hexxagon/hexxagon: -9.53% (45008.0000 => 40720.0000)
 MultiSource/Applications/lua/lua: -29.84% (704560.0000 => 494304.0000)
 MultiSource/Applications/sqlite3/sqlite3: -5.50% (1502608.0000 => 1420032.0000)
 MultiSource/Applications/treecc/treecc: 15.38% (364400.0000 => 420432.0000)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.63% (90048.0000 => 84976.0000)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.65% (438000.0000 => 413264.0000)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -62.41% (29072.0000 => 10928.0000)
 MultiSource/Benchmarks/Olden/treeadd/treeadd: -6.16% (3376.0000 => 3168.0000)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 446.71% (29184.0000 => 159552.0000)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -19.33% (54464.0000 => 43936.0000)
 MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -33.91% (36944.0000 => 24416.0000)
 MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (7696.0000 => 7104.0000)
 MultiSource/Benchmarks/mafft/pairlocalalign: -11.01% (344736.0000 => 306768.0000)
 MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.17% (13936.0000 => 13216.0000)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -10.71% (103552.0000 => 92464.0000)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -14.37% (423232.0000 => 362432.0000)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 21.83% (4544.0000 => 5536.0000)
JIT codegen:
 MultiSource/Applications/ClamAV/clamscan: -10.05% (5.1181 => 4.6039)
 MultiSource/Applications/SIBsim4/SIBsim4: -14.11% (0.6200 => 0.5325)
 MultiSource/Applications/hexxagon/hexxagon: -12.23% (0.2797 => 0.2455)
 MultiSource/Applications/lua/lua: -23.71% (2.5218 => 1.9238)
 MultiSource/Applications/siod/siod: -11.27% (1.0370 => 0.9201)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.76% (2.1893 => 2.3810)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.03% (0.3266 => 0.3069)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.68% (1.5979 => 1.4911)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -9.77% (0.5332 => 0.4811)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.70% (7.1886 => 6.4194)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -30.29% (0.3470 => 0.2419)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.24% (1.2343 => 1.1079)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -8.81% (0.4677 => 0.4265)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -9.17% (0.2563 => 0.2328)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -34.06% (1.1261 => 0.7426)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.11% (0.7196 => 0.6828)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -25.88% (0.5472 => 0.4056)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -31.33% (4.7452 => 3.2587)
CBE:
 Externals/SPEC/CFP2000/183_equake/183_equake: 5.40% (8.7000 => 9.1700)
 MultiSource/Applications/SIBsim4/SIBsim4: -18.75% (4.0000 => 3.2500)
 MultiSource/Applications/siod/siod: 5.68% (3.1700 => 3.3500)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 49.37% (0.7900 => 1.1800)
 SingleSource/Benchmarks/Shootout/ary3: 5.35% (3.5500 => 3.7400)
LLC-BETA:
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -5.01% (6.7800 => 6.4400)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (17.8000 => 16.8200)
 MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.69% (0.3900 => 0.4200)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 31.46% (0.8900 => 1.1700)
 SingleSource/Benchmarks/Shootout-C++/ary3: 7.23% (3.4600 => 3.7100)
 SingleSource/Benchmarks/Shootout/ary3: 6.59% (3.4900 => 3.7200)
LLC compile:
 Externals/SPEC/CFP2006/433_milc/433_milc: -13.30% (1.1766 => 1.0201)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -5.11% (2.9510 => 2.8002)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -14.22% (10.5871 => 9.0818)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -61.52% (13.6102 => 5.2372)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.68% (0.3890 => 0.4111)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -7.12% (18.0531 => 16.7683)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 7.17% (60.7874 => 65.1445)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -9.19% (13.1530 => 11.9446)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -26.65% (0.3156 => 0.2315)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -11.19% (52.3918 => 46.5303)
 MultiSource/Applications/ClamAV/clamscan: -13.49% (10.5279 => 9.1078)
 MultiSource/Applications/SIBsim4/SIBsim4: -14.45% (0.6893 => 0.5897)
 MultiSource/Applications/hexxagon/hexxagon: -7.66% (0.3236 => 0.2988)
 MultiSource/Applications/lemon/lemon: -9.14% (0.7760 => 0.7051)
 MultiSource/Applications/lua/lua: -30.97% (4.1434 => 2.8602)
 MultiSource/Applications/treecc/treecc: 16.54% (2.1809 => 2.5416)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.65% (0.3631 => 0.3426)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -7.04% (2.6561 => 2.4692)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.51% (1.1160 => 1.0545)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -15.49% (11.9125 => 10.0674)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -24.01% (0.4836 => 0.3675)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.69% (1.3214 => 1.1801)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.90% (0.6190 => 0.5825)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.30% (0.2879 => 0.2640)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -22.06% (0.4860 => 0.3788)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -33.48% (1.3535 => 0.9004)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -13.67% (0.7133 => 0.6158)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -32.76% (5.0450 => 3.3924)
GCCAS:
 Externals/SPEC/CFP2006/433_milc/433_milc: -18.15% (1.2213 => 0.9996)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -11.67% (3.7448 => 3.3079)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -12.73% (0.3895 => 0.3399)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -7.24% (7.1130 => 6.5980)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -14.61% (3.2069 => 2.7383)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -16.91% (0.3200 => 0.2659)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -6.28% (42.8720 => 40.1804)
 MultiSource/Applications/SIBsim4/SIBsim4: -7.65% (0.5909 => 0.5457)
 MultiSource/Applications/lua/lua: -17.89% (2.0594 => 1.6909)
 MultiSource/Applications/treecc/treecc: -6.02% (1.1810 => 1.1099)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -10.55% (0.2247 => 0.2010)
 MultiSource/Benchmarks/mafft/pairlocalalign: -14.25% (4.8017 => 4.1176)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.82% (1.7140 => 1.5971)
JIT:
 Externals/SPEC/CINT2000/176_gcc/176_gcc: -5.53% (22.4100 => 21.1700)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -11.80% (12.1200 => 10.6900)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -47.08% (12.4900 => 6.6100)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -6.23% (15.4000 => 14.4400)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 5.46% (41.2300 => 43.4800)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 8.31% (3.1300 => 3.3900)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -11.25% (19.4700 => 17.2800)
 MultiSource/Applications/ClamAV/clamscan: -9.27% (5.6100 => 5.0900)
 MultiSource/Applications/lemon/lemon: -8.65% (185.3400 => 169.3100)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.33% (0.6000 => 0.5500)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.10% (7.7200 => 6.9400)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.57% (0.5100 => 0.4000)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 1037.50% (0.2400 => 2.7300)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -27.78% (0.3600 => 0.2600)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.00% (1.3000 => 1.1700)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.12% (0.4900 => 0.4600)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.57% (0.3500 => 0.3200)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.82% (0.4400 => 0.4100)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -19.47% (1.9000 => 1.5300)
 MultiSource/Benchmarks/mafft/pairlocalalign: -12.74% (30.7700 => 26.8500)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.00% (0.8000 => 0.7600)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -22.95% (0.6100 => 0.4700)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -23.71% (6.2000 => 4.7300)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 29.35% (0.9200 => 1.1900)
 SingleSource/Benchmarks/Shootout/ary3: 8.75% (3.4300 => 3.7300)
 SingleSource/Benchmarks/Shootout/sieve: 10.42% (5.7600 => 6.3600)
LLC:
 SingleSource/Benchmarks/BenchmarkGame/recursive: 32.18% (0.8700 => 1.1500)
LLC-BETA compile:
 Externals/SPEC/CFP2006/433_milc/433_milc: -13.97% (1.1815 => 1.0165)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -5.44% (2.9534 => 2.7927)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -14.23% (10.6198 => 9.1091)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -61.54% (13.6480 => 5.2486)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.17% (0.3887 => 0.4088)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -7.45% (18.4510 => 17.0762)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 7.30% (60.4944 => 64.9100)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -9.50% (13.1525 => 11.9028)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -26.90% (0.3160 => 0.2310)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -11.25% (52.5433 => 46.6298)
 MultiSource/Applications/ClamAV/clamscan: -13.41% (10.5527 => 9.1377)
 MultiSource/Applications/SIBsim4/SIBsim4: -14.78% (0.6936 => 0.5911)
 MultiSource/Applications/hexxagon/hexxagon: -8.45% (0.3244 => 0.2970)
 MultiSource/Applications/lemon/lemon: -9.41% (0.7766 => 0.7035)
 MultiSource/Applications/lua/lua: -30.71% (4.1478 => 2.8740)
 MultiSource/Applications/siod/siod: -5.21% (2.6011 => 2.4656)
 MultiSource/Applications/treecc/treecc: 16.46% (2.1826 => 2.5418)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.84% (0.3610 => 0.3399)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.72% (2.6533 => 2.4751)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (1.1188 => 1.0551)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -15.63% (11.6696 => 9.8458)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.26% (3.6716 => 3.4783)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -24.50% (0.4873 => 0.3679)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -11.29% (1.3236 => 1.1742)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.6175 => 0.5808)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -7.78% (0.2868 => 0.2645)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -24.07% (0.4835 => 0.3671)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -33.31% (1.3583 => 0.9058)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -14.44% (0.7114 => 0.6087)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -31.29% (5.0417 => 3.4642)



More information about the llvm-testresults mailing list