[llvm-testresults] Geryon-X86-64 nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Nov 25 02:17:14 PST 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3256/
Name:  clattner2.apple.com
Nickname: Geryon-X86-64:4
Buildstatus: OK

Run: 3256, Start Time: 2009-11-24 23:09:38
Comparing To: 3087, Start Time: 2009-11-16 23:08:22

--- Changes Summary ---
New Test Passes: 2
New Test Failures: 17
Added Tests: 0
Removed Tests: 0
Significant Changes: 125

--- Tests Summary ---
Total Tests: 3834
Total Test Failures: 140

Total Test Failures By Type:
  CBE: 57
  JIT: 25
  JIT codegen: 26
  LLC: 4
  LLC compile: 4
  LLC-BETA: 12
  LLC_BETA compile: 12

--- Changes Detail ---
New Test Passes:
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction [CBE]
SingleSource/Benchmarks/Adobe-C++/stepanov_vector [CBE]

New Test Failures:
Externals/SPEC/CFP2006/450_soplex/450_soplex [LLC-BETA, LLC_BETA compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC-BETA, LLC_BETA compile]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen]
Externals/SPEC/CINT2006/403_gcc/403_gcc [LLC-BETA, LLC_BETA compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [LLC-BETA, LLC_BETA compile]
MultiSource/Applications/JM/ldecod/ldecod [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/VersaBench/dbms/dbms [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [LLC-BETA, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (171040.0000 => 179680.0000)
 MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.96% (7232.0000 => 7808.0000)
 SingleSource/Benchmarks/CoyoteBench/fftbench: -5.06% (14240.0000 => 13520.0000)
 SingleSource/Benchmarks/Shootout-C++/reversefile: 23.44% (9216.0000 => 11376.0000)
JIT codegen:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: -6.52% (1.5505 => 1.4494)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -5.89% (0.4144 => 0.3900)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -8.02% (2.5757 => 2.3691)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -8.62% (1.1421 => 1.0437)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -6.84% (5.4171 => 5.0468)
 MultiSource/Applications/JM/ldecod/ldecod: -6.70% (2.9857 => 2.7857)
 MultiSource/Applications/JM/lencod/lencod: -10.47% (7.2179 => 6.4619)
 MultiSource/Applications/SPASS/SPASS: -5.04% (8.8312 => 8.3860)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.05% (2.5623 => 2.4329)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.43% (0.3500 => 0.3205)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -12.77% (0.7371 => 0.6430)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.22% (0.2336 => 0.2214)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.31% (1.4527 => 1.3320)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.41% (0.8084 => 0.7081)
 MultiSource/Benchmarks/mafft/pairlocalalign: -6.66% (1.1418 => 1.0658)
 MultiSource/Benchmarks/sim/sim: -7.91% (0.2249 => 0.2071)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -22.49% (6.2888 => 4.8747)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -29.28% (2.7136 => 1.9190)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -36.66% (1.7574 => 1.1132)
CBE:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -6.22% (2.4100 => 2.2600)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -7.14% (0.2800 => 0.2600)
 SingleSource/Benchmarks/CoyoteBench/fftbench: 21.43% (2.1000 => 2.5500)
 SingleSource/Benchmarks/Dhrystone/dry: -9.30% (0.4300 => 0.3900)
 SingleSource/Benchmarks/Dhrystone/fldry: 13.10% (1.6800 => 1.9000)
 SingleSource/Benchmarks/Shootout-C++/ary3: 6.84% (3.5100 => 3.7500)
 SingleSource/Benchmarks/Shootout/ary3: 5.65% (3.5400 => 3.7400)
 SingleSource/Benchmarks/Shootout/matrix: -5.81% (3.4400 => 3.2400)
LLC-BETA:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -6.30% (2.3800 => 2.2300)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -5.20% (6.1500 => 5.8300)
 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.42% (0.6700 => 0.7800)
 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.57% (1.0500 => 0.9600)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.15% (3.2500 => 3.0500)
 SingleSource/Benchmarks/BenchmarkGame/fasta: 8.70% (1.1500 => 1.2500)
 SingleSource/Benchmarks/CoyoteBench/fftbench: 22.71% (2.0700 => 2.5400)
 SingleSource/Benchmarks/Dhrystone/dry: -13.11% (0.6100 => 0.5300)
 SingleSource/Benchmarks/Shootout/matrix: -5.23% (3.4400 => 3.2600)
LLC compile:
 Externals/SPEC/CFP2006/444_namd/444_namd: -8.16% (2.4815 => 2.2789)
 Externals/SPEC/CINT2000/252_eon/252_eon: -5.16% (5.1121 => 4.8483)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -7.00% (2.9858 => 2.7767)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -7.83% (1.1717 => 1.0800)
 MultiSource/Applications/JM/ldecod/ldecod: -6.63% (3.5392 => 3.3046)
 MultiSource/Applications/JM/lencod/lencod: -5.85% (8.3499 => 7.8617)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.11% (3.2070 => 3.0110)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.23% (0.3571 => 0.3277)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.46% (3.6682 => 3.4680)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.40% (0.6813 => 0.6377)
 MultiSource/Benchmarks/mafft/pairlocalalign: -5.38% (2.2287 => 2.1087)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.58% (5.1436 => 4.8050)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -15.34% (2.0692 => 1.7517)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -23.86% (1.3867 => 1.0559)
GCCAS:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -11.90% (4.1341 => 3.6421)
 Externals/SPEC/CFP2000/183_equake/183_equake: 6.36% (0.2374 => 0.2525)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 110.68% (1.1691 => 2.4631)
 Externals/SPEC/CFP2006/433_milc/433_milc: 39.28% (1.1738 => 1.6349)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 11.68% (2.9082 => 3.2478)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 5.65% (6.2076 => 6.5586)
 MultiSource/Applications/ClamAV/clamscan: 22.98% (6.6477 => 8.1753)
 MultiSource/Applications/d/make_dparser: 7.52% (1.3975 => 1.5026)
 MultiSource/Applications/oggenc/oggenc: 9.46% (2.6421 => 2.8921)
 MultiSource/Applications/sqlite3/sqlite3: 17.80% (6.7327 => 7.9309)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.68% (3.5361 => 3.8075)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.78% (1.6424 => 1.9344)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.64% (1.4100 => 1.7010)
 MultiSource/Benchmarks/Olden/bh/bh: 10.26% (0.2699 => 0.2976)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.45% (2.3292 => 2.7124)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.18% (1.6659 => 1.9521)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.07% (34.5718 => 37.0158)
JIT:
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -9.84% (34.5600 => 31.1600)
 MultiSource/Applications/JM/ldecod/ldecod: -6.50% (3.2300 => 3.0200)
 MultiSource/Applications/JM/lencod/lencod: -5.72% (14.6900 => 13.8500)
 MultiSource/Applications/lambda-0_1_3/lambda: 9.49% (5.6900 => 6.2300)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.14% (0.4200 => 0.3900)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -12.99% (0.7700 => 0.6700)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.55% (1.5200 => 1.3900)
 MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.83% (1.2000 => 1.1300)
 MultiSource/Benchmarks/Ptrdist/ks/ks: 9.38% (1.9200 => 2.1000)
 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.26% (1.0900 => 1.0000)
 MultiSource/Benchmarks/mafft/pairlocalalign: -20.47% (34.6300 => 27.5400)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -18.29% (7.7100 => 6.3000)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -20.26% (3.9000 => 3.1100)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -14.51% (4.4100 => 3.7700)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (3.0100 => 2.8300)
 SingleSource/Benchmarks/BenchmarkGame/fasta: 7.76% (1.1600 => 1.2500)
 SingleSource/Benchmarks/BenchmarkGame/recursive: -7.69% (1.0400 => 0.9600)
 SingleSource/Benchmarks/CoyoteBench/fftbench: 21.66% (2.1700 => 2.6400)
 SingleSource/Benchmarks/Dhrystone/dry: -13.33% (0.6000 => 0.5200)
 SingleSource/Benchmarks/Dhrystone/fldry: -10.00% (0.7000 => 0.6300)
 SingleSource/Benchmarks/Misc/flops: 8.95% (11.9600 => 13.0300)
 SingleSource/Benchmarks/Misc/flops-5: 95.45% (1.9800 => 3.8700)
 SingleSource/Benchmarks/Misc/flops-6: 125.39% (1.9300 => 4.3500)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 12.82% (2.3400 => 2.6400)
 SingleSource/Benchmarks/Misc/mandel: -29.63% (1.0800 => 0.7600)
 SingleSource/Benchmarks/Misc/whetstone: -5.17% (1.1600 => 1.1000)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -19.21% (2.0300 => 1.6400)
 SingleSource/Benchmarks/Shootout-C++/ary3: 6.82% (3.5200 => 3.7600)
 SingleSource/Benchmarks/Shootout-C++/fibo: -9.67% (2.6900 => 2.4300)
 SingleSource/Benchmarks/Shootout-C++/hash2: 9.36% (2.9900 => 3.2700)
 SingleSource/Benchmarks/Shootout/ary3: 5.95% (3.5300 => 3.7400)
 SingleSource/Benchmarks/Shootout/fib2: -10.15% (2.6600 => 2.3900)
 SingleSource/Benchmarks/Shootout/lists: -6.50% (5.6900 => 5.3200)
 SingleSource/Benchmarks/Shootout/methcall: -12.77% (6.1100 => 5.3300)
 SingleSource/Benchmarks/Shootout/sieve: 36.53% (5.3100 => 7.2500)
 SingleSource/UnitTests/Vector/build2: -21.88% (2.2400 => 1.7500)
LLC:
 MultiSource/Applications/minisat/minisat: 5.27% (6.6400 => 6.9900)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.89% (0.9400 => 0.8000)
 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.43% (1.0600 => 0.9600)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.15% (3.2500 => 3.0500)
 SingleSource/Benchmarks/BenchmarkGame/fasta: 7.83% (1.1500 => 1.2400)
 SingleSource/Benchmarks/CoyoteBench/fftbench: 21.63% (2.0800 => 2.5300)
 SingleSource/Benchmarks/Dhrystone/dry: -13.11% (0.6100 => 0.5300)
 SingleSource/Benchmarks/Shootout/ary3: 5.38% (3.5300 => 3.7200)
LLC-BETA compile:
 Externals/SPEC/CFP2006/444_namd/444_namd: -7.32% (2.4970 => 2.3143)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -6.08% (0.3965 => 0.3724)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -6.45% (2.9955 => 2.8024)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -7.96% (1.1818 => 1.0877)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (3.2165 => 3.0379)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.61% (0.3562 => 0.3362)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.86% (0.6879 => 0.6338)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.26% (5.1621 => 4.8905)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -13.94% (2.0813 => 1.7911)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.87% (1.3854 => 1.0686)



More information about the llvm-testresults mailing list