[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Fri Feb 19 03:46:45 PST 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5570/
Name:  grawp.apple.com
Nickname: Grawp:4

Run: 5570, Start Time: 2010-02-19 00:40:29, End Time: 2010-02-19 03:46:30
Comparing To: 5506, Start Time: 2010-02-16 00:32:56, End Time: 2010-02-16 04:08:45

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 18
Added Tests: 0
Removed Tests: 0
Significant Changes: 79

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 162

Total Test Failures By Type:
  Bitcode: 2
  CBE: 47
  GCCAS: 2
  JIT: 27
  JIT codegen: 58
  LLC: 6
  LLC compile: 6
  LLC-BETA: 7
  LLC_BETA compile: 7

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC-BETA, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [LLC, JIT, LLC-BETA, LLC compile, Bitcode, LLC_BETA compile, GCCAS]
SingleSource/Regression/C/2003-05-22-LocalTypeTest [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, Bitcode, LLC_BETA compile, GCCAS]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 MultiSource/Applications/viterbi/viterbi: 5.74% (6416.0000 => 6784.0000)
 MultiSource/Benchmarks/FreeBench/mason/mason: 7.80% (5536.0000 => 5968.0000)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 13.62% (6816.0000 => 7744.0000)
 SingleSource/Benchmarks/Shootout/hash: 7.03% (2960.0000 => 3168.0000)
JIT codegen:
 MultiSource/Applications/JM/ldecod/ldecod: 6.22% (3.6786 => 3.9075)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 70.93% (0.8799 => 1.5040)
 MultiSource/Benchmarks/McCat/05-eks/eks: 32.43% (0.4539 => 0.6011)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.43% (2.0652 => 2.4046)
CBE:
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.25% (0.3200 => 0.3000)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -35.71% (3.9200 => 2.5200)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 7.07% (0.9900 => 1.0600)
 SingleSource/Benchmarks/Misc/richards_benchmark: -7.14% (1.1200 => 1.0400)
 SingleSource/Benchmarks/Shootout-C++/hash2: -5.94% (4.3800 => 4.1200)
 SingleSource/Benchmarks/Shootout-C++/methcall: 17.28% (6.0200 => 7.0600)
LLC-BETA:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -9.50% (4.0000 => 3.6200)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.94% (9.7700 => 10.3500)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 9.72% (21.0800 => 23.1300)
 MultiSource/Applications/JM/lencod/lencod: 7.04% (8.3800 => 8.9700)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.25% (0.3200 => 0.3000)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.99% (0.8900 => 0.9700)
 SingleSource/Benchmarks/McGill/queens: -15.29% (2.5500 => 2.1600)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 7.07% (3.1100 => 3.3300)
 SingleSource/Benchmarks/Misc/oourafft: 7.74% (6.8500 => 7.3800)
 SingleSource/Benchmarks/Shootout/lists: -7.58% (7.1200 => 6.5800)
 SingleSource/Benchmarks/Shootout/methcall: 5.16% (4.0700 => 4.2800)
LLC compile:
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -7.61% (1.5390 => 1.4219)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 9.55% (11.2121 => 12.2825)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 73.89% (0.8717 => 1.5158)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.78% (0.5485 => 0.5168)
 MultiSource/Benchmarks/McCat/05-eks/eks: 33.40% (0.4518 => 0.6027)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.44% (2.5458 => 2.8879)
GCCAS:
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.38% (0.5090 => 0.5364)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 12.28% (17.1196 => 19.2219)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 5.81% (5.4069 => 5.7212)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 16.83% (3.4509 => 4.0318)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 7.01% (11.2344 => 12.0219)
 MultiSource/Applications/hexxagon/hexxagon: -5.55% (0.2524 => 0.2384)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.30% (6.4722 => 7.0741)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 36.43% (0.7294 => 0.9951)
JIT:
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 7.33% (10.2300 => 10.9800)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 12.17% (29.0100 => 32.5400)
 MultiSource/Applications/JM/ldecod/ldecod: 5.97% (4.0200 => 4.2600)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.36% (7.7200 => 8.5200)
 MultiSource/Benchmarks/BitBench/drop3/drop3: 6.90% (0.5800 => 0.6200)
 MultiSource/Benchmarks/FreeBench/mason/mason: 22.73% (0.2200 => 0.2700)
 MultiSource/Benchmarks/FreeBench/neural/neural: -6.06% (0.3300 => 0.3100)
 MultiSource/Benchmarks/McCat/05-eks/eks: 29.17% (0.4800 => 0.6200)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.99% (2.5400 => 2.8700)
 MultiSource/Benchmarks/PAQ8p/paq8p: 24.27% (98.3400 => 122.2100)
 MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.03% (1.2800 => 1.3700)
 MultiSource/Benchmarks/Ptrdist/ks/ks: 11.71% (2.0500 => 2.2900)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: -14.29% (3.0800 => 2.6400)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 7.36% (1.6300 => 1.7500)
 SingleSource/Benchmarks/McGill/chomp: -12.50% (1.0400 => 0.9100)
 SingleSource/Benchmarks/McGill/queens: -6.84% (2.6300 => 2.4500)
 SingleSource/Benchmarks/Misc-C++/ray: 8.61% (5.9200 => 6.4300)
 SingleSource/Benchmarks/Misc/fbench: -6.37% (2.5100 => 2.3500)
 SingleSource/Benchmarks/Misc/richards_benchmark: 6.31% (1.1100 => 1.1800)
 SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (1.6900 => 1.8200)
 SingleSource/Benchmarks/Shootout-C++/methcall: 15.14% (6.6700 => 7.6800)
 SingleSource/Benchmarks/Shootout/lists: 26.27% (6.2800 => 7.9300)
 SingleSource/Benchmarks/Shootout/methcall: 10.88% (5.7900 => 6.4200)
LLC:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -8.82% (3.9700 => 3.6200)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.50% (9.8100 => 10.3500)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 10.00% (20.9900 => 23.0900)
 MultiSource/Applications/JM/lencod/lencod: 7.54% (8.3600 => 8.9900)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.78% (0.9000 => 0.9700)
 SingleSource/Benchmarks/McGill/chomp: -13.08% (1.0700 => 0.9300)
 SingleSource/Benchmarks/McGill/queens: -15.29% (2.5500 => 2.1600)
 SingleSource/Benchmarks/Misc/himenobmtxpa: 7.42% (3.1000 => 3.3300)
 SingleSource/Benchmarks/Misc/oourafft: 5.27% (7.0200 => 7.3900)
 SingleSource/Benchmarks/Shootout-C++/ackermann: -5.56% (1.6200 => 1.5300)
 SingleSource/Benchmarks/Shootout/lists: -6.77% (7.0900 => 6.6100)
LLC-BETA compile:
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -6.92% (1.5193 => 1.4141)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 9.87% (11.2231 => 12.3309)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 70.50% (0.8806 => 1.5014)
 MultiSource/Benchmarks/McCat/05-eks/eks: 33.34% (0.4547 => 0.6063)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.98% (2.5548 => 2.8863)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (0.3815 => 0.4007)

More information about the llvm-testresults mailing list