[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Mar 10 03:49:52 PST 2010


http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/6128/
Name:  grawp.apple.com
Nickname: Grawp:4

Run: 6128, Start Time: 2010-03-10 00:39:07, End Time: 2010-03-10 03:49:40
Comparing To: 6096, Start Time: 2010-03-09 00:46:58, End Time: 2010-03-09 04:05:42

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 101

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 128

Total Test Failures By Type:
  CBE: 46
  JIT: 25
  JIT codegen: 57

--- Changes Detail ---
New Test Passes:

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 8.63% (9090288.0000 => 9874608.0000)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 22.98% (1511056.0000 => 1858256.0000)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 100.45% (74976.0000 => 150288.0000)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 8.56% (114528.0000 => 124336.0000)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (35360.0000 => 38320.0000)
JIT codegen:
 MultiSource/Applications/JM/ldecod/ldecod: -5.13% (4.1064 => 3.8958)
 MultiSource/Applications/JM/lencod/lencod: -5.71% (8.7159 => 8.2181)
 MultiSource/Applications/SPASS/SPASS: -5.51% (4.8807 => 4.6119)
 MultiSource/Applications/siod/siod: -6.41% (0.7951 => 0.7441)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 109.57% (0.5756 => 1.2063)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 9.94% (0.7553 => 0.8304)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.82% (2.0663 => 1.9461)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.21% (0.7348 => 0.6965)
CBE:
 Externals/SPEC/CFP2006/433_milc/433_milc: -8.40% (10.5900 => 9.7000)
 Externals/SPEC/CINT2000/197_parser/197_parser: -16.01% (3.0600 => 2.5700)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -7.11% (4.9200 => 4.5700)
 MultiSource/Applications/SPASS/SPASS: -14.41% (9.3000 => 7.9600)
 MultiSource/Applications/oggenc/oggenc: -8.70% (0.2300 => 0.2100)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.25% (0.3200 => 0.3000)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -87.80% (183.3600 => 22.3700)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -11.03% (1.3600 => 1.2100)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.17% (0.5800 => 0.5500)
 SingleSource/Benchmarks/CoyoteBench/fftbench: -12.12% (2.9700 => 2.6100)
 SingleSource/Benchmarks/CoyoteBench/lpbench: -15.56% (12.0200 => 10.1500)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -16.75% (6.0300 => 5.0200)
 SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (6.6600 => 7.0600)
LLC-BETA:
 Externals/SPEC/CFP2006/433_milc/433_milc: -13.25% (11.0200 => 9.5600)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.26% (3.6100 => 3.4200)
 Externals/SPEC/CINT2006/429_mcf/429_mcf: -6.49% (3.0800 => 2.8800)
 MultiSource/Applications/SPASS/SPASS: -12.32% (9.0900 => 7.9700)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.09% (0.8700 => 1.0100)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -16.22% (1.4800 => 1.2400)
 SingleSource/Benchmarks/CoyoteBench/fftbench: -12.62% (3.0900 => 2.7000)
 SingleSource/Benchmarks/CoyoteBench/lpbench: -16.01% (11.6200 => 9.7600)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -20.00% (5.6000 => 4.4800)
 SingleSource/Benchmarks/Shootout-C++/hash: -8.00% (1.0000 => 0.9200)
LLC compile:
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 6.82% (56.7827 => 60.6532)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 29.10% (10.6008 => 13.6856)
 MultiSource/Applications/SPASS/SPASS: -5.48% (8.6042 => 8.1327)
 MultiSource/Applications/siod/siod: -6.88% (2.6608 => 2.4777)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 106.06% (0.6373 => 1.3132)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 10.21% (0.8590 => 0.9467)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.28% (2.2387 => 2.0980)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.07% (0.8701 => 0.8260)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -9.93% (0.2456 => 0.2212)
GCCAS:
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 6.19% (42.1581 => 44.7688)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 87.50% (6.3185 => 11.8471)
 MultiSource/Applications/d/make_dparser: -5.05% (2.0226 => 1.9205)
 MultiSource/Applications/kimwitu++/kc: 8.78% (5.8455 => 6.3587)
 MultiSource/Applications/spiff/spiff: -6.49% (0.3220 => 0.3011)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 200.58% (0.2736 => 0.8224)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 5.69% (0.6172 => 0.6523)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.64% (1.5908 => 1.4534)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.60% (0.9168 => 0.8471)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.39% (0.3890 => 0.4294)
JIT:
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -6.45% (4.9600 => 4.6400)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 8.70% (31.8400 => 34.6100)
 MultiSource/Applications/JM/ldecod/ldecod: -5.37% (4.4700 => 4.2300)
 MultiSource/Applications/SPASS/SPASS: -13.57% (15.2500 => 13.1800)
 MultiSource/Applications/treecc/treecc: -5.88% (0.5100 => 0.4800)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 102.78% (0.7200 => 1.4600)
 MultiSource/Benchmarks/Ptrdist/ft/ft: -5.41% (1.1100 => 1.0500)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.75% (1.4200 => 1.5300)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.90% (1.1600 => 1.2400)
 MultiSource/Benchmarks/llubenchmark/llu: -6.08% (3.7800 => 3.5500)
 MultiSource/Benchmarks/mafft/pairlocalalign: 6.10% (29.1600 => 30.9400)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -14.86% (1.4800 => 1.2600)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.88% (0.5100 => 0.4800)
 SingleSource/Benchmarks/CoyoteBench/fftbench: -12.34% (3.1600 => 2.7700)
 SingleSource/Benchmarks/CoyoteBench/lpbench: -10.75% (10.8800 => 9.7100)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -14.72% (5.6400 => 4.8100)
 SingleSource/Benchmarks/Misc/richards_benchmark: 9.73% (1.1300 => 1.2400)
 SingleSource/Benchmarks/Shootout/ary3: -5.58% (4.3000 => 4.0600)
 SingleSource/Benchmarks/Shootout/heapsort: -5.40% (4.2600 => 4.0300)
LLC:
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.83% (3.6000 => 3.3900)
 MultiSource/Applications/ClamAV/clamscan: -11.11% (0.2700 => 0.2400)
 MultiSource/Applications/JM/lencod/lencod: -5.44% (9.3700 => 8.8600)
 MultiSource/Applications/SPASS/SPASS: -16.70% (9.5800 => 7.9800)
 MultiSource/Applications/sgefa/sgefa: -8.70% (0.6900 => 0.6300)
 MultiSource/Applications/spiff/spiff: -7.31% (4.3800 => 4.0600)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.90% (6.6700 => 6.0100)
 MultiSource/Benchmarks/Olden/health/health: 5.71% (0.3500 => 0.3700)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.09% (0.8700 => 1.0100)
 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.32% (1.0600 => 1.1800)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -13.99% (1.4300 => 1.2300)
 SingleSource/Benchmarks/BenchmarkGame/puzzle: -8.16% (0.4900 => 0.4500)
 SingleSource/Benchmarks/CoyoteBench/fftbench: -12.99% (3.0800 => 2.6800)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.46% (5.0600 => 4.4800)
 SingleSource/Benchmarks/Shootout-C++/hash: -7.07% (0.9900 => 0.9200)
 SingleSource/Benchmarks/Shootout-C++/heapsort: -7.16% (4.3300 => 4.0200)
 SingleSource/Benchmarks/Shootout-C++/methcall: -5.11% (5.6800 => 5.3900)
LLC-BETA compile:
 Externals/SPEC/CINT2000/197_parser/197_parser: -8.38% (2.0935 => 1.9181)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 7.37% (56.5293 => 60.6929)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 28.33% (10.6676 => 13.6893)
 MultiSource/Applications/d/make_dparser: -7.04% (1.5891 => 1.4772)
 MultiSource/Applications/oggenc/oggenc: -5.91% (2.5763 => 2.4240)
 MultiSource/Applications/treecc/treecc: -6.66% (1.9107 => 1.7835)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 104.33% (0.6414 => 1.3106)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 9.28% (0.8650 => 0.9453)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.43% (2.2596 => 2.0917)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -10.54% (0.2476 => 0.2215)



More information about the llvm-testresults mailing list