[llvm-testresults] Grawp nightly tester results

[Evan Cheng]

On Dec 12, 2009, at 2:25 PM, daniel_dunbar at apple.com wrote:

> 
> 
> New Test Failures:
> Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT, LLC, LLC compile]

The failure is real. Can someone track down what caused it? It's due to something committed during 12/10 or 12/11.

Evan

> 
> Added Tests:
> 
> Removed Tests:
> 
> Significant Changes in Test Results:
> CBE:
> Externals/SPEC/CFP2006/433_milc/433_milc: 13.76% (9.7400 => 11.0800)
> Externals/SPEC/CINT2000/181_mcf/181_mcf: 8.20% (5.0000 => 5.4100)
> MultiSource/Applications/kimwitu++/kc: 6.67% (0.3000 => 0.3200)
> MultiSource/Applications/spiff/spiff: 5.81% (4.3000 => 4.5500)
> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (16.8900 => 18.0900)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.76% (6.8200 => 7.6900)
> MultiSource/Benchmarks/Fhourstones/fhourstones: 13.21% (1.5900 => 1.8000)
> MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.45% (0.3100 => 0.3300)
> MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.38% (0.4700 => 0.5000)
> MultiSource/Benchmarks/Ptrdist/ft/ft: 15.69% (1.0200 => 1.1800)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.79% (1.7400 => 1.9800)
> MultiSource/Benchmarks/llubenchmark/llu: 33.51% (3.8200 => 5.1000)
> SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 17.36% (1.2100 => 1.4200)
> SingleSource/Benchmarks/Misc/ffbench: 9.62% (1.0400 => 1.1400)
> SingleSource/Benchmarks/Shootout-C++/ary3: 9.58% (4.0700 => 4.4600)
> SingleSource/Benchmarks/Shootout-C++/heapsort: 5.49% (4.5500 => 4.8000)
> SingleSource/Benchmarks/Shootout/ary3: 7.65% (4.0500 => 4.3600)
> LLC-BETA:
> Externals/SPEC/CFP2006/433_milc/433_milc: 36.52% (9.5300 => 13.0100)
> Externals/SPEC/CINT2000/181_mcf/181_mcf: 6.85% (4.9600 => 5.3000)
> Externals/SPEC/CINT2000/197_parser/197_parser: 7.66% (2.6100 => 2.8100)
> Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 6.33% (10.7500 => 11.4300)
> MultiSource/Applications/SPASS/SPASS: 8.92% (7.9600 => 8.6700)
> MultiSource/Applications/minisat/minisat: 16.80% (7.6800 => 8.9700)
> MultiSource/Applications/spiff/spiff: 5.97% (4.1900 => 4.4400)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.50% (5.5800 => 6.1100)
> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.85% (17.7400 => 19.3100)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.24% (6.5900 => 7.6600)
> MultiSource/Benchmarks/Fhourstones/fhourstones: 13.29% (1.4300 => 1.6200)
> MultiSource/Benchmarks/Olden/health/health: 8.33% (0.3600 => 0.3900)
> MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.41% (0.3700 => 0.3900)
> MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.67% (0.4500 => 0.4800)
> MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.69% (0.3900 => 0.4200)
> MultiSource/Benchmarks/PAQ8p/paq8p: 5.15% (93.9500 => 98.7900)
> MultiSource/Benchmarks/Ptrdist/ft/ft: 8.74% (1.0300 => 1.1200)
> MultiSource/Benchmarks/llubenchmark/llu: 46.50% (3.5700 => 5.2300)
> SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.69% (1.1600 => 1.4000)
> SingleSource/Benchmarks/BenchmarkGame/puzzle: 16.07% (0.5600 => 0.6500)
> SingleSource/Benchmarks/CoyoteBench/lpbench: 11.57% (9.8500 => 10.9900)
> SingleSource/Benchmarks/McGill/chomp: 5.32% (0.9400 => 0.9900)
> SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.22% (4.5000 => 5.4100)
> SingleSource/Benchmarks/Misc/ffbench: 6.45% (0.9300 => 0.9900)
> SingleSource/Benchmarks/Shootout-C++/ary3: 11.85% (4.0500 => 4.5300)
> SingleSource/Benchmarks/Shootout-C++/moments: 7.69% (0.2600 => 0.2800)
> SingleSource/Benchmarks/Shootout/ary3: 15.67% (4.0200 => 4.6500)
> LLC compile:
> Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.14% (6.4524 => 6.7843)
> Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.45% (4.1502 => 4.3763)
> Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.24% (0.4047 => 0.4259)
> Externals/SPEC/CINT2000/300_twolf/300_twolf: 8.19% (2.7657 => 2.9921)
> Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 5.98% (6.1631 => 6.5315)
> Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 8.07% (11.6710 => 12.6134)
> Externals/SPEC/CINT2006/473_astar/473_astar: 6.31% (0.3565 => 0.3790)
> MultiSource/Applications/hbd/hbd: 5.57% (0.4995 => 0.5273)
> MultiSource/Applications/kimwitu++/kc: 7.62% (8.1610 => 8.7826)
> MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.4780 => 0.5076)
> MultiSource/Applications/minisat/minisat: 5.82% (0.2854 => 0.3020)
> MultiSource/Applications/spiff/spiff: 5.19% (0.4084 => 0.4296)
> MultiSource/Applications/sqlite3/sqlite3: 6.38% (7.2885 => 7.7533)
> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.10% (0.3772 => 0.4002)
> MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (2.6486 => 2.7983)
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.74% (0.3290 => 0.3479)
> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.79% (0.3822 => 0.4158)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.2476 => 0.2643)
> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.27% (1.0058 => 1.0890)
> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (0.6394 => 0.6764)
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.96% (5.9966 => 6.6539)
> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.59% (1.5272 => 1.6890)
> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.91% (1.0527 => 1.1254)
> GCCAS:
> Externals/SPEC/CINT2000/300_twolf/300_twolf: 5.14% (2.2788 => 2.3959)
> Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 5.79% (7.0223 => 7.4292)
> Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 5.16% (5.5388 => 5.8246)
> MultiSource/Applications/JM/lencod/lencod: 6.49% (7.2799 => 7.7526)
> MultiSource/Applications/sqlite3/sqlite3: 7.96% (5.3769 => 5.8051)
> MultiSource/Benchmarks/PAQ8p/paq8p: 11.06% (1.1076 => 1.2301)
> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.83% (0.4497 => 0.4759)
> MultiSource/Benchmarks/Ptrdist/bc/bc: 13.42% (0.5483 => 0.6219)
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.64% (9.6147 => 10.3491)
> JIT:
> Externals/SPEC/CFP2006/433_milc/433_milc: 14.86% (10.7700 => 12.3700)
> Externals/SPEC/CINT2000/181_mcf/181_mcf: 5.72% (5.0700 => 5.3600)
> Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 6.43% (11.0500 => 11.7600)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.36% (7.7300 => 8.8400)
> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (17.8200 => 18.9800)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.84% (6.6400 => 7.3600)
> MultiSource/Benchmarks/Fhourstones/fhourstones: 10.53% (1.5200 => 1.6800)
> MultiSource/Benchmarks/McCat/09-vor/vor: 20.83% (0.2400 => 0.2900)
> MultiSource/Benchmarks/Olden/health/health: 7.32% (0.4100 => 0.4400)
> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 27.91% (0.4300 => 0.5500)
> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.63% (0.2700 => 0.3500)
> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 146.09% (1.2800 => 3.1500)
> SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 142.86% (1.2600 => 3.0600)
> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 473.56% (0.8700 => 4.9900)
> SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 25.42% (1.1800 => 1.4800)
> SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.79% (0.5600 => 0.7100)
> SingleSource/Benchmarks/CoyoteBench/fftbench: 6.34% (2.6800 => 2.8500)
> SingleSource/Benchmarks/Misc-C++/bigfib: 10.53% (0.5700 => 0.6300)
> SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.04% (0.2300 => 0.2600)
> SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.34% (4.6700 => 5.4800)
> SingleSource/Benchmarks/Misc/ffbench: 10.53% (0.9500 => 1.0500)
> SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (4.1000 => 4.4100)
> SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.3000 => 0.3200)
> SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.2800 => 0.3000)
> SingleSource/Benchmarks/Shootout/ary3: 13.09% (4.0500 => 4.5800)
> SingleSource/Benchmarks/Shootout/hash: 5.74% (6.7900 => 7.1800)
> SingleSource/Benchmarks/Shootout/heapsort: 6.11% (4.0900 => 4.3400)
> LLC:
> Externals/SPEC/CFP2000/179_art/179_art: 6.03% (1.1600 => 1.2300)
> Externals/SPEC/CFP2000/188_ammp/188_ammp: 5.26% (21.8700 => 23.0200)
> Externals/SPEC/CFP2006/433_milc/433_milc: 20.61% (9.5600 => 11.5300)
> Externals/SPEC/CFP2006/470_lbm/470_lbm: 5.34% (13.4900 => 14.2100)
> Externals/SPEC/CINT2000/181_mcf/181_mcf: 6.39% (5.0100 => 5.3300)
> Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 9.01% (10.7700 => 11.7400)
> Externals/SPEC/CINT2006/403_gcc/403_gcc: 9.20% (1.6300 => 1.7800)
> Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 5.73% (20.9400 => 22.1400)
> MultiSource/Applications/SPASS/SPASS: 8.85% (8.0200 => 8.7300)
> MultiSource/Applications/minisat/minisat: 16.34% (7.5900 => 8.8300)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.83% (6.5800 => 7.4900)
> MultiSource/Benchmarks/Fhourstones/fhourstones: 9.93% (1.4100 => 1.5500)
> MultiSource/Benchmarks/Olden/bh/bh: 5.28% (2.6500 => 2.7900)
> MultiSource/Benchmarks/Olden/bisort/bisort: 9.33% (0.7500 => 0.8200)
> MultiSource/Benchmarks/Olden/health/health: 5.56% (0.3600 => 0.3800)
> MultiSource/Benchmarks/Ptrdist/ft/ft: 20.83% (0.9600 => 1.1600)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.51% (1.4800 => 1.6800)
> MultiSource/Benchmarks/llubenchmark/llu: 37.85% (3.5400 => 4.8800)
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.59% (0.9100 => 0.9700)
> SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 22.41% (1.1600 => 1.4200)
> SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.57% (0.5600 => 0.7200)
> SingleSource/Benchmarks/CoyoteBench/lpbench: 6.50% (9.8500 => 10.4900)
> SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.19% (4.4700 => 4.9700)
> SingleSource/Benchmarks/Shootout-C++/ary3: 5.69% (4.0400 => 4.2700)
> SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (4.1000 => 4.3600)
> SingleSource/Benchmarks/Shootout/ary3: 8.64% (4.0500 => 4.4000)
> SingleSource/Benchmarks/Shootout/strcat: 6.90% (0.2900 => 0.3100)
> LLC-BETA compile:
> Externals/SPEC/CINT2000/254_gap/254_gap: 5.30% (8.1871 => 8.6210)
> Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.31% (0.4067 => 0.4283)
> Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 5.92% (11.9070 => 12.6113)
> MultiSource/Applications/SIBsim4/SIBsim4: 6.12% (0.6881 => 0.7302)
> MultiSource/Applications/SPASS/SPASS: 6.95% (7.6169 => 8.1465)
> MultiSource/Applications/hbd/hbd: 8.80% (0.5080 => 0.5527)
> MultiSource/Applications/hexxagon/hexxagon: 7.19% (0.2753 => 0.2951)
> MultiSource/Applications/lambda-0_1_3/lambda: 8.79% (0.4890 => 0.5320)
> MultiSource/Applications/minisat/minisat: 5.57% (0.2929 => 0.3092)
> MultiSource/Applications/treecc/treecc: 5.07% (1.7303 => 1.8180)
> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.74% (0.3870 => 0.4131)
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.3386 => 0.3578)
> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 7.45% (0.2040 => 0.2192)
> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.99% (0.3888 => 0.4121)
> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.75% (0.8867 => 0.9377)
> MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (0.7874 => 0.8304)
> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.36% (0.3847 => 0.4130)
> MultiSource/Benchmarks/sim/sim: 5.19% (0.2177 => 0.2290)
> SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.73% (0.2407 => 0.2569)
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults