[llvm-testresults] Grawp nightly tester results

Evan Cheng evan.cheng at apple.com
Thu Oct 1 16:12:30 PDT 2009 

Slow downs are not real. A process got wedged.

Evan

On Oct 1, 2009, at 4:10 AM, daniel_dunbar at apple.com wrote:

> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//2105
> Name:  grawp.apple.com
> Nickname: Grawp:4
> Buildstatus: OK
>
> Run: 2105, Start Time: 2009-10-01 00:40:35
> Comparing To: 2086, Start Time: 2009-09-30 00:33:26
>
> --- Changes Summary ---
> New Test Passes: 0
> New Test Failures: 0
> Added Tests: 0
> Removed Tests: 0
> Significant Changes: 119
>
> --- Tests Summary ---
> Total Tests: 3852
> Total Test Failures: 93
>
> Total Test Failures By Type:
>  CBE: 43
>  JIT: 24
>  JIT codegen: 24
>  LLC-BETA: 1
>  LLC_BETA compile: 1
>
> --- Changes Detail ---
> New Test Passes:
>
> New Test Failures:
>
> Added Tests:
>
> Removed Tests:
>
> Significant Changes in Test Results:
> Bitcode:
> MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.92% (9328.0000  
> => 10720.0000)
> JIT codegen:
> Externals/SPEC/CINT2000/300_twolf/300_twolf: 7.32% (1.7581 => 1.8868)
> Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 5.66% (0.6454 => 0.6819)
> MultiSource/Applications/lambda-0_1_3/lambda: 7.61% (0.3166 => 0.3407)
> MultiSource/Benchmarks/NPB-serial/is/is: 6.53% (0.4597 => 0.4897)
> MultiSource/Benchmarks/Ptrdist/bc/bc: 5.58% (0.6687 => 0.7060)
> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.14% (0.2166 =>  
> 0.2364)
> CBE:
> Externals/SPEC/CFP2000/183_equake/183_equake: 7.25% (9.1000 => 9.7600)
> Externals/SPEC/CFP2006/433_milc/433_milc: 13.80% (9.6400 => 10.9700)
> Externals/SPEC/CFP2006/470_lbm/470_lbm: 6.55% (15.4200 => 16.4300)
> Externals/SPEC/CINT2000/181_mcf/181_mcf: 6.56% (5.0300 => 5.3600)
> Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 6.62% (4.0800 => 4.3500)
> Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 8.70% (0.2300 => 0.2500)
> MultiSource/Applications/SPASS/SPASS: 6.63% (7.9900 => 8.5200)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.98% (5.7300 =>  
> 6.1300)
> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (16.8900 =>  
> 18.1100)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.33% (6.7500 =>  
> 7.3800)
> MultiSource/Benchmarks/Fhourstones/fhourstones: 8.75% (1.6000 =>  
> 1.7400)
> MultiSource/Benchmarks/Ptrdist/ft/ft: 13.86% (1.0100 => 1.1500)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.60% (1.7700 => 1.9400)
> SingleSource/Benchmarks/CoyoteBench/lpbench: 7.59% (10.1500 =>  
> 10.9200)
> SingleSource/Benchmarks/Dhrystone/fldry: -6.86% (3.0600 => 2.8500)
> SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.55% (5.0300  
> => 5.4100)
> SingleSource/Benchmarks/Shootout-C++/ary3: 9.83% (4.0700 => 4.4700)
> SingleSource/Benchmarks/Shootout-C++/heapsort: 6.92% (4.4800 =>  
> 4.7900)
> SingleSource/Benchmarks/Shootout/ary3: 8.56% (4.0900 => 4.4400)
> SingleSource/Benchmarks/Shootout/heapsort: 5.87% (4.4300 => 4.6900)
> SingleSource/Benchmarks/Shootout/strcat: 9.09% (0.2200 => 0.2400)
> LLC-BETA:
> Externals/SPEC/CFP2000/183_equake/183_equake: 5.25% (9.3300 => 9.8200)
> Externals/SPEC/CFP2006/433_milc/433_milc: 12.34% (9.8900 => 11.1100)
> Externals/SPEC/CFP2006/470_lbm/470_lbm: 6.74% (13.5000 => 14.4100)
> Externals/SPEC/CINT2000/181_mcf/181_mcf: 5.81% (4.9900 => 5.2800)
> MultiSource/Applications/SPASS/SPASS: 8.30% (8.1900 => 8.8700)
> MultiSource/Applications/minisat/minisat: 9.15% (7.8700 => 8.5900)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (5.5200 =>  
> 5.9000)
> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (17.9500 =>  
> 18.9500)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.89% (6.4300 =>  
> 7.1300)
> MultiSource/Benchmarks/Fhourstones/fhourstones: 9.66% (1.4500 =>  
> 1.5900)
> MultiSource/Benchmarks/Olden/health/health: 5.56% (0.3600 => 0.3800)
> MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 =>  
> 0.3200)
> MultiSource/Benchmarks/Ptrdist/ft/ft: 11.46% (0.9600 => 1.0700)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.93% (1.5100 => 1.6600)
> MultiSource/Benchmarks/llubenchmark/llu: 5.98% (3.5100 => 3.7200)
> SingleSource/Benchmarks/CoyoteBench/lpbench: 9.16% (9.8300 => 10.7300)
> SingleSource/Benchmarks/Dhrystone/dry: -17.86% (0.5600 => 0.4600)
> SingleSource/Benchmarks/Shootout-C++/ary3: 10.14% (4.1400 => 4.5600)
> SingleSource/Benchmarks/Shootout/ary3: 7.65% (4.0500 => 4.3600)
> SingleSource/Benchmarks/Shootout/heapsort: 5.15% (4.0800 => 4.2900)
> LLC compile:
> Externals/SPEC/CINT2000/252_eon/252_eon: 5.07% (2.2287 => 2.3418)
> Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 5.24% (8.1739 =>  
> 8.6023)
> Externals/SPEC/CINT2000/300_twolf/300_twolf: 5.08% (2.2650 => 2.3801)
> Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 5.20% (15.2624  
> => 16.0561)
> MultiSource/Benchmarks/MallocBench/gs/gs: 5.99% (1.9047 => 2.0187)
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57%  
> (0.2946 => 0.3110)
> GCCAS:
> MultiSource/Applications/hexxagon/hexxagon: 5.14% (0.3110 => 0.3270)
> MultiSource/Applications/lemon/lemon: 8.98% (0.5233 => 0.5703)
> JIT:
> Externals/SPEC/CFP2000/183_equake/183_equake: 6.32% (9.6500 =>  
> 10.2600)
> Externals/SPEC/CFP2006/433_milc/433_milc: 9.56% (10.7700 => 11.8000)
> Externals/SPEC/CFP2006/470_lbm/470_lbm: 7.39% (13.6600 => 14.6700)
> Externals/SPEC/CINT2000/300_twolf/300_twolf: 5.21% (6.1400 => 6.4600)
> Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 6.91% (3.9100 => 4.1800)
> Externals/SPEC/CINT2006/429_mcf/429_mcf: 6.00% (3.0000 => 3.1800)
> Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 7.45% (13.1500 =>  
> 14.1300)
> MultiSource/Applications/minisat/minisat: 7.38% (8.2600 => 8.8700)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.07% (8.0900 =>  
> 8.5000)
> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.09% (17.9000 =>  
> 18.9900)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.46% (6.5000 =>  
> 7.3100)
> MultiSource/Benchmarks/Fhourstones/fhourstones: 7.74% (1.5500 =>  
> 1.6700)
> MultiSource/Benchmarks/McCat/09-vor/vor: 7.41% (0.2700 => 0.2900)
> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08%  
> (0.5900 => 0.6200)
> MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.13% (0.3900 =>  
> 0.4100)
> MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.12% (0.4900 => 0.5200)
> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.52% (0.2100 =>  
> 0.2300)
> MultiSource/Benchmarks/Ptrdist/ft/ft: 23.53% (1.0200 => 1.2600)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.49% (1.7400 => 1.9400)
> MultiSource/Benchmarks/llubenchmark/llu: 6.48% (3.5500 => 3.7800)
> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.11% (0.2700 =>  
> 0.3000)
> SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.78% (1.1800 =>  
> 1.2600)
> SingleSource/Benchmarks/CoyoteBench/lpbench: 7.52% (9.8400 => 10.5800)
> SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.61% (4.8100  
> => 5.0800)
> SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (4.2400 => 4.6600)
> SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (4.1800 =>  
> 4.4400)
> SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.3000 => 0.3200)
> SingleSource/Benchmarks/Shootout/ary3: 8.89% (4.0500 => 4.4100)
> SingleSource/Benchmarks/Shootout/heapsort: 5.23% (4.2100 => 4.4300)
> LLC:
> Externals/SPEC/CFP2000/183_equake/183_equake: 6.65% (9.3300 => 9.9500)
> Externals/SPEC/CFP2006/433_milc/433_milc: 13.10% (9.8500 => 11.1400)
> Externals/SPEC/CFP2006/470_lbm/470_lbm: 6.15% (13.4900 => 14.3200)
> Externals/SPEC/CINT2000/181_mcf/181_mcf: 7.21% (4.9900 => 5.3500)
> Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.80% (9.6600 => 10.2200)
> Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 6.62% (3.1700 => 3.3800)
> MultiSource/Applications/kimwitu++/kc: 6.67% (0.3000 => 0.3200)
> MultiSource/Applications/minisat/minisat: 6.56% (7.9300 => 8.4500)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.80% (5.5100 =>  
> 5.9400)
> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.84% (17.9700 =>  
> 19.0200)
> MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.74% (6.4500 =>  
> 6.8200)
> MultiSource/Benchmarks/Olden/bisort/bisort: 8.00% (0.7500 => 0.8100)
> MultiSource/Benchmarks/Olden/health/health: 5.56% (0.3600 => 0.3800)
> MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.3900 => 0.4100)
> MultiSource/Benchmarks/Ptrdist/ft/ft: 13.83% (0.9400 => 1.0700)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.27% (1.5100 => 1.6500)
> MultiSource/Benchmarks/llubenchmark/llu: 11.65% (3.5200 => 3.9300)
> SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (2.6000 => 2.7800)
> SingleSource/Benchmarks/CoyoteBench/lpbench: 10.16% (9.8400 =>  
> 10.8400)
> SingleSource/Benchmarks/Dhrystone/dry: -12.96% (0.5400 => 0.4700)
> SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.43% (4.5600  
> => 4.9900)
> SingleSource/Benchmarks/Shootout-C++/ary3: 9.71% (4.1200 => 4.5200)
> SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (4.0800 =>  
> 4.3300)
> SingleSource/Benchmarks/Shootout/ary3: 8.91% (4.0400 => 4.4000)
> SingleSource/Benchmarks/Shootout/heapsort: 5.39% (4.0800 => 4.3000)
> LLC-BETA compile:
> Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.35% (3.6477 => 3.8427)
> Externals/SPEC/CINT2000/252_eon/252_eon: 5.27% (2.3307 => 2.4535)
> Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 6.70% (15.4710  
> => 16.5070)
> Externals/SPEC/CINT2006/473_astar/473_astar: 6.19% (0.3184 => 0.3381)
> MultiSource/Applications/minisat/minisat: 5.70% (0.2458 => 0.2598)
> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.14%  
> (0.7332 => 0.7709)
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.18%  
> (0.3009 => 0.3255)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.23% (0.2198 => 0.2313)
> MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (1.8607 => 1.9786)
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults

More information about the llvm-testresults mailing list