[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Thu Oct 1 04:10:34 PDT 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//2105
Name:  grawp.apple.com
Nickname: Grawp:4
Buildstatus: OK

Run: 2105, Start Time: 2009-10-01 00:40:35
Comparing To: 2086, Start Time: 2009-09-30 00:33:26

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 119

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 93

Total Test Failures By Type:
  CBE: 43
  JIT: 24
  JIT codegen: 24
  LLC-BETA: 1
  LLC_BETA compile: 1

--- Changes Detail ---
New Test Passes:

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.92% (9328.0000 => 10720.0000)
JIT codegen:
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 7.32% (1.7581 => 1.8868)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 5.66% (0.6454 => 0.6819)
 MultiSource/Applications/lambda-0_1_3/lambda: 7.61% (0.3166 => 0.3407)
 MultiSource/Benchmarks/NPB-serial/is/is: 6.53% (0.4597 => 0.4897)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 5.58% (0.6687 => 0.7060)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.14% (0.2166 => 0.2364)
CBE:
 Externals/SPEC/CFP2000/183_equake/183_equake: 7.25% (9.1000 => 9.7600)
 Externals/SPEC/CFP2006/433_milc/433_milc: 13.80% (9.6400 => 10.9700)
 Externals/SPEC/CFP2006/470_lbm/470_lbm: 6.55% (15.4200 => 16.4300)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: 6.56% (5.0300 => 5.3600)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 6.62% (4.0800 => 4.3500)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 8.70% (0.2300 => 0.2500)
 MultiSource/Applications/SPASS/SPASS: 6.63% (7.9900 => 8.5200)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.98% (5.7300 => 6.1300)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (16.8900 => 18.1100)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.33% (6.7500 => 7.3800)
 MultiSource/Benchmarks/Fhourstones/fhourstones: 8.75% (1.6000 => 1.7400)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 13.86% (1.0100 => 1.1500)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.60% (1.7700 => 1.9400)
 SingleSource/Benchmarks/CoyoteBench/lpbench: 7.59% (10.1500 => 10.9200)
 SingleSource/Benchmarks/Dhrystone/fldry: -6.86% (3.0600 => 2.8500)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.55% (5.0300 => 5.4100)
 SingleSource/Benchmarks/Shootout-C++/ary3: 9.83% (4.0700 => 4.4700)
 SingleSource/Benchmarks/Shootout-C++/heapsort: 6.92% (4.4800 => 4.7900)
 SingleSource/Benchmarks/Shootout/ary3: 8.56% (4.0900 => 4.4400)
 SingleSource/Benchmarks/Shootout/heapsort: 5.87% (4.4300 => 4.6900)
 SingleSource/Benchmarks/Shootout/strcat: 9.09% (0.2200 => 0.2400)
LLC-BETA:
 Externals/SPEC/CFP2000/183_equake/183_equake: 5.25% (9.3300 => 9.8200)
 Externals/SPEC/CFP2006/433_milc/433_milc: 12.34% (9.8900 => 11.1100)
 Externals/SPEC/CFP2006/470_lbm/470_lbm: 6.74% (13.5000 => 14.4100)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: 5.81% (4.9900 => 5.2800)
 MultiSource/Applications/SPASS/SPASS: 8.30% (8.1900 => 8.8700)
 MultiSource/Applications/minisat/minisat: 9.15% (7.8700 => 8.5900)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (5.5200 => 5.9000)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (17.9500 => 18.9500)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.89% (6.4300 => 7.1300)
 MultiSource/Benchmarks/Fhourstones/fhourstones: 9.66% (1.4500 => 1.5900)
 MultiSource/Benchmarks/Olden/health/health: 5.56% (0.3600 => 0.3800)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 11.46% (0.9600 => 1.0700)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.93% (1.5100 => 1.6600)
 MultiSource/Benchmarks/llubenchmark/llu: 5.98% (3.5100 => 3.7200)
 SingleSource/Benchmarks/CoyoteBench/lpbench: 9.16% (9.8300 => 10.7300)
 SingleSource/Benchmarks/Dhrystone/dry: -17.86% (0.5600 => 0.4600)
 SingleSource/Benchmarks/Shootout-C++/ary3: 10.14% (4.1400 => 4.5600)
 SingleSource/Benchmarks/Shootout/ary3: 7.65% (4.0500 => 4.3600)
 SingleSource/Benchmarks/Shootout/heapsort: 5.15% (4.0800 => 4.2900)
LLC compile:
 Externals/SPEC/CINT2000/252_eon/252_eon: 5.07% (2.2287 => 2.3418)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 5.24% (8.1739 => 8.6023)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 5.08% (2.2650 => 2.3801)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 5.20% (15.2624 => 16.0561)
 MultiSource/Benchmarks/MallocBench/gs/gs: 5.99% (1.9047 => 2.0187)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57% (0.2946 => 0.3110)
GCCAS:
 MultiSource/Applications/hexxagon/hexxagon: 5.14% (0.3110 => 0.3270)
 MultiSource/Applications/lemon/lemon: 8.98% (0.5233 => 0.5703)
JIT:
 Externals/SPEC/CFP2000/183_equake/183_equake: 6.32% (9.6500 => 10.2600)
 Externals/SPEC/CFP2006/433_milc/433_milc: 9.56% (10.7700 => 11.8000)
 Externals/SPEC/CFP2006/470_lbm/470_lbm: 7.39% (13.6600 => 14.6700)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 5.21% (6.1400 => 6.4600)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 6.91% (3.9100 => 4.1800)
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 6.00% (3.0000 => 3.1800)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 7.45% (13.1500 => 14.1300)
 MultiSource/Applications/minisat/minisat: 7.38% (8.2600 => 8.8700)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.07% (8.0900 => 8.5000)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.09% (17.9000 => 18.9900)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.46% (6.5000 => 7.3100)
 MultiSource/Benchmarks/Fhourstones/fhourstones: 7.74% (1.5500 => 1.6700)
 MultiSource/Benchmarks/McCat/09-vor/vor: 7.41% (0.2700 => 0.2900)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08% (0.5900 => 0.6200)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.13% (0.3900 => 0.4100)
 MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.12% (0.4900 => 0.5200)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.52% (0.2100 => 0.2300)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 23.53% (1.0200 => 1.2600)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.49% (1.7400 => 1.9400)
 MultiSource/Benchmarks/llubenchmark/llu: 6.48% (3.5500 => 3.7800)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.11% (0.2700 => 0.3000)
 SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.78% (1.1800 => 1.2600)
 SingleSource/Benchmarks/CoyoteBench/lpbench: 7.52% (9.8400 => 10.5800)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.61% (4.8100 => 5.0800)
 SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (4.2400 => 4.6600)
 SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (4.1800 => 4.4400)
 SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.3000 => 0.3200)
 SingleSource/Benchmarks/Shootout/ary3: 8.89% (4.0500 => 4.4100)
 SingleSource/Benchmarks/Shootout/heapsort: 5.23% (4.2100 => 4.4300)
LLC:
 Externals/SPEC/CFP2000/183_equake/183_equake: 6.65% (9.3300 => 9.9500)
 Externals/SPEC/CFP2006/433_milc/433_milc: 13.10% (9.8500 => 11.1400)
 Externals/SPEC/CFP2006/470_lbm/470_lbm: 6.15% (13.4900 => 14.3200)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: 7.21% (4.9900 => 5.3500)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.80% (9.6600 => 10.2200)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 6.62% (3.1700 => 3.3800)
 MultiSource/Applications/kimwitu++/kc: 6.67% (0.3000 => 0.3200)
 MultiSource/Applications/minisat/minisat: 6.56% (7.9300 => 8.4500)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.80% (5.5100 => 5.9400)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.84% (17.9700 => 19.0200)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.74% (6.4500 => 6.8200)
 MultiSource/Benchmarks/Olden/bisort/bisort: 8.00% (0.7500 => 0.8100)
 MultiSource/Benchmarks/Olden/health/health: 5.56% (0.3600 => 0.3800)
 MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.3900 => 0.4100)
 MultiSource/Benchmarks/Ptrdist/ft/ft: 13.83% (0.9400 => 1.0700)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.27% (1.5100 => 1.6500)
 MultiSource/Benchmarks/llubenchmark/llu: 11.65% (3.5200 => 3.9300)
 SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (2.6000 => 2.7800)
 SingleSource/Benchmarks/CoyoteBench/lpbench: 10.16% (9.8400 => 10.8400)
 SingleSource/Benchmarks/Dhrystone/dry: -12.96% (0.5400 => 0.4700)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.43% (4.5600 => 4.9900)
 SingleSource/Benchmarks/Shootout-C++/ary3: 9.71% (4.1200 => 4.5200)
 SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (4.0800 => 4.3300)
 SingleSource/Benchmarks/Shootout/ary3: 8.91% (4.0400 => 4.4000)
 SingleSource/Benchmarks/Shootout/heapsort: 5.39% (4.0800 => 4.3000)
LLC-BETA compile:
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.35% (3.6477 => 3.8427)
 Externals/SPEC/CINT2000/252_eon/252_eon: 5.27% (2.3307 => 2.4535)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 6.70% (15.4710 => 16.5070)
 Externals/SPEC/CINT2006/473_astar/473_astar: 6.19% (0.3184 => 0.3381)
 MultiSource/Applications/minisat/minisat: 5.70% (0.2458 => 0.2598)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.14% (0.7332 => 0.7709)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.18% (0.3009 => 0.3255)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.23% (0.2198 => 0.2313)
 MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (1.8607 => 1.9786)



More information about the llvm-testresults mailing list