[llvm-testresults] Grawp-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Sat Feb 27 07:31:30 PST 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5805/
Name:  grawp.apple.com
Nickname: Grawp-PIC:4

Run: 5805, Start Time: 2010-02-27 04:57:22, End Time: 2010-02-27 07:31:18
Comparing To: 5774, Start Time: 2010-02-26 04:57:47, End Time: 2010-02-26 07:28:49

--- Changes Summary ---
New Test Passes: 12
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 147

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 1777

Total Test Failures By Type:
  CBE: 45
  JIT: 433
  JIT codegen: 433
  LLC-BETA: 433
  LLC_BETA compile: 433

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2000/183_equake/183_equake [LLC, CBE, LLC compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC compile]
MultiSource/Applications/ClamAV/clamscan [CBE]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC compile]
SingleSource/Regression/C++/EH/ctor_dtor_count-2 [LLC, LLC compile]
SingleSource/Regression/C++/EH/throw_rethrow_test [LLC, LLC compile]

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 7.33% (4.6400 => 4.9800)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 5.36% (1.1200 => 1.1800)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -5.14% (4.8600 => 4.6100)
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 5.37% (2.9800 => 3.1400)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 8.70% (0.2300 => 0.2500)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 17.39% (6.2100 => 7.2900)
 MultiSource/Applications/ClamAV/clamscan: -7.69% (0.2600 => 0.2400)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.59% (0.9100 => 0.9700)
 SingleSource/Benchmarks/McGill/queens: -9.09% (2.6400 => 2.4000)
 SingleSource/Benchmarks/Misc/richards_benchmark: 8.82% (1.3600 => 1.4800)
GCCAS:
 Externals/Nurbs/nurbs: 5.40% (0.6538 => 0.6891)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 6.26% (4.8006 => 5.1013)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.66% (2.9427 => 3.1387)
 Externals/SPEC/CFP2006/433_milc/433_milc: 7.99% (1.3598 => 1.4685)
 Externals/SPEC/CFP2006/444_namd/444_namd: 58.56% (3.0441 => 4.8266)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.33% (38.2557 => 40.2929)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 9.29% (0.5330 => 0.5825)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 5.57% (1.4763 => 1.5586)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 21.58% (19.1377 => 23.2668)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 15.29% (1.9389 => 2.2354)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 9.38% (5.7134 => 6.2493)
 Externals/SPEC/CINT2000/254_gap/254_gap: 6.36% (5.8623 => 6.2353)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 13.60% (4.0193 => 4.5660)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 7.30% (0.4042 => 0.4337)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 10.80% (2.2841 => 2.5308)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 5.06% (12.2631 => 12.8834)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 16.64% (1.0901 => 1.2715)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 11.36% (45.9476 => 51.1681)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 10.08% (8.2055 => 9.0326)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 16.15% (1.1263 => 1.3082)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 10.44% (7.7194 => 8.5252)
 Externals/SPEC/CINT2006/473_astar/473_astar: 6.31% (0.3726 => 0.3961)
 MultiSource/Applications/ClamAV/clamscan: 15.35% (6.4017 => 7.3844)
 MultiSource/Applications/JM/ldecod/ldecod: 6.38% (3.9851 => 4.2393)
 MultiSource/Applications/JM/lencod/lencod: 6.61% (7.6192 => 8.1228)
 MultiSource/Applications/d/make_dparser: 7.69% (1.6249 => 1.7498)
 MultiSource/Applications/hexxagon/hexxagon: 22.04% (0.2387 => 0.2913)
 MultiSource/Applications/lemon/lemon: 6.68% (0.5089 => 0.5429)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.81% (4.1350 => 5.4088)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 120.57% (0.9936 => 2.1916)
 MultiSource/Benchmarks/PAQ8p/paq8p: 5.04% (1.0985 => 1.1539)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.11% (2.5509 => 2.7832)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.81% (0.5473 => 0.6776)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.73% (0.4538 => 0.5025)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.42% (1.8874 => 2.0463)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.67% (0.6311 => 0.6921)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.01% (1.3969 => 1.5926)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.89% (1.2080 => 1.3154)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.44% (0.7951 => 0.9020)
Bitcode:
 Externals/Povray/povray: 6.24% (1492112.0000 => 1585280.0000)
 Externals/SPEC/CFP2000/179_art/179_art: 111.07% (25152.0000 => 53088.0000)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 12.01% (254656.0000 => 285232.0000)
 Externals/SPEC/CFP2006/433_milc/433_milc: 25.33% (160848.0000 => 201584.0000)
 Externals/SPEC/CFP2006/444_namd/444_namd: 106.81% (434032.0000 => 897600.0000)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.40% (683968.0000 => 720896.0000)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 13.23% (60608.0000 => 68624.0000)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 9.35% (248384.0000 => 271600.0000)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 16.91% (3271280.0000 => 3824560.0000)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: 5.61% (19968.0000 => 21088.0000)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 30.91% (403024.0000 => 527584.0000)
 Externals/SPEC/CINT2000/197_parser/197_parser: 23.97% (275296.0000 => 341296.0000)
 Externals/SPEC/CINT2000/254_gap/254_gap: 7.90% (1166784.0000 => 1258928.0000)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 25.88% (753536.0000 => 948544.0000)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 29.71% (70112.0000 => 90944.0000)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: 9.83% (420704.0000 => 462048.0000)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 6.61% (2709024.0000 => 2887984.0000)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 12.70% (207760.0000 => 234144.0000)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 10.56% (9094528.0000 => 10054464.0000)
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 7.18% (22512.0000 => 24128.0000)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 74.40% (221632.0000 => 386528.0000)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 8.00% (54624.0000 => 58992.0000)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 7.06% (1038816.0000 => 1112192.0000)
 Externals/SPEC/CINT2006/473_astar/473_astar: 14.33% (51920.0000 => 59360.0000)
 MultiSource/Applications/ClamAV/clamscan: 23.71% (1267888.0000 => 1568464.0000)
 MultiSource/Applications/JM/lencod/lencod: 17.14% (1299664.0000 => 1522400.0000)
 MultiSource/Applications/SPASS/SPASS: 29.60% (1539168.0000 => 1994816.0000)
 MultiSource/Applications/d/make_dparser: 5.24% (301488.0000 => 317296.0000)
 MultiSource/Applications/hexxagon/hexxagon: 136.69% (40816.0000 => 96608.0000)
 MultiSource/Applications/lemon/lemon: 29.88% (96768.0000 => 125680.0000)
 MultiSource/Applications/minisat/minisat: 15.47% (46240.0000 => 53392.0000)
 MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.16% (9808.0000 => 10608.0000)
 MultiSource/Benchmarks/FreeBench/distray/distray: 9.13% (7008.0000 => 7648.0000)
 MultiSource/Benchmarks/MallocBench/gs/gs: 9.65% (384976.0000 => 422128.0000)
 MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 6.54% (3424.0000 => 3648.0000)
 MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 6.51% (3440.0000 => 3664.0000)
 MultiSource/Benchmarks/McCat/18-imp/imp: 21.37% (22240.0000 => 26992.0000)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.12% (314288.0000 => 330384.0000)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 848.70% (135184.0000 => 1282496.0000)
 MultiSource/Benchmarks/Olden/bh/bh: 5.14% (14016.0000 => 14736.0000)
 MultiSource/Benchmarks/PAQ8p/paq8p: 6.70% (194016.0000 => 207024.0000)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.10% (540384.0000 => 611152.0000)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 68.48% (89952.0000 => 151552.0000)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 234.54% (41600.0000 => 139168.0000)
 MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.11% (25648.0000 => 28240.0000)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.12% (79040.0000 => 85456.0000)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 24.67% (167344.0000 => 208624.0000)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 94.79% (87216.0000 => 169888.0000)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.41% (325808.0000 => 385776.0000)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.65% (114640.0000 => 137168.0000)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.24% (96560.0000 => 123824.0000)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (35360.0000 => 37584.0000)
 SingleSource/Benchmarks/McGill/chomp: 5.94% (6192.0000 => 6560.0000)
 SingleSource/Benchmarks/Misc/himenobmtxpa: -13.43% (7744.0000 => 6704.0000)
 SingleSource/Benchmarks/Shootout/hash: 7.07% (3168.0000 => 3392.0000)
 SingleSource/Benchmarks/Stanford/Bubblesort: 12.36% (1424.0000 => 1600.0000)
 SingleSource/Benchmarks/Stanford/Treesort: 6.06% (2112.0000 => 2240.0000)
 SingleSource/Regression/C/sumarraymalloc: 9.59% (1168.0000 => 1280.0000)
LLC compile:
 Externals/SPEC/CFP2000/179_art/179_art: 21.28% (0.2035 => 0.2468)
 Externals/SPEC/CFP2006/433_milc/433_milc: 5.33% (1.3534 => 1.4256)
 Externals/SPEC/CFP2006/444_namd/444_namd: 18.05% (3.0487 => 3.5991)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: 5.55% (23.7754 => 25.0948)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 8.35% (3.0882 => 3.3462)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 12.72% (5.5362 => 6.2405)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 9.40% (1.5580 => 1.7045)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 23.02% (2.6511 => 3.2614)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 5.71% (0.5083 => 0.5373)
 Externals/SPEC/CINT2006/473_astar/473_astar: 8.93% (0.4165 => 0.4537)
 MultiSource/Applications/ClamAV/clamscan: 6.82% (9.1342 => 9.7568)
 MultiSource/Applications/SPASS/SPASS: 18.14% (8.6809 => 10.2554)
 MultiSource/Applications/hexxagon/hexxagon: 29.54% (0.3565 => 0.4618)
 MultiSource/Applications/lemon/lemon: 5.17% (0.7335 => 0.7714)
 MultiSource/Applications/minisat/minisat: 5.98% (0.3259 => 0.3454)
 MultiSource/Applications/oggenc/oggenc: 5.26% (2.4430 => 2.5715)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 77.29% (1.1344 => 2.0112)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.89% (0.7468 => 0.8729)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 156.31% (0.3612 => 0.9258)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.19% (1.1258 => 1.1955)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.76% (0.7747 => 0.9123)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.21% (2.0379 => 2.1848)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.25% (1.0694 => 1.1255)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.15% (0.8435 => 0.9291)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.17% (0.2576 => 0.2735)
CBE:
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -6.64% (4.2200 => 3.9400)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: 8.03% (16.5700 => 17.9000)
 Externals/SPEC/CINT2000/181_mcf/181_mcf: 10.72% (5.1300 => 5.6800)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: 10.78% (11.3200 => 12.5400)
 Externals/SPEC/CINT2000/197_parser/197_parser: 6.06% (2.9700 => 3.1500)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 19.18% (15.6400 => 18.6400)
 Externals/SPEC/CINT2006/429_mcf/429_mcf: 15.46% (3.0400 => 3.5100)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 117.96% (7.7400 => 16.8700)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 9.90% (5.7600 => 6.3300)
 MultiSource/Applications/hexxagon/hexxagon: 38.78% (12.1200 => 16.8200)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.52% (0.8400 => 0.9200)
 MultiSource/Benchmarks/Olden/bh/bh: -8.14% (3.0700 => 2.8200)
 MultiSource/Benchmarks/Olden/health/health: 5.26% (0.3800 => 0.4000)
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 11809.32% (1.1800 => 140.5300)
 MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.52% (1.8100 => 1.9100)

More information about the llvm-testresults mailing list