[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Sat Feb 27 04:56:48 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5800/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 5800, Start Time: 2010-02-27 01:37:30, End Time: 2010-02-27 04:56:36
Comparing To: 5769, Start Time: 2010-02-26 01:43:19, End Time: 2010-02-26 04:56:59
--- Changes Summary ---
New Test Passes: 22
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 198
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 127
Total Test Failures By Type:
CBE: 45
JIT: 25
JIT codegen: 57
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2000/183_equake/183_equake [LLC, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/ClamAV/clamscan [CBE]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count-2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/throw_rethrow_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
New Test Failures:
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/Povray/povray: 6.23% (1492112.0000 => 1585120.0000)
Externals/SPEC/CFP2000/179_art/179_art: 111.07% (25152.0000 => 53088.0000)
Externals/SPEC/CFP2000/188_ammp/188_ammp: 11.86% (254656.0000 => 284848.0000)
Externals/SPEC/CFP2006/433_milc/433_milc: 25.32% (160848.0000 => 201568.0000)
Externals/SPEC/CFP2006/444_namd/444_namd: 107.16% (434032.0000 => 899120.0000)
Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.29% (683968.0000 => 720144.0000)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 13.09% (60608.0000 => 68544.0000)
Externals/SPEC/CINT2000/175_vpr/175_vpr: 9.73% (248384.0000 => 272544.0000)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 16.83% (3271280.0000 => 3821856.0000)
Externals/SPEC/CINT2000/181_mcf/181_mcf: 5.61% (19968.0000 => 21088.0000)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 30.91% (403024.0000 => 527600.0000)
Externals/SPEC/CINT2000/197_parser/197_parser: 24.00% (275296.0000 => 341376.0000)
Externals/SPEC/CINT2000/254_gap/254_gap: 7.78% (1166784.0000 => 1257552.0000)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 25.91% (753536.0000 => 948784.0000)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 29.92% (70112.0000 => 91088.0000)
Externals/SPEC/CINT2000/300_twolf/300_twolf: 9.82% (420704.0000 => 462016.0000)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 6.64% (2709024.0000 => 2888896.0000)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 12.68% (207760.0000 => 234112.0000)
Externals/SPEC/CINT2006/403_gcc/403_gcc: 10.48% (9094624.0000 => 10047328.0000)
Externals/SPEC/CINT2006/429_mcf/429_mcf: 7.25% (22512.0000 => 24144.0000)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 76.60% (221632.0000 => 391392.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 8.00% (54624.0000 => 58992.0000)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 7.02% (1038816.0000 => 1111728.0000)
Externals/SPEC/CINT2006/473_astar/473_astar: 14.30% (51920.0000 => 59344.0000)
MultiSource/Applications/ClamAV/clamscan: 24.67% (1267888.0000 => 1580736.0000)
MultiSource/Applications/JM/lencod/lencod: 16.80% (1299664.0000 => 1517952.0000)
MultiSource/Applications/SPASS/SPASS: 29.28% (1539168.0000 => 1989888.0000)
MultiSource/Applications/d/make_dparser: 5.25% (301488.0000 => 317312.0000)
MultiSource/Applications/hexxagon/hexxagon: 133.28% (40816.0000 => 95216.0000)
MultiSource/Applications/lemon/lemon: 30.03% (96768.0000 => 125824.0000)
MultiSource/Applications/minisat/minisat: 14.95% (46240.0000 => 53152.0000)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.99% (9808.0000 => 10592.0000)
MultiSource/Benchmarks/FreeBench/distray/distray: 9.13% (7008.0000 => 7648.0000)
MultiSource/Benchmarks/MallocBench/gs/gs: 10.03% (384960.0000 => 423584.0000)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 6.54% (3424.0000 => 3648.0000)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 6.51% (3440.0000 => 3664.0000)
MultiSource/Benchmarks/McCat/18-imp/imp: 21.37% (22240.0000 => 26992.0000)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.01% (314288.0000 => 330048.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 829.62% (135184.0000 => 1256704.0000)
MultiSource/Benchmarks/Olden/bh/bh: 5.14% (14016.0000 => 14736.0000)
MultiSource/Benchmarks/PAQ8p/paq8p: 6.70% (194016.0000 => 207024.0000)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.68% (540384.0000 => 614288.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 67.43% (89952.0000 => 150608.0000)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 242.38% (41600.0000 => 142432.0000)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.11% (25648.0000 => 28240.0000)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.12% (79040.0000 => 85456.0000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.88% (167344.0000 => 207312.0000)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 93.93% (87216.0000 => 169136.0000)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.32% (325808.0000 => 385504.0000)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.65% (114640.0000 => 137168.0000)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.22% (96560.0000 => 123808.0000)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (35360.0000 => 37584.0000)
SingleSource/Benchmarks/McGill/chomp: 5.94% (6192.0000 => 6560.0000)
SingleSource/Benchmarks/Misc/himenobmtxpa: -13.43% (7744.0000 => 6704.0000)
SingleSource/Benchmarks/Shootout/hash: 7.07% (3168.0000 => 3392.0000)
SingleSource/Benchmarks/Stanford/Bubblesort: 12.36% (1424.0000 => 1600.0000)
SingleSource/Benchmarks/Stanford/Treesort: 6.06% (2112.0000 => 2240.0000)
SingleSource/Regression/C/sumarraymalloc: 9.59% (1168.0000 => 1280.0000)
JIT codegen:
MultiSource/Applications/JM/lencod/lencod: 5.55% (8.4693 => 8.9394)
MultiSource/Applications/SPASS/SPASS: 30.82% (4.7108 => 6.1626)
MultiSource/Applications/hexxagon/hexxagon: 38.44% (0.2664 => 0.3688)
MultiSource/Applications/minisat/minisat: 5.75% (0.2800 => 0.2961)
MultiSource/Applications/oggenc/oggenc: 6.14% (1.5804 => 1.6774)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.2385 => 0.2537)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 331.98% (0.2092 => 0.9037)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.86% (0.6275 => 0.6894)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.69% (0.5002 => 0.6237)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.04% (0.9324 => 0.9794)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.57% (0.7263 => 0.8031)
CBE:
Externals/SPEC/CINT2000/164_gzip/164_gzip: 9.00% (12.3300 => 13.4400)
Externals/SPEC/CINT2000/181_mcf/181_mcf: 5.79% (5.0100 => 5.3000)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 11.74% (8.2600 => 9.2300)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 15.85% (10.6600 => 12.3500)
Externals/SPEC/CINT2006/429_mcf/429_mcf: 8.72% (2.9800 => 3.2400)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 144.93% (6.1200 => 14.9900)
MultiSource/Applications/hexxagon/hexxagon: 49.48% (10.5900 => 15.8300)
MultiSource/Applications/siod/siod: 5.57% (3.4100 => 3.6000)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.89% (0.7600 => 0.8200)
MultiSource/Benchmarks/Olden/bh/bh: -14.61% (3.0800 => 2.6300)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 6.38% (196.8600 => 209.4100)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.57% (1.4000 => 1.5200)
MultiSource/Benchmarks/Ptrdist/ft/ft: 7.62% (1.0500 => 1.1300)
MultiSource/Benchmarks/llubenchmark/llu: 5.24% (3.8200 => 4.0200)
SingleSource/Benchmarks/Misc/salsa20: -15.44% (14.9000 => 12.6000)
LLC-BETA:
Externals/SPEC/CFP2006/444_namd/444_namd: 5.14% (17.3100 => 18.2000)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 7.92% (1.0100 => 1.0900)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 20.02% (10.4900 => 12.5900)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 18.42% (5.4300 => 6.4300)
MultiSource/Applications/siod/siod: 10.15% (3.3500 => 3.6900)
MultiSource/Benchmarks/Olden/health/health: -5.00% (0.4000 => 0.3800)
MultiSource/Benchmarks/PAQ8p/paq8p: 21.24% (92.1900 => 111.7700)
SingleSource/Benchmarks/Shootout/lists: -7.75% (7.1000 => 6.5500)
LLC compile:
Externals/SPEC/CFP2006/444_namd/444_namd: 21.62% (2.9900 => 3.6364)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 6.09% (22.5462 => 23.9195)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 8.51% (2.7962 => 3.0342)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 13.24% (5.1745 => 5.8594)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 31.28% (1.4969 => 1.9652)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 6.38% (0.4871 => 0.5182)
Externals/SPEC/CINT2006/473_astar/473_astar: 8.27% (0.3952 => 0.4279)
MultiSource/Applications/ClamAV/clamscan: 7.25% (8.6918 => 9.3220)
MultiSource/Applications/SPASS/SPASS: 18.80% (8.0919 => 9.6133)
MultiSource/Applications/hexxagon/hexxagon: 36.78% (0.3034 => 0.4150)
MultiSource/Applications/lemon/lemon: 6.78% (0.6919 => 0.7388)
MultiSource/Applications/minisat/minisat: 5.92% (0.3175 => 0.3363)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 80.61% (1.0250 => 1.8513)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.85% (0.7168 => 0.8376)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 300.04% (0.2287 => 0.9149)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.11% (1.0889 => 1.1554)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.70% (0.7335 => 0.8633)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.68% (0.7708 => 0.8454)
GCCAS:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 6.16% (4.8072 => 5.1031)
Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.93% (2.9289 => 3.1320)
Externals/SPEC/CFP2006/444_namd/444_namd: 62.34% (3.0629 => 4.9723)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 8.82% (0.5360 => 0.5833)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 21.55% (19.2310 => 23.3758)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 15.33% (1.9451 => 2.2433)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 9.12% (5.7249 => 6.2470)
Externals/SPEC/CINT2000/254_gap/254_gap: 5.36% (5.9165 => 6.2338)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 14.29% (4.0188 => 4.5932)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 5.08% (0.4134 => 0.4344)
Externals/SPEC/CINT2000/300_twolf/300_twolf: 11.14% (2.2912 => 2.5465)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 6.73% (12.0719 => 12.8847)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 7.77% (1.1328 => 1.2208)
Externals/SPEC/CINT2006/403_gcc/403_gcc: 11.48% (45.8973 => 51.1678)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 9.34% (8.2290 => 8.9976)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 16.55% (1.1199 => 1.3052)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 9.27% (7.7946 => 8.5171)
Externals/SPEC/CINT2006/473_astar/473_astar: 5.67% (0.3738 => 0.3950)
MultiSource/Applications/ClamAV/clamscan: 15.19% (6.4043 => 7.3773)
MultiSource/Applications/JM/ldecod/ldecod: 6.25% (3.9761 => 4.2248)
MultiSource/Applications/JM/lencod/lencod: 6.44% (7.6124 => 8.1023)
MultiSource/Applications/d/make_dparser: 6.83% (1.6358 => 1.7476)
MultiSource/Applications/hexxagon/hexxagon: 21.75% (0.2382 => 0.2900)
MultiSource/Applications/lemon/lemon: 7.32% (0.5014 => 0.5381)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 31.32% (4.1169 => 5.4064)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 121.99% (0.9957 => 2.2104)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.12% (2.5545 => 2.7874)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.32% (0.5494 => 0.6775)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.57% (0.4568 => 0.5051)
MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (0.5098 => 0.5357)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.56% (1.8844 => 2.0269)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.96% (0.6320 => 0.6886)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.80% (1.3994 => 1.5925)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.78% (1.2270 => 1.3102)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.60% (0.8049 => 0.9063)
JIT:
Externals/SPEC/CFP2006/433_milc/433_milc: -16.33% (13.0400 => 10.9100)
Externals/SPEC/CFP2006/444_namd/444_namd: 5.25% (18.8700 => 19.8600)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 8.84% (15.0400 => 16.3700)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 6.97% (8.7500 => 9.3600)
Externals/SPEC/CINT2000/254_gap/254_gap: 6.86% (5.2500 => 5.6100)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 6.67% (6.1500 => 6.5600)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 19.19% (11.1000 => 13.2300)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 23.76% (6.4400 => 7.9700)
MultiSource/Applications/SPASS/SPASS: 12.15% (13.3300 => 14.9500)
MultiSource/Applications/lemon/lemon: 7.56% (171.3000 => 184.2500)
MultiSource/Applications/minisat/minisat: 5.39% (7.7900 => 8.2100)
MultiSource/Applications/siod/siod: 7.21% (4.4400 => 4.7600)
MultiSource/Benchmarks/FreeBench/neural/neural: -6.06% (0.3300 => 0.3100)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -12.50% (0.3200 => 0.2800)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.54% (0.2600 => 0.2900)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 291.67% (0.2400 => 0.9400)
MultiSource/Benchmarks/mafft/pairlocalalign: 7.51% (32.6200 => 35.0700)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.22% (0.7300 => 0.7900)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 22.81% (0.5700 => 0.7000)
SingleSource/Benchmarks/BenchmarkGame/n-body: 9.47% (1.9000 => 2.0800)
SingleSource/Benchmarks/McGill/chomp: 21.98% (0.9100 => 1.1100)
SingleSource/Benchmarks/McGill/queens: -5.18% (2.5100 => 2.3800)
LLC:
Externals/SPEC/CFP2006/433_milc/433_milc: -18.97% (11.7000 => 9.4800)
Externals/SPEC/CFP2006/444_namd/444_namd: 5.14% (17.3200 => 18.2100)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 8.91% (1.0100 => 1.1000)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 5.88% (6.4600 => 6.8400)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 20.65% (10.4600 => 12.6200)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 19.96% (5.3600 => 6.4300)
MultiSource/Applications/sgefa/sgefa: 7.94% (0.6300 => 0.6800)
MultiSource/Applications/siod/siod: 6.49% (3.3900 => 3.6100)
MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.69% (0.3900 => 0.4200)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.19% (0.9700 => 0.9100)
SingleSource/Benchmarks/Misc/richards_benchmark: -5.00% (1.0000 => 0.9500)
SingleSource/Benchmarks/Shootout/lists: -7.34% (7.0800 => 6.5600)
LLC-BETA compile:
Externals/SPEC/CFP2006/433_milc/433_milc: 5.81% (1.2658 => 1.3394)
Externals/SPEC/CFP2006/444_namd/444_namd: 19.98% (3.0732 => 3.6872)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 7.35% (22.5692 => 24.2274)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 8.50% (2.7989 => 3.0367)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 13.00% (5.1985 => 5.8743)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: 31.72% (1.5007 => 1.9767)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 6.43% (0.4867 => 0.5180)
Externals/SPEC/CINT2006/473_astar/473_astar: 8.04% (0.3967 => 0.4286)
MultiSource/Applications/ClamAV/clamscan: 9.70% (8.7189 => 9.5649)
MultiSource/Applications/SPASS/SPASS: 19.42% (8.1033 => 9.6770)
MultiSource/Applications/hexxagon/hexxagon: 35.43% (0.3031 => 0.4105)
MultiSource/Applications/lemon/lemon: 7.64% (0.6884 => 0.7410)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 81.53% (1.0244 => 1.8596)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.37% (0.7180 => 0.8427)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 299.04% (0.2295 => 0.9158)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (1.0931 => 1.1518)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.35% (0.7399 => 0.8683)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.48% (0.9769 => 1.0304)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.21% (0.7713 => 0.8423)
More information about the llvm-testresults
mailing list