[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Mon Mar 1 04:25:25 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5857/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 5857, Start Time: 2010-03-01 01:13:47, End Time: 2010-03-01 04:25:13
Comparing To: 5800, Start Time: 2010-02-27 01:37:30, End Time: 2010-02-27 04:56:36
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 1
Added Tests: 0
Removed Tests: 0
Significant Changes: 194
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 128
Total Test Failures By Type:
CBE: 46
JIT: 25
JIT codegen: 57
--- Changes Detail ---
New Test Passes:
New Test Failures:
MultiSource/Applications/ClamAV/clamscan [CBE]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/Povray/povray: -5.87% (1585120.0000 => 1492112.0000)
Externals/SPEC/CFP2000/179_art/179_art: -52.62% (53088.0000 => 25152.0000)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -10.60% (284848.0000 => 254656.0000)
Externals/SPEC/CFP2006/433_milc/433_milc: -20.20% (201568.0000 => 160848.0000)
Externals/SPEC/CFP2006/444_namd/444_namd: -51.73% (899120.0000 => 434032.0000)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -5.02% (720144.0000 => 683968.0000)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -11.58% (68544.0000 => 60608.0000)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -8.86% (272544.0000 => 248384.0000)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -14.41% (3821856.0000 => 3271280.0000)
Externals/SPEC/CINT2000/181_mcf/181_mcf: -5.31% (21088.0000 => 19968.0000)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -23.61% (527600.0000 => 403024.0000)
Externals/SPEC/CINT2000/197_parser/197_parser: -19.36% (341376.0000 => 275296.0000)
Externals/SPEC/CINT2000/254_gap/254_gap: -7.22% (1257552.0000 => 1166784.0000)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -20.58% (948784.0000 => 753536.0000)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -23.03% (91088.0000 => 70112.0000)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -8.94% (462016.0000 => 420704.0000)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -6.23% (2888896.0000 => 2709024.0000)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -11.26% (234112.0000 => 207760.0000)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -9.48% (10047328.0000 => 9094624.0000)
Externals/SPEC/CINT2006/429_mcf/429_mcf: -6.76% (24144.0000 => 22512.0000)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -43.37% (391392.0000 => 221632.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -7.40% (58992.0000 => 54624.0000)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -6.56% (1111728.0000 => 1038816.0000)
Externals/SPEC/CINT2006/473_astar/473_astar: -12.51% (59344.0000 => 51920.0000)
MultiSource/Applications/ClamAV/clamscan: -19.79% (1580736.0000 => 1267888.0000)
MultiSource/Applications/JM/lencod/lencod: -14.38% (1517952.0000 => 1299664.0000)
MultiSource/Applications/SPASS/SPASS: -22.65% (1989888.0000 => 1539168.0000)
MultiSource/Applications/hexxagon/hexxagon: -57.13% (95216.0000 => 40816.0000)
MultiSource/Applications/lemon/lemon: -23.09% (125824.0000 => 96768.0000)
MultiSource/Applications/minisat/minisat: -13.00% (53152.0000 => 46240.0000)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.40% (10592.0000 => 9808.0000)
MultiSource/Benchmarks/FreeBench/distray/distray: -8.37% (7648.0000 => 7008.0000)
MultiSource/Benchmarks/MallocBench/gs/gs: -9.12% (423584.0000 => 384960.0000)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -6.14% (3648.0000 => 3424.0000)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -6.11% (3664.0000 => 3440.0000)
MultiSource/Benchmarks/McCat/18-imp/imp: -17.61% (26992.0000 => 22240.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -89.24% (1256704.0000 => 135184.0000)
MultiSource/Benchmarks/PAQ8p/paq8p: -6.28% (207024.0000 => 194016.0000)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.90% (614288.0000 => 541168.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -40.27% (150608.0000 => 89952.0000)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -70.79% (142432.0000 => 41600.0000)
MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.18% (28240.0000 => 25648.0000)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.51% (85456.0000 => 79040.0000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -19.28% (207312.0000 => 167344.0000)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -48.43% (169136.0000 => 87216.0000)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -15.49% (385504.0000 => 325808.0000)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -16.42% (137168.0000 => 114640.0000)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.01% (123808.0000 => 96560.0000)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.92% (37584.0000 => 35360.0000)
SingleSource/Benchmarks/McGill/chomp: -5.61% (6560.0000 => 6192.0000)
SingleSource/Benchmarks/Misc/himenobmtxpa: 15.51% (6704.0000 => 7744.0000)
SingleSource/Benchmarks/Shootout/hash: -6.60% (3392.0000 => 3168.0000)
SingleSource/Benchmarks/Stanford/Bubblesort: -11.00% (1600.0000 => 1424.0000)
SingleSource/Benchmarks/Stanford/Treesort: -5.71% (2240.0000 => 2112.0000)
SingleSource/Regression/C/sumarraymalloc: -8.75% (1280.0000 => 1168.0000)
JIT codegen:
MultiSource/Applications/SPASS/SPASS: -23.96% (6.1626 => 4.6861)
MultiSource/Applications/d/make_dparser: -6.17% (1.2284 => 1.1526)
MultiSource/Applications/hexxagon/hexxagon: -28.23% (0.3688 => 0.2647)
MultiSource/Applications/minisat/minisat: -5.91% (0.2961 => 0.2786)
MultiSource/Applications/oggenc/oggenc: -5.73% (1.6774 => 1.5813)
MultiSource/Benchmarks/MallocBench/gs/gs: -6.07% (1.0282 => 0.9658)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.78% (0.2537 => 0.2365)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -76.77% (0.9037 => 0.2099)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -8.47% (0.6894 => 0.6310)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -19.79% (0.6237 => 0.5003)
CBE:
Externals/SPEC/CINT2000/164_gzip/164_gzip: -8.26% (13.4400 => 12.3300)
Externals/SPEC/CINT2000/181_mcf/181_mcf: -5.09% (5.3000 => 5.0300)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -10.73% (9.2300 => 8.2400)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -14.41% (12.3500 => 10.5700)
Externals/SPEC/CINT2006/429_mcf/429_mcf: -8.95% (3.2400 => 2.9500)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -59.11% (14.9900 => 6.1300)
MultiSource/Applications/hexxagon/hexxagon: -33.04% (15.8300 => 10.6000)
MultiSource/Applications/siod/siod: -5.56% (3.6000 => 3.4000)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -7.32% (0.8200 => 0.7600)
MultiSource/Benchmarks/Olden/bh/bh: 15.59% (2.6300 => 3.0400)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -99.84% (209.4100 => 0.3400)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.89% (1.5200 => 1.4000)
MultiSource/Benchmarks/Ptrdist/ft/ft: -5.31% (1.1300 => 1.0700)
SingleSource/Benchmarks/Misc/salsa20: 18.25% (12.6000 => 14.9000)
LLC-BETA:
Externals/SPEC/CFP2006/444_namd/444_namd: -6.81% (18.2000 => 16.9600)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -7.34% (1.0900 => 1.0100)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -17.95% (12.5900 => 10.3300)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -15.71% (6.4300 => 5.4200)
MultiSource/Applications/minisat/minisat: -6.05% (7.9300 => 7.4500)
MultiSource/Applications/siod/siod: -9.21% (3.6900 => 3.3500)
MultiSource/Benchmarks/Olden/bh/bh: -5.49% (2.7300 => 2.5800)
MultiSource/Benchmarks/PAQ8p/paq8p: -17.50% (111.7700 => 92.2100)
SingleSource/UnitTests/Vector/build2: 8.33% (1.8000 => 1.9500)
LLC compile:
Externals/SPEC/CFP2006/433_milc/433_milc: -5.61% (1.3367 => 1.2617)
Externals/SPEC/CFP2006/444_namd/444_namd: -18.40% (3.6364 => 2.9673)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -5.91% (23.9195 => 22.5063)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -8.31% (3.0342 => 2.7821)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -12.20% (5.8594 => 5.1446)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -6.36% (1.5540 => 1.4551)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -23.96% (1.9652 => 1.4943)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -5.63% (0.5182 => 0.4890)
Externals/SPEC/CINT2006/473_astar/473_astar: -7.53% (0.4279 => 0.3957)
MultiSource/Applications/ClamAV/clamscan: -6.57% (9.3220 => 8.7091)
MultiSource/Applications/SPASS/SPASS: -16.60% (9.6133 => 8.0179)
MultiSource/Applications/hexxagon/hexxagon: -27.54% (0.4150 => 0.3007)
MultiSource/Applications/lemon/lemon: -7.92% (0.7388 => 0.6803)
MultiSource/Applications/minisat/minisat: -5.92% (0.3363 => 0.3164)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -44.56% (1.8513 => 1.0263)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -14.79% (0.8376 => 0.7137)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -75.00% (0.9149 => 0.2287)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.25% (1.1554 => 1.0947)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -15.17% (0.8633 => 0.7323)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.49% (0.8454 => 0.7990)
GCCAS:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -5.58% (5.1031 => 4.8184)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -6.70% (3.1320 => 2.9220)
Externals/SPEC/CFP2006/433_milc/433_milc: -7.93% (1.4649 => 1.3487)
Externals/SPEC/CFP2006/444_namd/444_namd: -38.57% (4.9723 => 3.0547)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -5.07% (40.2709 => 38.2290)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -7.82% (0.5833 => 0.5377)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -17.59% (23.3758 => 19.2635)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -12.73% (2.2433 => 1.9577)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -8.01% (6.2470 => 5.7465)
Externals/SPEC/CINT2000/254_gap/254_gap: -5.35% (6.2338 => 5.9004)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -11.67% (4.5932 => 4.0574)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -6.10% (0.4344 => 0.4079)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -10.08% (2.5465 => 2.2898)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -10.50% (1.2208 => 1.0926)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -9.35% (51.1678 => 46.3811)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -8.70% (8.9976 => 8.2151)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -13.91% (1.3052 => 1.1236)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -9.30% (8.5171 => 7.7254)
MultiSource/Applications/ClamAV/clamscan: -12.84% (7.3773 => 6.4301)
MultiSource/Applications/JM/ldecod/ldecod: -5.56% (4.2248 => 3.9899)
MultiSource/Applications/JM/lencod/lencod: -5.63% (8.1023 => 7.6464)
MultiSource/Applications/d/make_dparser: -6.67% (1.7476 => 1.6311)
MultiSource/Applications/hexxagon/hexxagon: -17.24% (0.2900 => 0.2400)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -23.20% (5.4064 => 4.1522)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -54.61% (2.2104 => 1.0033)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.16% (2.7874 => 2.5599)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -18.63% (0.6775 => 0.5513)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.82% (0.5051 => 0.4555)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.42% (2.0269 => 1.8967)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -7.48% (0.6886 => 0.6371)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -12.24% (1.5925 => 1.3975)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.98% (1.3102 => 1.2187)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -11.56% (0.9063 => 0.8015)
JIT:
Externals/SPEC/CFP2006/444_namd/444_namd: -5.29% (19.8600 => 18.8100)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -9.22% (16.3700 => 14.8600)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -6.94% (9.3600 => 8.7100)
Externals/SPEC/CINT2000/254_gap/254_gap: -7.13% (5.6100 => 5.2100)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -7.01% (6.5600 => 6.1000)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -16.93% (13.2300 => 10.9900)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -19.32% (7.9700 => 6.4300)
MultiSource/Applications/SPASS/SPASS: -11.17% (14.9500 => 13.2800)
MultiSource/Applications/d/make_dparser: -5.59% (1.4300 => 1.3500)
MultiSource/Applications/lemon/lemon: -7.55% (184.2500 => 170.3300)
MultiSource/Applications/minisat/minisat: -5.48% (8.2100 => 7.7600)
MultiSource/Applications/siod/siod: -6.09% (4.7600 => 4.4700)
MultiSource/Benchmarks/MallocBench/gs/gs: -6.20% (1.2900 => 1.2100)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.26% (0.3800 => 0.3600)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.34% (0.2900 => 0.2600)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -74.47% (0.9400 => 0.2400)
MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (35.0700 => 32.9000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -7.59% (0.7900 => 0.7300)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -18.57% (0.7000 => 0.5700)
SingleSource/Benchmarks/BenchmarkGame/n-body: -8.65% (2.0800 => 1.9000)
SingleSource/Benchmarks/BenchmarkGame/recursive: -6.86% (1.7500 => 1.6300)
SingleSource/Benchmarks/Dhrystone/dry: -62.70% (1.2600 => 0.4700)
SingleSource/Benchmarks/McGill/chomp: -18.02% (1.1100 => 0.9100)
SingleSource/Benchmarks/Misc/richards_benchmark: -5.04% (1.1900 => 1.1300)
SingleSource/Benchmarks/Shootout-C++/ackermann: -7.14% (1.8200 => 1.6900)
SingleSource/Benchmarks/Shootout/lists: 7.17% (6.9700 => 7.4700)
SingleSource/Benchmarks/Shootout/methcall: -11.08% (6.8600 => 6.1000)
LLC:
Externals/SPEC/CFP2006/444_namd/444_namd: -6.86% (18.2100 => 16.9600)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -9.09% (1.1000 => 1.0000)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -17.91% (12.6200 => 10.3600)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -17.57% (6.4300 => 5.3000)
MultiSource/Applications/kimwitu++/kc: -6.25% (0.3200 => 0.3000)
MultiSource/Applications/siod/siod: -6.37% (3.6100 => 3.3800)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.9100 => 0.9600)
SingleSource/UnitTests/Vector/build2: 8.33% (1.8000 => 1.9500)
LLC-BETA compile:
Externals/SPEC/CFP2006/433_milc/433_milc: -5.74% (1.3394 => 1.2625)
Externals/SPEC/CFP2006/444_namd/444_namd: -18.33% (3.6872 => 3.0112)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -7.21% (24.2274 => 22.4810)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -8.94% (3.0367 => 2.7653)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -12.23% (5.8743 => 5.1556)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -6.38% (1.5521 => 1.4530)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -24.36% (1.9767 => 1.4951)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -5.91% (0.5180 => 0.4874)
Externals/SPEC/CINT2006/473_astar/473_astar: -7.09% (0.4286 => 0.3982)
MultiSource/Applications/ClamAV/clamscan: -9.06% (9.5649 => 8.6979)
MultiSource/Applications/SPASS/SPASS: -16.58% (9.6770 => 8.0726)
MultiSource/Applications/hexxagon/hexxagon: -26.75% (0.4105 => 0.3007)
MultiSource/Applications/lemon/lemon: -10.18% (0.7410 => 0.6656)
MultiSource/Applications/oggenc/oggenc: -5.02% (2.4825 => 2.3580)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -44.52% (1.8596 => 1.0317)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -15.63% (0.8427 => 0.7110)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -74.50% (0.9158 => 0.2335)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -15.27% (0.8683 => 0.7357)
More information about the llvm-testresults
mailing list