[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Thu Mar 18 03:53:27 PDT 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/6477/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 6477, Start Time: 2010-03-18 00:33:29, End Time: 2010-03-18 03:53:08
Comparing To: 6415, Start Time: 2010-03-17 00:33:53, End Time: 2010-03-17 03:45:26
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 202
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 128
Total Test Failures By Type:
CBE: 46
JIT: 25
JIT codegen: 57
--- Changes Detail ---
New Test Passes:
New Test Failures:
Added Tests:
Removed Tests:
Significant Changes in Test Results:
CBE:
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 2619.22% (18.4200 => 500.8800)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.62% (0.8900 => 0.8400)
LLC-BETA:
MultiSource/Benchmarks/FreeBench/neural/neural: 9.52% (0.2100 => 0.2300)
MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.9700 => 1.0300)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.66% (0.7900 => 0.6900)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.34% (1.3100 => 1.3800)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.50% (2.0000 => 1.8700)
SingleSource/Benchmarks/Dhrystone/fldry: 6.35% (0.6300 => 0.6700)
SingleSource/Benchmarks/Misc/fbench: 9.95% (2.2100 => 2.4300)
SingleSource/Benchmarks/Misc/flops-1: -6.67% (3.9000 => 3.6400)
SingleSource/Benchmarks/Misc/himenobmtxpa: -7.24% (2.9000 => 2.6900)
SingleSource/Benchmarks/Misc/lowercase: 6.58% (8.8200 => 9.4000)
SingleSource/Benchmarks/Misc/mandel-2: -8.57% (1.0500 => 0.9600)
SingleSource/Benchmarks/Misc/richards_benchmark: 6.32% (0.9500 => 1.0100)
SingleSource/Benchmarks/Misc/salsa20: 7.77% (9.4000 => 10.1300)
LLC compile:
Externals/Nurbs/nurbs: -7.20% (1.0211 => 0.9476)
Externals/Povray/povray: -7.94% (9.6738 => 8.9054)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -7.98% (6.9659 => 6.4102)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -6.76% (1.9440 => 1.8126)
Externals/SPEC/CFP2006/433_milc/433_milc: -6.99% (1.2959 => 1.2053)
Externals/SPEC/CFP2006/444_namd/444_namd: -7.79% (3.1108 => 2.8685)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -7.21% (8.3393 => 7.7379)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -9.03% (4.8059 => 4.3719)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -5.86% (0.4383 => 0.4126)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -7.52% (1.8142 => 1.6778)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -7.94% (23.7877 => 21.8997)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -8.79% (2.8366 => 2.5874)
Externals/SPEC/CINT2000/197_parser/197_parser: -6.46% (1.9432 => 1.8177)
Externals/SPEC/CINT2000/252_eon/252_eon: -8.72% (3.0157 => 2.7527)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -8.28% (10.1526 => 9.3115)
Externals/SPEC/CINT2000/254_gap/254_gap: -7.95% (9.1007 => 8.3768)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -8.28% (5.4395 => 4.9889)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -6.09% (0.6170 => 0.5794)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -7.57% (3.3615 => 3.1069)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -8.56% (19.2462 => 17.5996)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -6.28% (1.4803 => 1.3874)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -8.42% (60.8428 => 55.7197)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -7.48% (12.3621 => 11.4371)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -7.50% (2.5848 => 2.3909)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -7.28% (1.5516 => 1.4387)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -9.04% (0.5077 => 0.4618)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -6.16% (10.9892 => 10.3125)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -7.34% (13.8460 => 12.8300)
Externals/SPEC/CINT2006/473_astar/473_astar: -8.37% (0.4109 => 0.3765)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -8.02% (46.3368 => 42.6208)
MultiSource/Applications/ClamAV/clamscan: -7.38% (9.2864 => 8.6006)
MultiSource/Applications/JM/ldecod/ldecod: -6.88% (5.3344 => 4.9675)
MultiSource/Applications/JM/lencod/lencod: -6.39% (11.2723 => 10.5520)
MultiSource/Applications/SIBsim4/SIBsim4: -6.73% (0.9871 => 0.9207)
MultiSource/Applications/SPASS/SPASS: -8.38% (8.2652 => 7.5729)
MultiSource/Applications/d/make_dparser: -8.30% (1.4980 => 1.3737)
MultiSource/Applications/hbd/hbd: -8.70% (0.5462 => 0.4987)
MultiSource/Applications/hexxagon/hexxagon: -7.70% (0.3156 => 0.2913)
MultiSource/Applications/kimwitu++/kc: -12.48% (8.7576 => 7.6643)
MultiSource/Applications/lambda-0_1_3/lambda: -9.31% (0.5446 => 0.4939)
MultiSource/Applications/lemon/lemon: -10.41% (0.7242 => 0.6488)
MultiSource/Applications/lua/lua: -8.61% (3.4040 => 3.1108)
MultiSource/Applications/minisat/minisat: -8.31% (0.3299 => 0.3025)
MultiSource/Applications/oggenc/oggenc: -6.72% (2.4565 => 2.2915)
MultiSource/Applications/siod/siod: -7.94% (2.5305 => 2.3297)
MultiSource/Applications/spiff/spiff: -6.64% (0.4639 => 0.4331)
MultiSource/Applications/sqlite3/sqlite3: -7.68% (7.5187 => 6.9415)
MultiSource/Applications/treecc/treecc: -7.51% (1.8101 => 1.6742)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.07% (4.6262 => 4.2989)
MultiSource/Benchmarks/Bullet/bullet: -8.86% (3.7989 => 3.4622)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.18% (0.5696 => 0.5230)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.86% (0.4257 => 0.3965)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -7.40% (3.1085 => 2.8784)
MultiSource/Benchmarks/MallocBench/gs/gs: -7.92% (2.5872 => 2.3822)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -7.98% (1.3616 => 1.2529)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.71% (2.6513 => 2.4998)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.70% (8.5724 => 7.6551)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.81% (1.0822 => 0.9869)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.17% (0.4114 => 0.3778)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -6.29% (1.3267 => 1.2433)
MultiSource/Benchmarks/PAQ8p/paq8p: -8.82% (1.4517 => 1.3237)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.96% (3.8993 => 3.5889)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.93% (0.7445 => 0.6929)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -7.70% (0.3624 => 0.3345)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.55% (0.9097 => 0.8501)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -10.01% (0.2388 => 0.2149)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -8.64% (0.2221 => 0.2029)
MultiSource/Benchmarks/Prolangs-C/football/football: -5.66% (0.6645 => 0.6269)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.94% (0.3227 => 0.3003)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.13% (0.4602 => 0.4320)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.33% (0.3146 => 0.2947)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.83% (0.6518 => 0.6138)
MultiSource/Benchmarks/Ptrdist/bc/bc: -7.20% (0.9619 => 0.8926)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.01% (0.5556 => 0.5222)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.57% (0.2729 => 0.2495)
MultiSource/Benchmarks/mafft/pairlocalalign: -6.49% (2.5950 => 2.4265)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.25% (0.4055 => 0.3761)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -7.60% (1.1648 => 1.0763)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.82% (0.7495 => 0.6984)
MultiSource/Benchmarks/sim/sim: -7.29% (0.2649 => 0.2456)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.61% (7.2127 => 6.5920)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.74% (2.1105 => 1.9893)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.47% (0.8362 => 0.7821)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.28% (0.7536 => 0.7063)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.38% (0.2790 => 0.2612)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.04% (0.2665 => 0.2504)
JIT:
MultiSource/Benchmarks/FreeBench/neural/neural: 6.45% (0.3100 => 0.3300)
MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (30.9400 => 29.0600)
LLC:
MultiSource/Benchmarks/FreeBench/neural/neural: 9.52% (0.2100 => 0.2300)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.70% (0.2300 => 0.2100)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.66% (0.7900 => 0.6900)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.34% (1.3100 => 1.3800)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.50% (2.0000 => 1.8700)
SingleSource/Benchmarks/Dhrystone/fldry: 6.35% (0.6300 => 0.6700)
SingleSource/Benchmarks/Misc/fbench: 9.95% (2.2100 => 2.4300)
SingleSource/Benchmarks/Misc/flops-1: -6.91% (3.9100 => 3.6400)
SingleSource/Benchmarks/Misc/himenobmtxpa: -5.86% (2.9000 => 2.7300)
SingleSource/Benchmarks/Misc/lowercase: 5.99% (8.8500 => 9.3800)
SingleSource/Benchmarks/Misc/mandel-2: -8.57% (1.0500 => 0.9600)
SingleSource/Benchmarks/Misc/richards_benchmark: 5.21% (0.9600 => 1.0100)
SingleSource/Benchmarks/Misc/salsa20: 8.00% (9.3700 => 10.1200)
LLC-BETA compile:
Externals/Nurbs/nurbs: -7.81% (1.0270 => 0.9468)
Externals/Povray/povray: -7.93% (9.6616 => 8.8950)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -7.42% (6.9509 => 6.4349)
Externals/SPEC/CFP2000/188_ammp/188_ammp: -7.04% (1.9528 => 1.8154)
Externals/SPEC/CFP2006/433_milc/433_milc: -6.28% (1.2904 => 1.2094)
Externals/SPEC/CFP2006/444_namd/444_namd: -8.33% (3.1258 => 2.8654)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -7.21% (8.3369 => 7.7361)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -8.55% (4.7698 => 4.3619)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -6.21% (0.4382 => 0.4110)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -7.49% (1.8136 => 1.6778)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -7.89% (23.8193 => 21.9389)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -8.76% (2.8363 => 2.5877)
Externals/SPEC/CINT2000/197_parser/197_parser: -6.09% (2.0299 => 1.9062)
Externals/SPEC/CINT2000/252_eon/252_eon: -8.21% (3.0054 => 2.7587)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -7.70% (10.1536 => 9.3719)
Externals/SPEC/CINT2000/254_gap/254_gap: -8.14% (9.1245 => 8.3821)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -8.25% (5.4493 => 4.9999)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -5.60% (0.6179 => 0.5833)
Externals/SPEC/CINT2000/300_twolf/300_twolf: -7.99% (3.3730 => 3.1035)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -11.35% (19.9846 => 17.7158)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.50% (1.4773 => 1.3960)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -8.40% (60.7677 => 55.6641)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -7.28% (2.5852 => 2.3970)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -7.14% (1.5539 => 1.4430)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -8.97% (0.5075 => 0.4620)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -5.69% (10.9814 => 10.3564)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -7.47% (13.8765 => 12.8404)
Externals/SPEC/CINT2006/473_astar/473_astar: -9.16% (0.4115 => 0.3738)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -8.02% (46.2605 => 42.5493)
MultiSource/Applications/ClamAV/clamscan: -7.22% (9.2830 => 8.6129)
MultiSource/Applications/JM/ldecod/ldecod: -7.24% (5.3609 => 4.9726)
MultiSource/Applications/JM/lencod/lencod: -6.93% (11.3185 => 10.5338)
MultiSource/Applications/SIBsim4/SIBsim4: -6.73% (0.9899 => 0.9233)
MultiSource/Applications/SPASS/SPASS: -8.11% (8.2749 => 7.6037)
MultiSource/Applications/d/make_dparser: -8.41% (1.4964 => 1.3706)
MultiSource/Applications/hbd/hbd: -9.05% (0.5472 => 0.4977)
MultiSource/Applications/hexxagon/hexxagon: -6.56% (0.3138 => 0.2932)
MultiSource/Applications/kimwitu++/kc: -12.38% (8.7431 => 7.6604)
MultiSource/Applications/lambda-0_1_3/lambda: -8.39% (0.5408 => 0.4954)
MultiSource/Applications/lemon/lemon: -8.06% (0.7018 => 0.6452)
MultiSource/Applications/lua/lua: -8.84% (3.4197 => 3.1173)
MultiSource/Applications/minisat/minisat: -7.90% (0.3303 => 0.3042)
MultiSource/Applications/oggenc/oggenc: -6.81% (2.4559 => 2.2887)
MultiSource/Applications/siod/siod: -6.97% (2.5300 => 2.3536)
MultiSource/Applications/spiff/spiff: -6.54% (0.4650 => 0.4346)
MultiSource/Applications/sqlite3/sqlite3: -8.30% (7.5610 => 6.9338)
MultiSource/Applications/treecc/treecc: -7.78% (1.8106 => 1.6697)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.69% (4.6223 => 4.3131)
MultiSource/Benchmarks/Bullet/bullet: -8.22% (3.7822 => 3.4714)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.72% (0.5724 => 0.5225)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.89% (0.4297 => 0.3958)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -7.37% (3.1110 => 2.8817)
MultiSource/Benchmarks/MallocBench/gs/gs: -8.11% (2.5939 => 2.3835)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.27% (0.6827 => 0.6467)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -7.73% (1.3618 => 1.2565)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.99% (2.7180 => 2.5008)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.95% (8.4902 => 7.6456)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.90% (1.0737 => 0.9889)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.43% (0.4145 => 0.3754)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -5.70% (1.3273 => 1.2517)
MultiSource/Benchmarks/PAQ8p/paq8p: -9.47% (1.4537 => 1.3161)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.70% (3.8983 => 3.5980)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -7.48% (0.7471 => 0.6912)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -7.00% (0.3629 => 0.3375)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.71% (0.9144 => 0.8530)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -10.45% (0.2401 => 0.2150)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.46% (0.2213 => 0.2048)
MultiSource/Benchmarks/Prolangs-C/football/football: -6.29% (0.6663 => 0.6244)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -7.10% (0.3225 => 0.2996)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.85% (0.4611 => 0.4295)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.62% (0.3142 => 0.2934)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.57% (0.6484 => 0.6123)
MultiSource/Benchmarks/Ptrdist/bc/bc: -8.05% (0.9655 => 0.8878)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.21% (0.5564 => 0.5274)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.82% (0.2744 => 0.2502)
MultiSource/Benchmarks/mafft/pairlocalalign: -7.36% (2.6296 => 2.4361)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.70% (0.4067 => 0.3754)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -8.52% (1.1688 => 1.0692)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.75% (0.7479 => 0.6974)
MultiSource/Benchmarks/sim/sim: -8.36% (0.2669 => 0.2446)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.39% (7.2466 => 6.6383)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.87% (2.1102 => 1.9863)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.98% (0.8334 => 0.7836)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.92% (0.7575 => 0.7051)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.11% (0.2761 => 0.2620)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.69% (0.2653 => 0.2502)
More information about the llvm-testresults
mailing list