[llvm-testresults] smoosh-01.apple.com nightly tester results
Daniel Dunbar
daniel at zuster.org
Sun Oct 18 19:28:20 PDT 2009
I assume this is post regalloc scheduling being turned on. I have to
say, at least on nightly test the compile time performance hit to
runtime performance improvement looks kind of sad... does it have to
be this expensive?
- Daniel
On Sun, Oct 18, 2009 at 5:15 PM, <daniel_dunbar at apple.com> wrote:
> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//2440
> Name: smoosh-01
> Nickname: smoosh-01.apple.com:2
> Buildstatus: OK
>
> Run: 2440, Start Time: 2009-10-18 15:28:17
> Comparing To: 2439, Start Time: 2009-10-18 12:37:19
>
> --- Changes Summary ---
> New Test Passes: 0
> New Test Failures: 0
> Added Tests: 0
> Removed Tests: 0
> Significant Changes: 194
>
> --- Tests Summary ---
> Total Tests: 3537
> Total Test Failures: 92
>
> Total Test Failures By Type:
> CBE: 44
> JIT: 24
> JIT codegen: 24
>
> --- Changes Detail ---
> New Test Passes:
>
> New Test Failures:
>
> Added Tests:
>
> Removed Tests:
>
> Significant Changes in Test Results:
> JIT codegen:
> MultiSource/Applications/ClamAV/clamscan: 7.98% (4.3292 => 4.6746)
> MultiSource/Applications/JM/ldecod/ldecod: 10.40% (2.4122 => 2.6631)
> MultiSource/Applications/SIBsim4/SIBsim4: 10.40% (0.5300 => 0.5851)
> MultiSource/Applications/SPASS/SPASS: 9.26% (4.2415 => 4.6343)
> MultiSource/Applications/d/make_dparser: 9.95% (0.9689 => 1.0653)
> MultiSource/Applications/hbd/hbd: 11.22% (0.3699 => 0.4114)
> MultiSource/Applications/hexxagon/hexxagon: 10.52% (0.2328 => 0.2573)
> MultiSource/Applications/kimwitu++/kc: 18.55% (4.9504 => 5.8689)
> MultiSource/Applications/lambda-0_1_3/lambda: 10.59% (0.3021 => 0.3341)
> MultiSource/Applications/lua/lua: 10.97% (1.7705 => 1.9647)
> MultiSource/Applications/minisat/minisat: 10.85% (0.2249 => 0.2493)
> MultiSource/Applications/oggenc/oggenc: 9.98% (1.0775 => 1.1850)
> MultiSource/Applications/siod/siod: 10.08% (0.8583 => 0.9448)
> MultiSource/Applications/spiff/spiff: 9.20% (0.2662 => 0.2907)
> MultiSource/Applications/sqlite3/sqlite3: 9.97% (4.2982 => 4.7268)
> MultiSource/Applications/treecc/treecc: 9.28% (0.3750 => 0.4098)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.90% (2.1640 => 2.3782)
> MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.80% (0.3224 => 0.3701)
> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.43% (0.2926 => 0.3202)
> MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.28% (1.4974 => 1.6364)
> MultiSource/Benchmarks/MallocBench/gs/gs: 10.52% (0.7294 => 0.8061)
> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.47% (0.2808 => 0.3074)
> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.97% (0.4584 => 0.5041)
> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.38% (1.0376 => 1.1453)
> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.07% (5.5840 => 6.2580)
> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.77% (0.2164 => 0.2527)
> MultiSource/Benchmarks/PAQ8p/paq8p: 11.50% (0.7069 => 0.7882)
> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.37% (0.5229 => 0.5719)
> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.07% (0.2669 => 0.2911)
> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.12% (0.8772 => 0.9397)
> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3170 => 0.3477)
> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.33% (0.2052 => 0.2305)
> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.86% (0.2405 => 0.2618)
> MultiSource/Benchmarks/Ptrdist/bc/bc: 9.18% (0.6418 => 0.7007)
> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.51% (0.2962 => 0.3214)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.15% (0.2010 => 0.2214)
> MultiSource/Benchmarks/mafft/pairlocalalign: 7.94% (0.8501 => 0.9176)
> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.18% (0.5226 => 0.5758)
> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.98% (0.4207 => 0.4627)
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.35% (4.6331 => 5.3908)
> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.21% (1.5009 => 1.6392)
> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.51% (1.1021 => 1.1628)
> LLC-BETA:
> MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.38% (0.9100 => 0.7700)
> SingleSource/Benchmarks/BenchmarkGame/partialsums: -6.35% (0.6300 => 0.5900)
> SingleSource/Benchmarks/Dhrystone/dry: -12.78% (1.3300 => 1.1600)
> SingleSource/Benchmarks/Misc/flops: -8.42% (12.2300 => 11.2000)
> SingleSource/Benchmarks/Misc/flops-5: -47.76% (4.0200 => 2.1000)
> SingleSource/Benchmarks/Misc/flops-6: -56.25% (4.6400 => 2.0300)
> SingleSource/Benchmarks/Shootout-C++/sieve: -7.02% (2.2800 => 2.1200)
> LLC compile:
> MultiSource/Applications/ClamAV/clamscan: 8.49% (7.9460 => 8.6209)
> MultiSource/Applications/JM/ldecod/ldecod: 10.34% (3.0582 => 3.3745)
> MultiSource/Applications/JM/lencod/lencod: 10.12% (6.8455 => 7.5385)
> MultiSource/Applications/SIBsim4/SIBsim4: 10.01% (0.5376 => 0.5914)
> MultiSource/Applications/SPASS/SPASS: 9.47% (6.2637 => 6.8570)
> MultiSource/Applications/d/make_dparser: 10.29% (1.1249 => 1.2406)
> MultiSource/Applications/hbd/hbd: 11.01% (0.4415 => 0.4901)
> MultiSource/Applications/hexxagon/hexxagon: 10.49% (0.2451 => 0.2708)
> MultiSource/Applications/kimwitu++/kc: 16.47% (7.5404 => 8.7826)
> MultiSource/Applications/lambda-0_1_3/lambda: 10.64% (0.3852 => 0.4262)
> MultiSource/Applications/lemon/lemon: 7.88% (0.6117 => 0.6599)
> MultiSource/Applications/lua/lua: 10.92% (2.6851 => 2.9784)
> MultiSource/Applications/minisat/minisat: 10.20% (0.2334 => 0.2572)
> MultiSource/Applications/oggenc/oggenc: 10.13% (1.3552 => 1.4925)
> MultiSource/Applications/siod/siod: 9.71% (2.1586 => 2.3682)
> MultiSource/Applications/spiff/spiff: 9.28% (0.3425 => 0.3743)
> MultiSource/Applications/sqlite3/sqlite3: 9.31% (5.9562 => 6.5106)
> MultiSource/Applications/treecc/treecc: 9.90% (1.4364 => 1.5786)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.64% (2.8087 => 3.0795)
> MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.00% (0.3251 => 0.3706)
> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.40% (0.3010 => 0.3293)
> MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.47% (2.1892 => 2.3965)
> MultiSource/Benchmarks/MallocBench/gs/gs: 10.01% (1.6644 => 1.8310)
> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.45% (0.2942 => 0.3220)
> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.51% (0.9122 => 1.0081)
> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.35% (1.2688 => 1.4128)
> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.77% (6.6902 => 7.4774)
> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.06% (0.7777 => 0.8637)
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.75% (0.2660 => 0.2946)
> MultiSource/Benchmarks/PAQ8p/paq8p: 13.26% (0.9600 => 1.0873)
> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.38% (3.1079 => 3.3993)
> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.45% (0.5133 => 0.5618)
> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.25% (0.3385 => 0.3698)
> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.28% (0.8852 => 0.9496)
> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.69% (0.3167 => 0.3474)
> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.2522 => 0.2749)
> MultiSource/Benchmarks/Prolangs-C/football/football: 8.74% (0.5375 => 0.5845)
> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.59% (0.2063 => 0.2302)
> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.61% (0.3982 => 0.4325)
> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.49% (0.2709 => 0.2939)
> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.02% (0.4733 => 0.5160)
> MultiSource/Benchmarks/Ptrdist/bc/bc: 9.09% (0.6787 => 0.7404)
> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.64% (0.2975 => 0.3232)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.60% (0.2056 => 0.2274)
> MultiSource/Benchmarks/mafft/pairlocalalign: 8.75% (1.8290 => 1.9891)
> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.96% (0.2656 => 0.2947)
> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.62% (0.7963 => 0.8809)
> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.05% (0.5514 => 0.6068)
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.64% (5.0090 => 5.7923)
> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.54% (1.5160 => 1.6454)
> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.13% (1.0892 => 1.1560)
> JIT:
> MultiSource/Applications/ClamAV/clamscan: 6.80% (4.8500 => 5.1800)
> MultiSource/Applications/JM/ldecod/ldecod: 9.32% (2.7900 => 3.0500)
> MultiSource/Applications/d/make_dparser: 8.04% (1.1200 => 1.2100)
> MultiSource/Applications/hbd/hbd: 9.76% (0.4100 => 0.4500)
> MultiSource/Applications/kimwitu++/kc: 16.31% (5.6400 => 6.5600)
> MultiSource/Applications/lemon/lemon: 7.66% (164.6800 => 177.2900)
> MultiSource/Applications/oggenc/oggenc: 7.86% (1.4000 => 1.5100)
> MultiSource/Applications/sqlite3/sqlite3: 6.03% (10.1200 => 10.7300)
> MultiSource/Applications/treecc/treecc: 9.76% (0.4100 => 0.4500)
> MultiSource/Applications/viterbi/viterbi: 10.63% (11.8500 => 13.1100)
> MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.42% (0.4800 => 0.5300)
> MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.19% (2.3100 => 2.4300)
> MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2500 => 0.2700)
> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.82% (0.3400 => 0.3700)
> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.62% (0.5200 => 0.5700)
> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.86% (1.4000 => 1.5100)
> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.15% (6.1000 => 6.7800)
> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.2400 => 0.2700)
> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.93% (0.5600 => 0.6100)
> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.52% (0.2100 => 0.2300)
> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.90% (0.2900 => 0.3100)
> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.53% (0.9300 => 1.0000)
> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3400 => 0.3700)
> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.2900 => 0.3100)
> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.38% (0.3200 => 0.3500)
> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.52% (2.3000 => 2.4500)
> MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.07% (0.8300 => 0.9800)
> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.70% (0.2300 => 0.2500)
> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.47% (0.5900 => 0.6400)
> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.33% (0.4800 => 0.5200)
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.15% (5.7800 => 6.5400)
> SingleSource/Benchmarks/BenchmarkGame/partialsums: -6.15% (0.6500 => 0.6100)
> SingleSource/Benchmarks/CoyoteBench/huffbench: -6.06% (21.8000 => 20.4800)
> SingleSource/Benchmarks/Misc/flops: -8.40% (12.2600 => 11.2300)
> SingleSource/Benchmarks/Misc/flops-5: -47.64% (4.0300 => 2.1100)
> SingleSource/Benchmarks/Misc/flops-6: -56.03% (4.6400 => 2.0400)
> SingleSource/Benchmarks/Shootout-C++/sieve: -5.88% (2.5500 => 2.4000)
> LLC:
> MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.38% (0.7800 => 0.9000)
> SingleSource/Benchmarks/BenchmarkGame/partialsums: -6.35% (0.6300 => 0.5900)
> SingleSource/Benchmarks/Misc/flops: -8.59% (12.2300 => 11.1800)
> SingleSource/Benchmarks/Misc/flops-5: -47.76% (4.0200 => 2.1000)
> SingleSource/Benchmarks/Misc/flops-6: -56.03% (4.6400 => 2.0400)
> SingleSource/Benchmarks/Shootout-C++/sieve: -6.58% (2.2800 => 2.1300)
> LLC-BETA compile:
> MultiSource/Applications/ClamAV/clamscan: 8.48% (7.9729 => 8.6488)
> MultiSource/Applications/JM/ldecod/ldecod: 10.25% (3.0782 => 3.3938)
> MultiSource/Applications/JM/lencod/lencod: 9.89% (6.9243 => 7.6093)
> MultiSource/Applications/SIBsim4/SIBsim4: 10.32% (0.5379 => 0.5934)
> MultiSource/Applications/SPASS/SPASS: 9.50% (6.3112 => 6.9110)
> MultiSource/Applications/d/make_dparser: 9.52% (1.1387 => 1.2471)
> MultiSource/Applications/hbd/hbd: 11.25% (0.4444 => 0.4944)
> MultiSource/Applications/hexxagon/hexxagon: 10.29% (0.2459 => 0.2712)
> MultiSource/Applications/kimwitu++/kc: 16.05% (7.6334 => 8.8586)
> MultiSource/Applications/lambda-0_1_3/lambda: 10.47% (0.3879 => 0.4285)
> MultiSource/Applications/lemon/lemon: 8.16% (0.6150 => 0.6652)
> MultiSource/Applications/lua/lua: 10.72% (2.7177 => 3.0090)
> MultiSource/Applications/minisat/minisat: 10.55% (0.2350 => 0.2598)
> MultiSource/Applications/oggenc/oggenc: 9.62% (1.3706 => 1.5024)
> MultiSource/Applications/siod/siod: 9.77% (2.1690 => 2.3810)
> MultiSource/Applications/spiff/spiff: 9.21% (0.3431 => 0.3747)
> MultiSource/Applications/sqlite3/sqlite3: 9.61% (5.9871 => 6.5625)
> MultiSource/Applications/treecc/treecc: 9.85% (1.4434 => 1.5856)
> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.88% (2.8221 => 3.1010)
> MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.90% (0.3267 => 0.3721)
> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (0.3029 => 0.3301)
> MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.22% (2.2022 => 2.4052)
> MultiSource/Benchmarks/MallocBench/gs/gs: 10.38% (1.6807 => 1.8551)
> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.43% (0.2924 => 0.3229)
> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.19% (0.9209 => 1.0147)
> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.52% (1.2773 => 1.4244)
> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.40% (6.7906 => 7.5644)
> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.94% (0.7807 => 0.8661)
> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.08% (0.2672 => 0.2968)
> MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (0.9669 => 1.0960)
> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.69% (3.1230 => 3.4255)
> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.40% (0.5159 => 0.5644)
> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.27% (0.3397 => 0.3712)
> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.85% (0.8897 => 0.9506)
> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.13% (0.3175 => 0.3465)
> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.84% (0.2545 => 0.2770)
> MultiSource/Benchmarks/Prolangs-C/football/football: 8.14% (0.5393 => 0.5832)
> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.32% (0.2102 => 0.2340)
> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.78% (0.3836 => 0.4211)
> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.83% (0.2719 => 0.2959)
> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.10% (0.4749 => 0.5181)
> MultiSource/Benchmarks/Ptrdist/bc/bc: 9.17% (0.6849 => 0.7477)
> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.49% (0.2990 => 0.3244)
> MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.40% (0.2071 => 0.2307)
> MultiSource/Benchmarks/mafft/pairlocalalign: 8.95% (1.8410 => 2.0058)
> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.85% (0.2673 => 0.2963)
> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.65% (0.8090 => 0.8871)
> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.14% (0.5543 => 0.6105)
> MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.00% (5.0953 => 5.8594)
> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.92% (1.5211 => 1.6568)
> SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.93% (1.0958 => 1.1608)
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>
More information about the llvm-testresults
mailing list