[llvm-testresults] smoosh-01.apple.com nightly tester results
Daniel Dunbar
daniel at zuster.org
Sun Jul 12 22:09:12 PDT 2009
Well, the reboot didn't change anything. I suppose I should do a run
of an old revision just to make absolutely sure its nothing in LLVM
that is causing this, but it looks like a machine issue. I have no
idea how to go about debugging this...
- Daniel
On Sun, Jul 12, 2009 at 3:44 PM, Daniel Dunbar<daniel at zuster.org> wrote:
> On Sun, Jul 12, 2009 at 3:23 PM, Bill Wendling<wendling at apple.com> wrote:
>> I didn't touch the machine... :-) Cross fingers that a reboot helps?
>
> I'm not sure which is better... if a reboot doesn't help then it seems
> like a machine hardware failure (or I'm missing something obvious) --
> bad, but stable. If it does help, then we have some unexplained
> variation in the machine.
>
> It would be nice if nightytest had a "normalization" time, which ran
> some stable benchmark and reported the time, to catch variations in
> the machine performance. I'm not sure what that benchmark would look
> like -- timing the build of something stable using the system compiler
> would work, although we tend to change the system compiler a lot so it
> isn't ideal. In practice the GCCAS numbers very rarely change, so
> significant changes in them seem to indicate something on the machine
> vs something in LLVM, but one single number would make it easier to
> filter/flag untrustworthy results.
>
> - Daniel
>
>> -bw
>>
>> On Jul 12, 2009, at 3:14 PM, Daniel Dunbar wrote:
>>
>>> Something incredibly bad started happening here. I don't recall seeing
>>> badness on other machines, so it appears to be local to the machine.
>>>
>>> I don't see anything obviously suspicious in 'top', but the results
>>> here are pretty dramatic, and they have stayed bad ever since this. In
>>> fact, the changes are enough that what used to be a 90 minute run is
>>> now a 120 minute run. Here is a graph of some gccas times:
>>>
>>> http://smooshlab.apple.com/perf.cgi/nightlytest/511/graphSingle?run=511&kind=4&cb.5376=on&cb.5286=on&cb.6382=on&cb.4681=on
>>>
>>> The change happened between these two runs:
>>> http://smooshlab.apple.com:8010/builders/nnt/builds/46
>>> http://smooshlab.apple.com:8010/builders/nnt/builds/47
>>> and the only commits were on clang. I checked for any test-suite
>>> commits (which aren't tracked by buildbot) and didn't notice anything.
>>>
>>> Bill, I don't supposed you changed anything on this machine last Sunday?
>>>
>>> I'm going to try a reboot and see if that restores the balance of power.
>>>
>>> - Daniel
>>>
>>> p.s. Sorry for the internal links. I hope to get some work done on
>>> bringing the new nightlytest stuff into the public tree this week.
>>>
>>> On Sun, Jul 5, 2009 at 5:24 PM, <daniel_dunbar at apple.com> wrote:
>>>>
>>>> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//511
>>>> Name: smoosh-01
>>>> Nickname: smoosh-01.apple.com:1
>>>> Buildstatus: OK
>>>>
>>>> Run: 511, Start Time: 2009-07-05 15:36:17
>>>> Comparing To: 508, Start Time: 2009-07-05 13:31:46
>>>>
>>>> --- Changes Summary ---
>>>> New Test Passes: 0
>>>> New Test Failures: 2
>>>> Added Tests: 0
>>>> Removed Tests: 0
>>>> Significant Changes: 325
>>>>
>>>> --- Tests Summary ---
>>>> Total Tests: 3429
>>>> Total Test Failures: 490
>>>>
>>>> Total Test Failures By Type:
>>>> Bitcode: 50
>>>> CBE: 70
>>>> GCCAS: 50
>>>> JIT: 60
>>>> JIT codegen: 60
>>>> LLC: 50
>>>> LLC compile: 50
>>>> LLC-BETA: 50
>>>> LLC_BETA compile: 50
>>>>
>>>> --- Changes Detail ---
>>>> New Test Passes:
>>>>
>>>> New Test Failures:
>>>> MultiSource/Applications/lemon/lemon [JIT, JIT codegen]
>>>>
>>>> Added Tests:
>>>>
>>>> Removed Tests:
>>>>
>>>> Significant Changes in Test Results:
>>>> JIT codegen:
>>>> MultiSource/Applications/ClamAV/clamscan: 49.23% (10.3864 => 15.5000)
>>>> MultiSource/Applications/JM/ldecod/ldecod: 58.17% (7.1708 => 11.3419)
>>>> MultiSource/Applications/JM/lencod/lencod: 54.55% (15.6812 => 24.2353)
>>>> MultiSource/Applications/SIBsim4/SIBsim4: 58.97% (1.4115 => 2.2439)
>>>> MultiSource/Applications/SPASS/SPASS: 53.76% (11.2251 => 17.2602)
>>>> MultiSource/Applications/d/make_dparser: 49.69% (3.5134 => 5.2591)
>>>> MultiSource/Applications/hbd/hbd: 50.58% (0.9954 => 1.4989)
>>>> MultiSource/Applications/lambda-0_1_3/lambda: 43.35% (0.8750 => 1.2543)
>>>> MultiSource/Applications/lua/lua: 43.33% (5.4783 => 7.8518)
>>>> MultiSource/Applications/oggenc/oggenc: 55.12% (3.0524 => 4.7348)
>>>> MultiSource/Applications/sgefa/sgefa: 52.13% (0.2580 => 0.3925)
>>>> MultiSource/Applications/siod/siod: 40.81% (2.0376 => 2.8691)
>>>> MultiSource/Applications/spiff/spiff: 48.29% (0.6879 => 1.0201)
>>>> MultiSource/Applications/sqlite3/sqlite3: 46.23% (13.4152 => 19.6175)
>>>> MultiSource/Applications/treecc/treecc: 47.77% (1.1037 => 1.6309)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 68.57% (6.1341 =>
>>>> 10.3402)
>>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 49.86% (0.2160 =>
>>>> 0.3237)
>>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 56.14% (0.3231
>>>> => 0.5045)
>>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 62.77% (0.9809 => 1.5966)
>>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 47.48% (0.9381 =>
>>>> 1.3835)
>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 50.13% (4.2586 =>
>>>> 6.3936)
>>>> MultiSource/Benchmarks/MallocBench/gs/gs: 41.91% (2.7813 => 3.9470)
>>>> MultiSource/Benchmarks/McCat/09-vor/vor: 41.44% (0.3697 => 0.5229)
>>>> MultiSource/Benchmarks/McCat/18-imp/imp: 50.43% (0.3230 => 0.4859)
>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 60.46%
>>>> (0.8055 => 1.2925)
>>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 48.35%
>>>> (1.4086 => 2.0896)
>>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.76%
>>>> (2.7921 => 4.4049)
>>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 44.27%
>>>> (15.6790 => 22.6196)
>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 50.30%
>>>> (0.4865 => 0.7312)
>>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>>> 50.60% (0.2154 => 0.3244)
>>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 44.72% (0.5932
>>>> => 0.8585)
>>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 42.91% (0.2265 =>
>>>> 0.3237)
>>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 41.75% (0.3559 =>
>>>> 0.5045)
>>>> MultiSource/Benchmarks/PAQ8p/paq8p: 46.72% (2.2943 => 3.3663)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 55.64%
>>>> (1.1579 => 1.8021)
>>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 48.65% (0.4993 => 0.7422)
>>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 52.97% (0.7155 =>
>>>> 1.0945)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 52.75% (1.9100 =>
>>>> 2.9176)
>>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 54.22% (0.6937 => 1.0698)
>>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 40.87% (0.6303 => 0.8879)
>>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 53.26% (0.2867 =>
>>>> 0.4394)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 55.56% (0.4714
>>>> => 0.7333)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 53.49% (0.5111 =>
>>>> 0.7845)
>>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 47.69% (1.8665 => 2.7566)
>>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 59.08% (0.8082 => 1.2857)
>>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 56.15% (0.2456 => 0.3835)
>>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 34.59% (0.3487 =>
>>>> 0.4693)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 50.06% (0.5587 => 0.8384)
>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 57.25% (2.1478 => 3.3774)
>>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.75% (0.5698 =>
>>>> 0.8248)
>>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 46.13% (1.4823 =>
>>>> 2.1661)
>>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.66%
>>>> (1.1257 => 1.7860)
>>>> MultiSource/Benchmarks/sim/sim: 64.09% (0.4729 => 0.7760)
>>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 52.79% (4.4064 => 6.7327)
>>>> SingleSource/UnitTests/SignlessTypes/rem: 63.80% (0.2174 => 0.3561)
>>>> CBE:
>>>> MultiSource/Applications/sgefa/sgefa: -8.75% (0.8000 => 0.7300)
>>>> MultiSource/Benchmarks/Olden/health/health: -5.56% (0.3600 => 0.3400)
>>>> LLC-BETA:
>>>> MultiSource/Benchmarks/Olden/health/health: 5.88% (0.3400 => 0.3600)
>>>> LLC compile:
>>>> MultiSource/Applications/ClamAV/clamscan: 48.87% (20.2787 => 30.1888)
>>>> MultiSource/Applications/JM/ldecod/ldecod: 56.09% (9.1867 => 14.3393)
>>>> MultiSource/Applications/JM/lencod/lencod: 51.99% (20.1605 => 30.6413)
>>>> MultiSource/Applications/SIBsim4/SIBsim4: 56.48% (1.4731 => 2.3051)
>>>> MultiSource/Applications/SPASS/SPASS: 51.78% (17.2164 => 26.1306)
>>>> MultiSource/Applications/d/make_dparser: 47.87% (4.1601 => 6.1515)
>>>> MultiSource/Applications/hbd/hbd: 49.02% (1.2424 => 1.8514)
>>>> MultiSource/Applications/lambda-0_1_3/lambda: 42.51% (1.1342 => 1.6163)
>>>> MultiSource/Applications/lemon/lemon: 46.71% (1.6987 => 2.4921)
>>>> MultiSource/Applications/lua/lua: 42.05% (8.4445 => 11.9951)
>>>> MultiSource/Applications/oggenc/oggenc: 53.07% (3.8891 => 5.9531)
>>>> MultiSource/Applications/sgefa/sgefa: 50.94% (0.2658 => 0.4012)
>>>> MultiSource/Applications/siod/siod: 39.67% (5.8487 => 8.1689)
>>>> MultiSource/Applications/spiff/spiff: 46.33% (0.8923 => 1.3057)
>>>> MultiSource/Applications/sqlite3/sqlite3: 44.73% (19.0892 => 27.6273)
>>>> MultiSource/Applications/treecc/treecc: 46.95% (4.9042 => 7.2066)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 67.88% (8.2110 =>
>>>> 13.7848)
>>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 47.95% (0.2246 =>
>>>> 0.3323)
>>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 55.66% (0.3782
>>>> => 0.5887)
>>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 60.62% (1.0181 => 1.6353)
>>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 47.28% (0.9971 =>
>>>> 1.4685)
>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 48.58% (6.6418 =>
>>>> 9.8686)
>>>> MultiSource/Benchmarks/MallocBench/gs/gs: 42.39% (5.8443 => 8.3215)
>>>> MultiSource/Benchmarks/McCat/09-vor/vor: 41.67% (0.3811 => 0.5399)
>>>> MultiSource/Benchmarks/McCat/18-imp/imp: 49.28% (0.3344 => 0.4992)
>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 56.87%
>>>> (0.8706 => 1.3657)
>>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 48.73%
>>>> (2.7850 => 4.1421)
>>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.20%
>>>> (3.6016 => 5.6256)
>>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 43.55%
>>>> (19.5151 => 28.0137)
>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 46.72%
>>>> (2.1228 => 3.1146)
>>>> MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish:
>>>> 50.74% (0.2761 => 0.4162)
>>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>>> 50.53% (0.3214 => 0.4838)
>>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 43.58% (0.8277
>>>> => 1.1884)
>>>> MultiSource/Benchmarks/Olden/bh/bh: 52.90% (0.2049 => 0.3133)
>>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.80% (0.2493 =>
>>>> 0.3535)
>>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 41.94% (0.3698 =>
>>>> 0.5249)
>>>> MultiSource/Benchmarks/PAQ8p/paq8p: 44.68% (3.2163 => 4.6535)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.40%
>>>> (8.1524 => 12.5057)
>>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 48.53% (1.5058 => 2.2366)
>>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 49.79% (0.9806 =>
>>>> 1.4688)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 51.90% (2.0017 =>
>>>> 3.0405)
>>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 53.58% (0.7217 => 1.1084)
>>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 39.69% (0.7523 =>
>>>> 1.0509)
>>>> MultiSource/Benchmarks/Prolangs-C/football/football: 48.78% (1.4503 =>
>>>> 2.1578)
>>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 39.84% (0.6523 => 0.9122)
>>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 50.27% (0.4036 =>
>>>> 0.6065)
>>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 43.58% (0.9954 =>
>>>> 1.4292)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 50.98% (0.7018
>>>> => 1.0596)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 47.58% (1.3481 =>
>>>> 1.9895)
>>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 47.26% (2.0268 => 2.9846)
>>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 57.79% (0.8372 => 1.3210)
>>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 53.68% (0.2543 => 0.3908)
>>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 32.22% (0.3551 =>
>>>> 0.4695)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 49.18% (0.5923 => 0.8836)
>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 57.85% (4.9583 => 7.8265)
>>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.78% (0.8309 =>
>>>> 1.1864)
>>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 46.51% (2.3646 =>
>>>> 3.4643)
>>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 55.33%
>>>> (1.5479 => 2.4044)
>>>> MultiSource/Benchmarks/sim/sim: 62.76% (0.4920 => 0.8008)
>>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 50.54% (4.5832 => 6.8995)
>>>> SingleSource/UnitTests/SignlessTypes/rem: 62.47% (0.2241 => 0.3641)
>>>> GCCAS:
>>>> MultiSource/Applications/ClamAV/clamscan: 188.47% (14.8513 => 42.8415)
>>>> MultiSource/Applications/JM/ldecod/ldecod: 194.31% (8.1741 => 24.0576)
>>>> MultiSource/Applications/JM/lencod/lencod: 196.85% (17.5271 => 52.0288)
>>>> MultiSource/Applications/SIBsim4/SIBsim4: 180.29% (1.4560 => 4.0810)
>>>> MultiSource/Applications/SPASS/SPASS: 186.34% (19.8547 => 56.8524)
>>>> MultiSource/Applications/d/make_dparser: 184.13% (4.3132 => 12.2551)
>>>> MultiSource/Applications/hbd/hbd: 197.33% (0.8960 => 2.6641)
>>>> MultiSource/Applications/lambda-0_1_3/lambda: 180.91% (0.7112 => 1.9978)
>>>> MultiSource/Applications/lemon/lemon: 178.78% (1.1427 => 3.1856)
>>>> MultiSource/Applications/lua/lua: 178.58% (5.5054 => 15.3371)
>>>> MultiSource/Applications/oggenc/oggenc: 180.80% (4.6297 => 13.0004)
>>>> MultiSource/Applications/sgefa/sgefa: 174.30% (0.2560 => 0.7022)
>>>> MultiSource/Applications/siod/siod: 193.76% (2.3005 => 6.7579)
>>>> MultiSource/Applications/spiff/spiff: 178.20% (0.5872 => 1.6336)
>>>> MultiSource/Applications/sqlite3/sqlite3: 185.18% (13.0557 => 37.2324)
>>>> MultiSource/Applications/treecc/treecc: 180.67% (2.4635 => 6.9144)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 236.71% (8.5006 =>
>>>> 28.6224)
>>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 171.95% (0.3262 =>
>>>> 0.8871)
>>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 171.54% (0.2403
>>>> => 0.6525)
>>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 175.22% (0.9729 => 2.6776)
>>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 171.20% (0.7718 =>
>>>> 2.0931)
>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 175.74% (4.7685 =>
>>>> 13.1485)
>>>> MultiSource/Benchmarks/MallocBench/gs/gs: 176.85% (3.9399 => 10.9076)
>>>> MultiSource/Benchmarks/McCat/05-eks/eks: 168.70% (0.2824 => 0.7588)
>>>> MultiSource/Benchmarks/McCat/08-main/main: 218.23% (0.2167 => 0.6896)
>>>> MultiSource/Benchmarks/McCat/09-vor/vor: 194.59% (0.2922 => 0.8608)
>>>> MultiSource/Benchmarks/McCat/18-imp/imp: 181.17% (0.2640 => 0.7423)
>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>>> 210.43% (0.8821 => 2.7383)
>>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 187.86%
>>>> (3.8478 => 11.0764)
>>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 192.73%
>>>> (4.0301 => 11.7975)
>>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset:
>>>> 188.84% (19.3500 => 55.8903)
>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 190.05%
>>>> (1.6203 => 4.6997)
>>>> MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish:
>>>> 210.03% (0.3361 => 1.0420)
>>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>>> 375.88% (0.3408 => 1.6218)
>>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 164.33%
>>>> (1.2476 => 3.2978)
>>>> MultiSource/Benchmarks/Olden/bh/bh: 191.88% (0.2462 => 0.7186)
>>>> MultiSource/Benchmarks/Olden/voronoi/voronoi: 171.92% (0.2646 => 0.7195)
>>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 158.89% (0.2459 =>
>>>> 0.6366)
>>>> MultiSource/Benchmarks/PAQ8p/paq8p: 191.83% (2.8291 => 8.2561)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 195.49%
>>>> (5.5887 => 16.5140)
>>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 181.33% (1.1113 =>
>>>> 3.1264)
>>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 182.33% (0.5122
>>>> => 1.4461)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 177.42% (1.0712 =>
>>>> 2.9717)
>>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 219.20% (0.3078 =>
>>>> 0.9825)
>>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 207.46% (0.3323 =>
>>>> 1.0217)
>>>> MultiSource/Benchmarks/Prolangs-C/football/football: 202.53% (0.9670 =>
>>>> 2.9255)
>>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 194.86% (0.3679 =>
>>>> 1.0848)
>>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 167.10% (0.2483 =>
>>>> 0.6632)
>>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 180.37% (0.7132
>>>> => 1.9996)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 180.96% (0.3933
>>>> => 1.1050)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 185.79% (0.8714 =>
>>>> 2.4904)
>>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 187.54% (1.2887 => 3.7055)
>>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 173.22% (0.6419 => 1.7538)
>>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 166.45% (0.2316 => 0.6171)
>>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 485.33% (0.4103 =>
>>>> 2.4016)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 218.38% (0.3286 => 1.0462)
>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 199.99% (9.9048 => 29.7131)
>>>> MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 160.03%
>>>> (0.2314 => 0.6017)
>>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 164.01% (1.2480 =>
>>>> 3.2949)
>>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 187.81% (3.8963 =>
>>>> 11.2141)
>>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 186.27%
>>>> (1.4295 => 4.0922)
>>>> MultiSource/Benchmarks/sim/sim: 193.73% (0.2853 => 0.8380)
>>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 163.50% (3.0193 =>
>>>> 7.9558)
>>>> SingleSource/Benchmarks/Misc/ReedSolomon: 189.16% (0.2030 => 0.5870)
>>>> SingleSource/Benchmarks/Misc/oourafft: 170.93% (0.2394 => 0.6486)
>>>> JIT:
>>>> MultiSource/Applications/ClamAV/clamscan: 54.40% (10.9000 => 16.8300)
>>>> MultiSource/Applications/JM/ldecod/ldecod: 63.49% (7.4500 => 12.1800)
>>>> MultiSource/Applications/JM/lencod/lencod: 38.16% (26.1800 => 36.1700)
>>>> MultiSource/Applications/SIBsim4/SIBsim4: 12.65% (7.2700 => 8.1900)
>>>> MultiSource/Applications/SPASS/SPASS: 35.54% (22.3400 => 30.2800)
>>>> MultiSource/Applications/d/make_dparser: 58.54% (3.6900 => 5.8500)
>>>> MultiSource/Applications/hbd/hbd: 55.77% (1.0400 => 1.6200)
>>>> MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (7.2800 => 7.7200)
>>>> MultiSource/Applications/lua/lua: 12.66% (20.9300 => 23.5800)
>>>> MultiSource/Applications/oggenc/oggenc: 63.72% (3.3900 => 5.5500)
>>>> MultiSource/Applications/sgefa/sgefa: 14.78% (1.1500 => 1.3200)
>>>> MultiSource/Applications/siod/siod: 17.88% (5.4800 => 6.4600)
>>>> MultiSource/Applications/spiff/spiff: 8.31% (4.4500 => 4.8200)
>>>> MultiSource/Applications/sqlite3/sqlite3: 34.88% (19.2100 => 25.9100)
>>>> MultiSource/Applications/treecc/treecc: 55.65% (1.1500 => 1.7900)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 47.48% (9.7300 =>
>>>> 14.3500)
>>>> MultiSource/Benchmarks/BitBench/drop3/drop3: 7.84% (0.5100 => 0.5500)
>>>> MultiSource/Benchmarks/Fhourstones/fhourstones: 5.97% (1.3400 => 1.4200)
>>>> MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 42.86% (0.2100 =>
>>>> 0.3000)
>>>> MultiSource/Benchmarks/FreeBench/distray/distray: 16.67% (0.3600 =>
>>>> 0.4200)
>>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.67% (1.2000
>>>> => 1.4000)
>>>> MultiSource/Benchmarks/FreeBench/mason/mason: 12.50% (0.3200 => 0.3600)
>>>> MultiSource/Benchmarks/FreeBench/neural/neural: 20.00% (0.4000 =>
>>>> 0.4800)
>>>> MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.41% (0.3400
>>>> => 0.4400)
>>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 58.62% (1.1600 => 1.8400)
>>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.41% (3.4400 =>
>>>> 3.9700)
>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 47.78% (5.1700 =>
>>>> 7.6400)
>>>> MultiSource/Benchmarks/MallocBench/gs/gs: 48.14% (2.9500 => 4.3700)
>>>> MultiSource/Benchmarks/McCat/09-vor/vor: 32.08% (0.5300 => 0.7000)
>>>> MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.54% (0.2600 => 0.2900)
>>>> MultiSource/Benchmarks/McCat/18-imp/imp: 43.18% (0.4400 => 0.6300)
>>>>
>>>> MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath:
>>>> 10.42% (0.4800 => 0.5300)
>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 58.06%
>>>> (0.9300 => 1.4700)
>>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 55.10%
>>>> (1.4700 => 2.2800)
>>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.06%
>>>> (3.2000 => 5.0900)
>>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 49.35%
>>>> (16.1900 => 24.1800)
>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 58.82%
>>>> (0.5100 => 0.8100)
>>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>>> 46.67% (0.3000 => 0.4400)
>>>> MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.70%
>>>> (0.2300 => 0.2500)
>>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 39.02% (0.8200
>>>> => 1.1400)
>>>> MultiSource/Benchmarks/Olden/bh/bh: 7.39% (1.7600 => 1.8900)
>>>> MultiSource/Benchmarks/Olden/health/health: 12.77% (0.4700 => 0.5300)
>>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.53% (0.5100 =>
>>>> 0.6300)
>>>> MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.13% (0.3900 => 0.4100)
>>>> MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.87% (0.5300 => 0.6300)
>>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 51.16% (0.4300 =>
>>>> 0.6500)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 65.83%
>>>> (1.2000 => 1.9900)
>>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 56.60% (0.5300 => 0.8300)
>>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 59.46% (0.7400 =>
>>>> 1.1800)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 61.00% (2.0000 =>
>>>> 3.2200)
>>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 62.50% (0.7200 => 1.1700)
>>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 42.25% (0.7100 => 1.0100)
>>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 54.84% (0.3100 =>
>>>> 0.4800)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 61.22% (0.4900
>>>> => 0.7900)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 64.15% (0.5300 =>
>>>> 0.8700)
>>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 35.82% (2.8200 => 3.8300)
>>>> MultiSource/Benchmarks/Ptrdist/ft/ft: 6.93% (1.0100 => 1.0800)
>>>> MultiSource/Benchmarks/Ptrdist/ks/ks: 7.23% (1.6600 => 1.7800)
>>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 25.47% (2.1200 => 2.6600)
>>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.77% (2.6000 =>
>>>> 2.7500)
>>>> MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.10% (0.9800
>>>> => 1.0300)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.98% (2.0700 => 2.3800)
>>>> MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.43% (0.2300
>>>> => 0.3000)
>>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.61% (0.6200 =>
>>>> 0.9400)
>>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 52.90% (1.5500 =>
>>>> 2.3700)
>>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.71%
>>>> (1.1800 => 1.9200)
>>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 45.74% (6.1000 => 8.8900)
>>>> SingleSource/Benchmarks/BenchmarkGame/recursive: 6.76% (0.7400 =>
>>>> 0.7900)
>>>> SingleSource/Benchmarks/McGill/misr: 7.14% (0.2800 => 0.3000)
>>>> SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.69% (0.2900 => 0.3500)
>>>> SingleSource/Benchmarks/Misc/ffbench: 5.15% (0.9700 => 1.0200)
>>>> SingleSource/Benchmarks/Shootout/fib2: 5.71% (0.3500 => 0.3700)
>>>> SingleSource/Benchmarks/Shootout/strcat: 6.67% (0.3000 => 0.3200)
>>>> SingleSource/Benchmarks/Stanford/Perm: 10.53% (0.3800 => 0.4200)
>>>> SingleSource/Benchmarks/Stanford/Puzzle: 17.39% (0.2300 => 0.2700)
>>>> SingleSource/UnitTests/SignlessTypes/rem: 69.57% (0.2300 => 0.3900)
>>>> SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.68% (0.6200 =>
>>>> 0.6800)
>>>> SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.99% (0.7700 => 0.8700)
>>>> LLC-BETA compile:
>>>> MultiSource/Applications/ClamAV/clamscan: 61.16% (21.5990 => 34.8079)
>>>> MultiSource/Applications/JM/ldecod/ldecod: 65.39% (9.7881 => 16.1883)
>>>> MultiSource/Applications/JM/lencod/lencod: 61.26% (21.5384 => 34.7328)
>>>> MultiSource/Applications/SIBsim4/SIBsim4: 66.62% (1.5757 => 2.6255)
>>>> MultiSource/Applications/SPASS/SPASS: 63.85% (18.3954 => 30.1412)
>>>> MultiSource/Applications/d/make_dparser: 59.25% (4.4494 => 7.0855)
>>>> MultiSource/Applications/hbd/hbd: 60.91% (1.3319 => 2.1432)
>>>> MultiSource/Applications/lambda-0_1_3/lambda: 57.84% (1.2199 => 1.9255)
>>>> MultiSource/Applications/lemon/lemon: 57.82% (1.7950 => 2.8329)
>>>> MultiSource/Applications/lua/lua: 54.31% (9.0360 => 13.9438)
>>>> MultiSource/Applications/oggenc/oggenc: 63.57% (4.1537 => 6.7940)
>>>> MultiSource/Applications/sgefa/sgefa: 62.56% (0.2826 => 0.4594)
>>>> MultiSource/Applications/siod/siod: 54.47% (6.2808 => 9.7021)
>>>> MultiSource/Applications/spiff/spiff: 57.95% (0.9461 => 1.4944)
>>>> MultiSource/Applications/sqlite3/sqlite3: 56.73% (20.3019 => 31.8192)
>>>> MultiSource/Applications/treecc/treecc: 59.35% (5.2630 => 8.3866)
>>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 76.28% (8.7886 =>
>>>> 15.4922)
>>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 58.90% (0.2382 =>
>>>> 0.3785)
>>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 66.22% (0.4088
>>>> => 0.6795)
>>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 68.67% (1.1253 => 1.8980)
>>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 58.61% (1.0627 =>
>>>> 1.6856)
>>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 58.89% (7.0660 =>
>>>> 11.2275)
>>>> MultiSource/Benchmarks/MallocBench/gs/gs: 55.56% (6.2661 => 9.7474)
>>>> MultiSource/Benchmarks/McCat/09-vor/vor: 52.53% (0.4091 => 0.6240)
>>>> MultiSource/Benchmarks/McCat/18-imp/imp: 59.35% (0.3562 => 0.5676)
>>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 63.16%
>>>> (0.9223 => 1.5048)
>>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 60.21%
>>>> (2.9825 => 4.7782)
>>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 66.67%
>>>> (3.8648 => 6.4413)
>>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 55.85%
>>>> (20.8604 => 32.5111)
>>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 60.42%
>>>> (2.2721 => 3.6449)
>>>> MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish:
>>>> 62.06% (0.2984 => 0.4836)
>>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>>> 59.50% (0.3790 => 0.6045)
>>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 54.33% (0.8900
>>>> => 1.3735)
>>>> MultiSource/Benchmarks/Olden/bh/bh: 63.55% (0.2211 => 0.3616)
>>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 55.04% (0.2689 =>
>>>> 0.4169)
>>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 59.37% (0.4145 =>
>>>> 0.6606)
>>>> MultiSource/Benchmarks/PAQ8p/paq8p: 56.72% (3.5089 => 5.4992)
>>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 63.54%
>>>> (8.6981 => 14.2249)
>>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 60.37% (1.6010 => 2.5675)
>>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 60.38% (1.0461 =>
>>>> 1.6777)
>>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 61.51% (2.1205 =>
>>>> 3.4248)
>>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 63.56% (0.7704 => 1.2601)
>>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 52.46% (0.7982 =>
>>>> 1.2169)
>>>> MultiSource/Benchmarks/Prolangs-C/football/football: 60.23% (1.5364 =>
>>>> 2.4618)
>>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 52.43% (0.6964 => 1.0615)
>>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 60.36% (0.4342 =>
>>>> 0.6963)
>>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 56.15% (1.0640 =>
>>>> 1.6614)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 61.97% (0.7467
>>>> => 1.2094)
>>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 58.58% (1.4318 =>
>>>> 2.2705)
>>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 59.24% (2.1588 => 3.4376)
>>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 68.02% (0.8889 => 1.4935)
>>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 63.96% (0.2708 => 0.4440)
>>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 71.62% (0.4253 =>
>>>> 0.7299)
>>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 61.91% (0.6395 => 1.0354)
>>>> MultiSource/Benchmarks/mafft/pairlocalalign: 67.43% (5.2454 => 8.7825)
>>>> MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 53.50% (0.2069
>>>> => 0.3176)
>>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 54.39% (0.8897 =>
>>>> 1.3736)
>>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 57.22% (2.5361 =>
>>>> 3.9873)
>>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 64.98%
>>>> (1.6596 => 2.7380)
>>>> MultiSource/Benchmarks/sim/sim: 74.13% (0.5272 => 0.9180)
>>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 59.19% (4.8490 => 7.7190)
>>>> SingleSource/Benchmarks/Misc/oourafft: 70.18% (0.2086 => 0.3550)
>>>> SingleSource/UnitTests/SignlessTypes/rem: 73.73% (0.2440 => 0.4239)
>>>> _______________________________________________
>>>> llvm-testresults mailing list
>>>> llvm-testresults at cs.uiuc.edu
>>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>>>
>>
>>
>
More information about the llvm-testresults
mailing list