[llvm-testresults] smoosh-01.apple.com nightly tester results
Daniel Dunbar
daniel at zuster.org
Sun Jul 12 15:44:05 PDT 2009
On Sun, Jul 12, 2009 at 3:23 PM, Bill Wendling<wendling at apple.com> wrote:
> I didn't touch the machine... :-) Cross fingers that a reboot helps?
I'm not sure which is better... if a reboot doesn't help then it seems
like a machine hardware failure (or I'm missing something obvious) --
bad, but stable. If it does help, then we have some unexplained
variation in the machine.
It would be nice if nightytest had a "normalization" time, which ran
some stable benchmark and reported the time, to catch variations in
the machine performance. I'm not sure what that benchmark would look
like -- timing the build of something stable using the system compiler
would work, although we tend to change the system compiler a lot so it
isn't ideal. In practice the GCCAS numbers very rarely change, so
significant changes in them seem to indicate something on the machine
vs something in LLVM, but one single number would make it easier to
filter/flag untrustworthy results.
- Daniel
> -bw
>
> On Jul 12, 2009, at 3:14 PM, Daniel Dunbar wrote:
>
>> Something incredibly bad started happening here. I don't recall seeing
>> badness on other machines, so it appears to be local to the machine.
>>
>> I don't see anything obviously suspicious in 'top', but the results
>> here are pretty dramatic, and they have stayed bad ever since this. In
>> fact, the changes are enough that what used to be a 90 minute run is
>> now a 120 minute run. Here is a graph of some gccas times:
>>
>> http://smooshlab.apple.com/perf.cgi/nightlytest/511/graphSingle?run=511&kind=4&cb.5376=on&cb.5286=on&cb.6382=on&cb.4681=on
>>
>> The change happened between these two runs:
>> http://smooshlab.apple.com:8010/builders/nnt/builds/46
>> http://smooshlab.apple.com:8010/builders/nnt/builds/47
>> and the only commits were on clang. I checked for any test-suite
>> commits (which aren't tracked by buildbot) and didn't notice anything.
>>
>> Bill, I don't supposed you changed anything on this machine last Sunday?
>>
>> I'm going to try a reboot and see if that restores the balance of power.
>>
>> - Daniel
>>
>> p.s. Sorry for the internal links. I hope to get some work done on
>> bringing the new nightlytest stuff into the public tree this week.
>>
>> On Sun, Jul 5, 2009 at 5:24 PM, <daniel_dunbar at apple.com> wrote:
>>>
>>> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//511
>>> Name: smoosh-01
>>> Nickname: smoosh-01.apple.com:1
>>> Buildstatus: OK
>>>
>>> Run: 511, Start Time: 2009-07-05 15:36:17
>>> Comparing To: 508, Start Time: 2009-07-05 13:31:46
>>>
>>> --- Changes Summary ---
>>> New Test Passes: 0
>>> New Test Failures: 2
>>> Added Tests: 0
>>> Removed Tests: 0
>>> Significant Changes: 325
>>>
>>> --- Tests Summary ---
>>> Total Tests: 3429
>>> Total Test Failures: 490
>>>
>>> Total Test Failures By Type:
>>> Bitcode: 50
>>> CBE: 70
>>> GCCAS: 50
>>> JIT: 60
>>> JIT codegen: 60
>>> LLC: 50
>>> LLC compile: 50
>>> LLC-BETA: 50
>>> LLC_BETA compile: 50
>>>
>>> --- Changes Detail ---
>>> New Test Passes:
>>>
>>> New Test Failures:
>>> MultiSource/Applications/lemon/lemon [JIT, JIT codegen]
>>>
>>> Added Tests:
>>>
>>> Removed Tests:
>>>
>>> Significant Changes in Test Results:
>>> JIT codegen:
>>> MultiSource/Applications/ClamAV/clamscan: 49.23% (10.3864 => 15.5000)
>>> MultiSource/Applications/JM/ldecod/ldecod: 58.17% (7.1708 => 11.3419)
>>> MultiSource/Applications/JM/lencod/lencod: 54.55% (15.6812 => 24.2353)
>>> MultiSource/Applications/SIBsim4/SIBsim4: 58.97% (1.4115 => 2.2439)
>>> MultiSource/Applications/SPASS/SPASS: 53.76% (11.2251 => 17.2602)
>>> MultiSource/Applications/d/make_dparser: 49.69% (3.5134 => 5.2591)
>>> MultiSource/Applications/hbd/hbd: 50.58% (0.9954 => 1.4989)
>>> MultiSource/Applications/lambda-0_1_3/lambda: 43.35% (0.8750 => 1.2543)
>>> MultiSource/Applications/lua/lua: 43.33% (5.4783 => 7.8518)
>>> MultiSource/Applications/oggenc/oggenc: 55.12% (3.0524 => 4.7348)
>>> MultiSource/Applications/sgefa/sgefa: 52.13% (0.2580 => 0.3925)
>>> MultiSource/Applications/siod/siod: 40.81% (2.0376 => 2.8691)
>>> MultiSource/Applications/spiff/spiff: 48.29% (0.6879 => 1.0201)
>>> MultiSource/Applications/sqlite3/sqlite3: 46.23% (13.4152 => 19.6175)
>>> MultiSource/Applications/treecc/treecc: 47.77% (1.1037 => 1.6309)
>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 68.57% (6.1341 =>
>>> 10.3402)
>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 49.86% (0.2160 =>
>>> 0.3237)
>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 56.14% (0.3231
>>> => 0.5045)
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 62.77% (0.9809 => 1.5966)
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 47.48% (0.9381 =>
>>> 1.3835)
>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 50.13% (4.2586 =>
>>> 6.3936)
>>> MultiSource/Benchmarks/MallocBench/gs/gs: 41.91% (2.7813 => 3.9470)
>>> MultiSource/Benchmarks/McCat/09-vor/vor: 41.44% (0.3697 => 0.5229)
>>> MultiSource/Benchmarks/McCat/18-imp/imp: 50.43% (0.3230 => 0.4859)
>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 60.46%
>>> (0.8055 => 1.2925)
>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 48.35%
>>> (1.4086 => 2.0896)
>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.76%
>>> (2.7921 => 4.4049)
>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 44.27%
>>> (15.6790 => 22.6196)
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 50.30%
>>> (0.4865 => 0.7312)
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>> 50.60% (0.2154 => 0.3244)
>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 44.72% (0.5932
>>> => 0.8585)
>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 42.91% (0.2265 =>
>>> 0.3237)
>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 41.75% (0.3559 =>
>>> 0.5045)
>>> MultiSource/Benchmarks/PAQ8p/paq8p: 46.72% (2.2943 => 3.3663)
>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 55.64%
>>> (1.1579 => 1.8021)
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 48.65% (0.4993 => 0.7422)
>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 52.97% (0.7155 =>
>>> 1.0945)
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 52.75% (1.9100 =>
>>> 2.9176)
>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 54.22% (0.6937 => 1.0698)
>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 40.87% (0.6303 => 0.8879)
>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 53.26% (0.2867 =>
>>> 0.4394)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 55.56% (0.4714
>>> => 0.7333)
>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 53.49% (0.5111 =>
>>> 0.7845)
>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 47.69% (1.8665 => 2.7566)
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 59.08% (0.8082 => 1.2857)
>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 56.15% (0.2456 => 0.3835)
>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 34.59% (0.3487 =>
>>> 0.4693)
>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 50.06% (0.5587 => 0.8384)
>>> MultiSource/Benchmarks/mafft/pairlocalalign: 57.25% (2.1478 => 3.3774)
>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.75% (0.5698 =>
>>> 0.8248)
>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 46.13% (1.4823 =>
>>> 2.1661)
>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.66%
>>> (1.1257 => 1.7860)
>>> MultiSource/Benchmarks/sim/sim: 64.09% (0.4729 => 0.7760)
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 52.79% (4.4064 => 6.7327)
>>> SingleSource/UnitTests/SignlessTypes/rem: 63.80% (0.2174 => 0.3561)
>>> CBE:
>>> MultiSource/Applications/sgefa/sgefa: -8.75% (0.8000 => 0.7300)
>>> MultiSource/Benchmarks/Olden/health/health: -5.56% (0.3600 => 0.3400)
>>> LLC-BETA:
>>> MultiSource/Benchmarks/Olden/health/health: 5.88% (0.3400 => 0.3600)
>>> LLC compile:
>>> MultiSource/Applications/ClamAV/clamscan: 48.87% (20.2787 => 30.1888)
>>> MultiSource/Applications/JM/ldecod/ldecod: 56.09% (9.1867 => 14.3393)
>>> MultiSource/Applications/JM/lencod/lencod: 51.99% (20.1605 => 30.6413)
>>> MultiSource/Applications/SIBsim4/SIBsim4: 56.48% (1.4731 => 2.3051)
>>> MultiSource/Applications/SPASS/SPASS: 51.78% (17.2164 => 26.1306)
>>> MultiSource/Applications/d/make_dparser: 47.87% (4.1601 => 6.1515)
>>> MultiSource/Applications/hbd/hbd: 49.02% (1.2424 => 1.8514)
>>> MultiSource/Applications/lambda-0_1_3/lambda: 42.51% (1.1342 => 1.6163)
>>> MultiSource/Applications/lemon/lemon: 46.71% (1.6987 => 2.4921)
>>> MultiSource/Applications/lua/lua: 42.05% (8.4445 => 11.9951)
>>> MultiSource/Applications/oggenc/oggenc: 53.07% (3.8891 => 5.9531)
>>> MultiSource/Applications/sgefa/sgefa: 50.94% (0.2658 => 0.4012)
>>> MultiSource/Applications/siod/siod: 39.67% (5.8487 => 8.1689)
>>> MultiSource/Applications/spiff/spiff: 46.33% (0.8923 => 1.3057)
>>> MultiSource/Applications/sqlite3/sqlite3: 44.73% (19.0892 => 27.6273)
>>> MultiSource/Applications/treecc/treecc: 46.95% (4.9042 => 7.2066)
>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 67.88% (8.2110 =>
>>> 13.7848)
>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 47.95% (0.2246 =>
>>> 0.3323)
>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 55.66% (0.3782
>>> => 0.5887)
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 60.62% (1.0181 => 1.6353)
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 47.28% (0.9971 =>
>>> 1.4685)
>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 48.58% (6.6418 =>
>>> 9.8686)
>>> MultiSource/Benchmarks/MallocBench/gs/gs: 42.39% (5.8443 => 8.3215)
>>> MultiSource/Benchmarks/McCat/09-vor/vor: 41.67% (0.3811 => 0.5399)
>>> MultiSource/Benchmarks/McCat/18-imp/imp: 49.28% (0.3344 => 0.4992)
>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 56.87%
>>> (0.8706 => 1.3657)
>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 48.73%
>>> (2.7850 => 4.1421)
>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.20%
>>> (3.6016 => 5.6256)
>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 43.55%
>>> (19.5151 => 28.0137)
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 46.72%
>>> (2.1228 => 3.1146)
>>> MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish:
>>> 50.74% (0.2761 => 0.4162)
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>> 50.53% (0.3214 => 0.4838)
>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 43.58% (0.8277
>>> => 1.1884)
>>> MultiSource/Benchmarks/Olden/bh/bh: 52.90% (0.2049 => 0.3133)
>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.80% (0.2493 =>
>>> 0.3535)
>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 41.94% (0.3698 =>
>>> 0.5249)
>>> MultiSource/Benchmarks/PAQ8p/paq8p: 44.68% (3.2163 => 4.6535)
>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.40%
>>> (8.1524 => 12.5057)
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 48.53% (1.5058 => 2.2366)
>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 49.79% (0.9806 =>
>>> 1.4688)
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 51.90% (2.0017 =>
>>> 3.0405)
>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 53.58% (0.7217 => 1.1084)
>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 39.69% (0.7523 =>
>>> 1.0509)
>>> MultiSource/Benchmarks/Prolangs-C/football/football: 48.78% (1.4503 =>
>>> 2.1578)
>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 39.84% (0.6523 => 0.9122)
>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 50.27% (0.4036 =>
>>> 0.6065)
>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 43.58% (0.9954 =>
>>> 1.4292)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 50.98% (0.7018
>>> => 1.0596)
>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 47.58% (1.3481 =>
>>> 1.9895)
>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 47.26% (2.0268 => 2.9846)
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 57.79% (0.8372 => 1.3210)
>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 53.68% (0.2543 => 0.3908)
>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 32.22% (0.3551 =>
>>> 0.4695)
>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 49.18% (0.5923 => 0.8836)
>>> MultiSource/Benchmarks/mafft/pairlocalalign: 57.85% (4.9583 => 7.8265)
>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.78% (0.8309 =>
>>> 1.1864)
>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 46.51% (2.3646 =>
>>> 3.4643)
>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 55.33%
>>> (1.5479 => 2.4044)
>>> MultiSource/Benchmarks/sim/sim: 62.76% (0.4920 => 0.8008)
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 50.54% (4.5832 => 6.8995)
>>> SingleSource/UnitTests/SignlessTypes/rem: 62.47% (0.2241 => 0.3641)
>>> GCCAS:
>>> MultiSource/Applications/ClamAV/clamscan: 188.47% (14.8513 => 42.8415)
>>> MultiSource/Applications/JM/ldecod/ldecod: 194.31% (8.1741 => 24.0576)
>>> MultiSource/Applications/JM/lencod/lencod: 196.85% (17.5271 => 52.0288)
>>> MultiSource/Applications/SIBsim4/SIBsim4: 180.29% (1.4560 => 4.0810)
>>> MultiSource/Applications/SPASS/SPASS: 186.34% (19.8547 => 56.8524)
>>> MultiSource/Applications/d/make_dparser: 184.13% (4.3132 => 12.2551)
>>> MultiSource/Applications/hbd/hbd: 197.33% (0.8960 => 2.6641)
>>> MultiSource/Applications/lambda-0_1_3/lambda: 180.91% (0.7112 => 1.9978)
>>> MultiSource/Applications/lemon/lemon: 178.78% (1.1427 => 3.1856)
>>> MultiSource/Applications/lua/lua: 178.58% (5.5054 => 15.3371)
>>> MultiSource/Applications/oggenc/oggenc: 180.80% (4.6297 => 13.0004)
>>> MultiSource/Applications/sgefa/sgefa: 174.30% (0.2560 => 0.7022)
>>> MultiSource/Applications/siod/siod: 193.76% (2.3005 => 6.7579)
>>> MultiSource/Applications/spiff/spiff: 178.20% (0.5872 => 1.6336)
>>> MultiSource/Applications/sqlite3/sqlite3: 185.18% (13.0557 => 37.2324)
>>> MultiSource/Applications/treecc/treecc: 180.67% (2.4635 => 6.9144)
>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 236.71% (8.5006 =>
>>> 28.6224)
>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 171.95% (0.3262 =>
>>> 0.8871)
>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 171.54% (0.2403
>>> => 0.6525)
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 175.22% (0.9729 => 2.6776)
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 171.20% (0.7718 =>
>>> 2.0931)
>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 175.74% (4.7685 =>
>>> 13.1485)
>>> MultiSource/Benchmarks/MallocBench/gs/gs: 176.85% (3.9399 => 10.9076)
>>> MultiSource/Benchmarks/McCat/05-eks/eks: 168.70% (0.2824 => 0.7588)
>>> MultiSource/Benchmarks/McCat/08-main/main: 218.23% (0.2167 => 0.6896)
>>> MultiSource/Benchmarks/McCat/09-vor/vor: 194.59% (0.2922 => 0.8608)
>>> MultiSource/Benchmarks/McCat/18-imp/imp: 181.17% (0.2640 => 0.7423)
>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan:
>>> 210.43% (0.8821 => 2.7383)
>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 187.86%
>>> (3.8478 => 11.0764)
>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 192.73%
>>> (4.0301 => 11.7975)
>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset:
>>> 188.84% (19.3500 => 55.8903)
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 190.05%
>>> (1.6203 => 4.6997)
>>> MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish:
>>> 210.03% (0.3361 => 1.0420)
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>> 375.88% (0.3408 => 1.6218)
>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 164.33%
>>> (1.2476 => 3.2978)
>>> MultiSource/Benchmarks/Olden/bh/bh: 191.88% (0.2462 => 0.7186)
>>> MultiSource/Benchmarks/Olden/voronoi/voronoi: 171.92% (0.2646 => 0.7195)
>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 158.89% (0.2459 =>
>>> 0.6366)
>>> MultiSource/Benchmarks/PAQ8p/paq8p: 191.83% (2.8291 => 8.2561)
>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 195.49%
>>> (5.5887 => 16.5140)
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 181.33% (1.1113 =>
>>> 3.1264)
>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 182.33% (0.5122
>>> => 1.4461)
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 177.42% (1.0712 =>
>>> 2.9717)
>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 219.20% (0.3078 =>
>>> 0.9825)
>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 207.46% (0.3323 =>
>>> 1.0217)
>>> MultiSource/Benchmarks/Prolangs-C/football/football: 202.53% (0.9670 =>
>>> 2.9255)
>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 194.86% (0.3679 =>
>>> 1.0848)
>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 167.10% (0.2483 =>
>>> 0.6632)
>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 180.37% (0.7132
>>> => 1.9996)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 180.96% (0.3933
>>> => 1.1050)
>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 185.79% (0.8714 =>
>>> 2.4904)
>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 187.54% (1.2887 => 3.7055)
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 173.22% (0.6419 => 1.7538)
>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 166.45% (0.2316 => 0.6171)
>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 485.33% (0.4103 =>
>>> 2.4016)
>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 218.38% (0.3286 => 1.0462)
>>> MultiSource/Benchmarks/mafft/pairlocalalign: 199.99% (9.9048 => 29.7131)
>>> MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 160.03%
>>> (0.2314 => 0.6017)
>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 164.01% (1.2480 =>
>>> 3.2949)
>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 187.81% (3.8963 =>
>>> 11.2141)
>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 186.27%
>>> (1.4295 => 4.0922)
>>> MultiSource/Benchmarks/sim/sim: 193.73% (0.2853 => 0.8380)
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 163.50% (3.0193 =>
>>> 7.9558)
>>> SingleSource/Benchmarks/Misc/ReedSolomon: 189.16% (0.2030 => 0.5870)
>>> SingleSource/Benchmarks/Misc/oourafft: 170.93% (0.2394 => 0.6486)
>>> JIT:
>>> MultiSource/Applications/ClamAV/clamscan: 54.40% (10.9000 => 16.8300)
>>> MultiSource/Applications/JM/ldecod/ldecod: 63.49% (7.4500 => 12.1800)
>>> MultiSource/Applications/JM/lencod/lencod: 38.16% (26.1800 => 36.1700)
>>> MultiSource/Applications/SIBsim4/SIBsim4: 12.65% (7.2700 => 8.1900)
>>> MultiSource/Applications/SPASS/SPASS: 35.54% (22.3400 => 30.2800)
>>> MultiSource/Applications/d/make_dparser: 58.54% (3.6900 => 5.8500)
>>> MultiSource/Applications/hbd/hbd: 55.77% (1.0400 => 1.6200)
>>> MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (7.2800 => 7.7200)
>>> MultiSource/Applications/lua/lua: 12.66% (20.9300 => 23.5800)
>>> MultiSource/Applications/oggenc/oggenc: 63.72% (3.3900 => 5.5500)
>>> MultiSource/Applications/sgefa/sgefa: 14.78% (1.1500 => 1.3200)
>>> MultiSource/Applications/siod/siod: 17.88% (5.4800 => 6.4600)
>>> MultiSource/Applications/spiff/spiff: 8.31% (4.4500 => 4.8200)
>>> MultiSource/Applications/sqlite3/sqlite3: 34.88% (19.2100 => 25.9100)
>>> MultiSource/Applications/treecc/treecc: 55.65% (1.1500 => 1.7900)
>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 47.48% (9.7300 =>
>>> 14.3500)
>>> MultiSource/Benchmarks/BitBench/drop3/drop3: 7.84% (0.5100 => 0.5500)
>>> MultiSource/Benchmarks/Fhourstones/fhourstones: 5.97% (1.3400 => 1.4200)
>>> MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 42.86% (0.2100 =>
>>> 0.3000)
>>> MultiSource/Benchmarks/FreeBench/distray/distray: 16.67% (0.3600 =>
>>> 0.4200)
>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.67% (1.2000
>>> => 1.4000)
>>> MultiSource/Benchmarks/FreeBench/mason/mason: 12.50% (0.3200 => 0.3600)
>>> MultiSource/Benchmarks/FreeBench/neural/neural: 20.00% (0.4000 =>
>>> 0.4800)
>>> MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.41% (0.3400
>>> => 0.4400)
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 58.62% (1.1600 => 1.8400)
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.41% (3.4400 =>
>>> 3.9700)
>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 47.78% (5.1700 =>
>>> 7.6400)
>>> MultiSource/Benchmarks/MallocBench/gs/gs: 48.14% (2.9500 => 4.3700)
>>> MultiSource/Benchmarks/McCat/09-vor/vor: 32.08% (0.5300 => 0.7000)
>>> MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.54% (0.2600 => 0.2900)
>>> MultiSource/Benchmarks/McCat/18-imp/imp: 43.18% (0.4400 => 0.6300)
>>>
>>> MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath:
>>> 10.42% (0.4800 => 0.5300)
>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 58.06%
>>> (0.9300 => 1.4700)
>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 55.10%
>>> (1.4700 => 2.2800)
>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.06%
>>> (3.2000 => 5.0900)
>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 49.35%
>>> (16.1900 => 24.1800)
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 58.82%
>>> (0.5100 => 0.8100)
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>> 46.67% (0.3000 => 0.4400)
>>> MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.70%
>>> (0.2300 => 0.2500)
>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 39.02% (0.8200
>>> => 1.1400)
>>> MultiSource/Benchmarks/Olden/bh/bh: 7.39% (1.7600 => 1.8900)
>>> MultiSource/Benchmarks/Olden/health/health: 12.77% (0.4700 => 0.5300)
>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.53% (0.5100 =>
>>> 0.6300)
>>> MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.13% (0.3900 => 0.4100)
>>> MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.87% (0.5300 => 0.6300)
>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 51.16% (0.4300 =>
>>> 0.6500)
>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 65.83%
>>> (1.2000 => 1.9900)
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 56.60% (0.5300 => 0.8300)
>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 59.46% (0.7400 =>
>>> 1.1800)
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 61.00% (2.0000 =>
>>> 3.2200)
>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 62.50% (0.7200 => 1.1700)
>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 42.25% (0.7100 => 1.0100)
>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 54.84% (0.3100 =>
>>> 0.4800)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 61.22% (0.4900
>>> => 0.7900)
>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 64.15% (0.5300 =>
>>> 0.8700)
>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 35.82% (2.8200 => 3.8300)
>>> MultiSource/Benchmarks/Ptrdist/ft/ft: 6.93% (1.0100 => 1.0800)
>>> MultiSource/Benchmarks/Ptrdist/ks/ks: 7.23% (1.6600 => 1.7800)
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 25.47% (2.1200 => 2.6600)
>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.77% (2.6000 =>
>>> 2.7500)
>>> MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.10% (0.9800
>>> => 1.0300)
>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.98% (2.0700 => 2.3800)
>>> MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.43% (0.2300
>>> => 0.3000)
>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.61% (0.6200 =>
>>> 0.9400)
>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 52.90% (1.5500 =>
>>> 2.3700)
>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.71%
>>> (1.1800 => 1.9200)
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 45.74% (6.1000 => 8.8900)
>>> SingleSource/Benchmarks/BenchmarkGame/recursive: 6.76% (0.7400 =>
>>> 0.7900)
>>> SingleSource/Benchmarks/McGill/misr: 7.14% (0.2800 => 0.3000)
>>> SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.69% (0.2900 => 0.3500)
>>> SingleSource/Benchmarks/Misc/ffbench: 5.15% (0.9700 => 1.0200)
>>> SingleSource/Benchmarks/Shootout/fib2: 5.71% (0.3500 => 0.3700)
>>> SingleSource/Benchmarks/Shootout/strcat: 6.67% (0.3000 => 0.3200)
>>> SingleSource/Benchmarks/Stanford/Perm: 10.53% (0.3800 => 0.4200)
>>> SingleSource/Benchmarks/Stanford/Puzzle: 17.39% (0.2300 => 0.2700)
>>> SingleSource/UnitTests/SignlessTypes/rem: 69.57% (0.2300 => 0.3900)
>>> SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.68% (0.6200 =>
>>> 0.6800)
>>> SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.99% (0.7700 => 0.8700)
>>> LLC-BETA compile:
>>> MultiSource/Applications/ClamAV/clamscan: 61.16% (21.5990 => 34.8079)
>>> MultiSource/Applications/JM/ldecod/ldecod: 65.39% (9.7881 => 16.1883)
>>> MultiSource/Applications/JM/lencod/lencod: 61.26% (21.5384 => 34.7328)
>>> MultiSource/Applications/SIBsim4/SIBsim4: 66.62% (1.5757 => 2.6255)
>>> MultiSource/Applications/SPASS/SPASS: 63.85% (18.3954 => 30.1412)
>>> MultiSource/Applications/d/make_dparser: 59.25% (4.4494 => 7.0855)
>>> MultiSource/Applications/hbd/hbd: 60.91% (1.3319 => 2.1432)
>>> MultiSource/Applications/lambda-0_1_3/lambda: 57.84% (1.2199 => 1.9255)
>>> MultiSource/Applications/lemon/lemon: 57.82% (1.7950 => 2.8329)
>>> MultiSource/Applications/lua/lua: 54.31% (9.0360 => 13.9438)
>>> MultiSource/Applications/oggenc/oggenc: 63.57% (4.1537 => 6.7940)
>>> MultiSource/Applications/sgefa/sgefa: 62.56% (0.2826 => 0.4594)
>>> MultiSource/Applications/siod/siod: 54.47% (6.2808 => 9.7021)
>>> MultiSource/Applications/spiff/spiff: 57.95% (0.9461 => 1.4944)
>>> MultiSource/Applications/sqlite3/sqlite3: 56.73% (20.3019 => 31.8192)
>>> MultiSource/Applications/treecc/treecc: 59.35% (5.2630 => 8.3866)
>>> MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 76.28% (8.7886 =>
>>> 15.4922)
>>> MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 58.90% (0.2382 =>
>>> 0.3785)
>>> MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 66.22% (0.4088
>>> => 0.6795)
>>> MultiSource/Benchmarks/FreeBench/pifft/pifft: 68.67% (1.1253 => 1.8980)
>>> MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 58.61% (1.0627 =>
>>> 1.6856)
>>> MultiSource/Benchmarks/MallocBench/espresso/espresso: 58.89% (7.0660 =>
>>> 11.2275)
>>> MultiSource/Benchmarks/MallocBench/gs/gs: 55.56% (6.2661 => 9.7474)
>>> MultiSource/Benchmarks/McCat/09-vor/vor: 52.53% (0.4091 => 0.6240)
>>> MultiSource/Benchmarks/McCat/18-imp/imp: 59.35% (0.3562 => 0.5676)
>>> MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 63.16%
>>> (0.9223 => 1.5048)
>>> MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 60.21%
>>> (2.9825 => 4.7782)
>>> MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 66.67%
>>> (3.8648 => 6.4413)
>>> MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 55.85%
>>> (20.8604 => 32.5111)
>>> MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 60.42%
>>> (2.2721 => 3.6449)
>>> MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish:
>>> 62.06% (0.2984 => 0.4836)
>>> MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael:
>>> 59.50% (0.3790 => 0.6045)
>>> MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 54.33% (0.8900
>>> => 1.3735)
>>> MultiSource/Benchmarks/Olden/bh/bh: 63.55% (0.2211 => 0.3616)
>>> MultiSource/Benchmarks/Olden/perimeter/perimeter: 55.04% (0.2689 =>
>>> 0.4169)
>>> MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 59.37% (0.4145 =>
>>> 0.6606)
>>> MultiSource/Benchmarks/PAQ8p/paq8p: 56.72% (3.5089 => 5.4992)
>>> MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 63.54%
>>> (8.6981 => 14.2249)
>>> MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 60.37% (1.6010 => 2.5675)
>>> MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 60.38% (1.0461 =>
>>> 1.6777)
>>> MultiSource/Benchmarks/Prolangs-C/bison/mybison: 61.51% (2.1205 =>
>>> 3.4248)
>>> MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 63.56% (0.7704 => 1.2601)
>>> MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 52.46% (0.7982 =>
>>> 1.2169)
>>> MultiSource/Benchmarks/Prolangs-C/football/football: 60.23% (1.5364 =>
>>> 2.4618)
>>> MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 52.43% (0.6964 => 1.0615)
>>> MultiSource/Benchmarks/Prolangs-C/loader/loader: 60.36% (0.4342 =>
>>> 0.6963)
>>> MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 56.15% (1.0640 =>
>>> 1.6614)
>>> MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 61.97% (0.7467
>>> => 1.2094)
>>> MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 58.58% (1.4318 =>
>>> 2.2705)
>>> MultiSource/Benchmarks/Ptrdist/bc/bc: 59.24% (2.1588 => 3.4376)
>>> MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 68.02% (0.8889 => 1.4935)
>>> MultiSource/Benchmarks/SciMark2-C/scimark2: 63.96% (0.2708 => 0.4440)
>>> MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 71.62% (0.4253 =>
>>> 0.7299)
>>> MultiSource/Benchmarks/VersaBench/dbms/dbms: 61.91% (0.6395 => 1.0354)
>>> MultiSource/Benchmarks/mafft/pairlocalalign: 67.43% (5.2454 => 8.7825)
>>> MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 53.50% (0.2069
>>> => 0.3176)
>>> MultiSource/Benchmarks/mediabench/gsm/toast/toast: 54.39% (0.8897 =>
>>> 1.3736)
>>> MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 57.22% (2.5361 =>
>>> 3.9873)
>>> MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 64.98%
>>> (1.6596 => 2.7380)
>>> MultiSource/Benchmarks/sim/sim: 74.13% (0.5272 => 0.9180)
>>> SingleSource/Benchmarks/Adobe-C++/loop_unroll: 59.19% (4.8490 => 7.7190)
>>> SingleSource/Benchmarks/Misc/oourafft: 70.18% (0.2086 => 0.3550)
>>> SingleSource/UnitTests/SignlessTypes/rem: 73.73% (0.2440 => 0.4239)
>>> _______________________________________________
>>> llvm-testresults mailing list
>>> llvm-testresults at cs.uiuc.edu
>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>>
>
>
More information about the llvm-testresults
mailing list