[llvm-testresults] Grawp-PIC nightly tester results

Daniel Dunbar daniel at zuster.org
Fri Aug 14 12:53:57 PDT 2009


On Fri, Aug 14, 2009 at 11:32 AM, Dan Gohman<gohman at apple.com> wrote:
> My understanding is that the quadradic behavior is now gone, and
> llc -asm-verbose is just printing more than it did before. I'll
> take a closer look when I get a chance, but it may also be a good
> idea to turn off verbose asm for running tests.

Ok, it would be worth double checking just to make sure nothing funny
is going on. gobmk seems to get particularly worse:
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 158.67% (9.7602 => 25.2465)
which is a little more than I would expect from just verbose asm.

But yes, I think we should probably turn verbose asm off (or at least
off by default) since we aren't particularly interested in those
regressions.

 - Daniel

> Dan
>
> On Aug 14, 2009, at 8:20 AM, Daniel Dunbar wrote:
>
>
>> From this, and other, reports, it looks like compile time hasn't
>> returned to where it used to be (note that grawp and geryon seemed to
>> skip yesterday).
>>
>> Dan, I presume this is due to .s printing related things, is there
>> still more work being done there?
>>
>> - Daniel
>>
>> On Fri, Aug 14, 2009 at 6:06 AM, <daniel_dunbar at apple.com> wrote:
>>
>>> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//1238
>>>
>>> Name:  grawp.apple.com
>>>
>>> Nickname: Grawp-PIC:4
>>>
>>> Buildstatus: OK
>>>
>>>
>>>
>>> Run: 1238, Start Time: 2009-08-14 03:31:23
>>>
>>> Comparing To: 1208, Start Time: 2009-08-12 03:48:44
>>>
>>>
>>>
>>> --- Changes Summary ---
>>>
>>> New Test Passes: 0
>>>
>>> New Test Failures: 0
>>>
>>> Added Tests: 0
>>>
>>> Removed Tests: 0
>>>
>>> Significant Changes: 31
>>>
>>>
>>>
>>> --- Tests Summary ---
>>>
>>> Total Tests: 3852
>>>
>>> Total Test Failures: 1759
>>>
>>>
>>>
>>> Total Test Failures By Type:
>>>
>>>  CBE: 43
>>>
>>>  JIT: 428
>>>
>>>  JIT codegen: 428
>>>
>>>  LLC: 2
>>>
>>>  LLC compile: 2
>>>
>>>  LLC-BETA: 428
>>>
>>>  LLC_BETA compile: 428
>>>
>>>
>>>
>>> --- Changes Detail ---
>>>
>>> New Test Passes:
>>>
>>>
>>>
>>> New Test Failures:
>>>
>>>
>>>
>>> Added Tests:
>>>
>>>
>>>
>>> Removed Tests:
>>>
>>>
>>>
>>> Significant Changes in Test Results:
>>>
>>> LLC:
>>>
>>>  MultiSource/Applications/sgefa/sgefa: 6.58% (0.7600 => 0.8100)
>>>
>>>  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -6.67%
>>> (0.3000 => 0.2800)
>>>
>>> LLC compile:
>>>
>>>  Externals/Povray/povray: 158.29% (8.0047 => 20.6751)
>>>
>>>  Externals/SPEC/CFP2000/177_mesa/177_mesa: 63.91% (5.3976 => 8.8473)
>>>
>>>  Externals/SPEC/CFP2000/188_ammp/188_ammp: 26.84% (1.4790 => 1.8760)
>>>
>>>  Externals/SPEC/CFP2006/433_milc/433_milc: 6.77% (0.7930 => 0.8467)
>>>
>>>  Externals/SPEC/CFP2006/444_namd/444_namd: 17.49% (2.2245 => 2.6135)
>>>
>>>  Externals/SPEC/CFP2006/447_dealII/447_dealII: 28.55% (5.7593 => 7.4035)
>>>
>>>  Externals/SPEC/CFP2006/450_soplex/450_soplex: 61.48% (3.5077 => 5.6642)
>>>
>>>  Externals/SPEC/CINT2000/175_vpr/175_vpr: 10.70% (1.5403 => 1.7051)
>>>
>>>  Externals/SPEC/CINT2000/252_eon/252_eon: 79.50% (2.2175 => 3.9805)
>>>
>>>  Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 9.25% (9.3704 =>
>>> 10.2369)
>>>
>>>  Externals/SPEC/CINT2000/300_twolf/300_twolf: 6.33% (2.3286 => 2.4759)
>>>
>>>  Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 12.79% (17.6578 =>
>>> 19.9160)
>>>
>>>  Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 158.67% (9.7602 => 25.2465)
>>>
>>>  Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 16.17% (1.9809 => 2.3012)
>>>
>>>  Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 19.71% (5.8437 =>
>>> 6.9954)
>>>
>>>  Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 25.80% (10.5614 =>
>>> 13.2861)
>>>
>>>  Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 61.03% (38.3277 =>
>>> 61.7203)
>>>
>>>  MultiSource/Applications/JM/lencod/lencod: 25.77% (7.1955 => 9.0496)
>>>
>>>  MultiSource/Applications/oggenc/oggenc: 84.53% (1.3701 => 2.5282)
>>>
>>>  MultiSource/Applications/sqlite3/sqlite3: 10.90% (6.2932 => 6.9791)
>>>
>>>  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.06% (0.3459 => 0.3634)
>>>
>>>  MultiSource/Benchmarks/MallocBench/gs/gs: 19.55% (1.8314 => 2.1894)
>>>
>>>  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 34.33%
>>> (1.2859 => 1.7274)
>>>
>>>  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.67%
>>> (6.5868 => 7.2897)
>>>
>>>  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.06%
>>> (2.9884 => 3.5281)
>>>
>>>  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 22.87% (5.0591 => 6.2162)
>>>
>>>  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.20% (1.6482 => 1.7834)
>>>
>>> CBE:
>>>
>>>  MultiSource/Applications/ClamAV/clamscan: -7.14% (0.2800 => 0.2600)
>>>
>>>  MultiSource/Applications/sgefa/sgefa: -8.33% (0.7200 => 0.6600)
>>>
>>> _______________________________________________
>>>
>>> llvm-testresults mailing list
>>>
>>> llvm-testresults at cs.uiuc.edu
>>>
>>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>>>
>>>
>>>
>
>
>




More information about the llvm-testresults mailing list