[zorg] r222346 - Limit parallel link job count to 3 on the bootstrap bot.

[Evgeniy Stepanov]

On Wed, Nov 19, 2014 at 7:23 PM, David Blaikie <dblaikie at gmail.com> wrote:
>
>
> On Wed, Nov 19, 2014 at 2:51 AM, Evgeniy Stepanov
> <eugeni.stepanov at gmail.com> wrote:
>>
>> Author: eugenis
>> Date: Wed Nov 19 04:51:17 2014
>> New Revision: 222346
>>
>> URL: http://llvm.org/viewvc/llvm-project?rev=222346&view=rev
>> Log:
>> Limit parallel link job count to 3 on the bootstrap bot.
>
>
> I'm a bit surprised at only 3 - how many corse/RAM does the machine have? (&
> again, probably nice to have this come down from the buildbot config, though
> there's no in-built attribute for this, I imagine (unlike the 'jobs'
> attribute which matches more CPU bound tasks like compilation, not linking
> which can easily be memory bound))

The machine has 24 cores and 24Gb of RAM. Some linker jobs that I've
seen take 4 or 5 Gb. Compilation jobs on the 3rd stage (when the
compiler binary is built with ASan) take up to 1Gb each.

Maybe link jobs count could be raised a bit, but I'd like to make sure
that the bot is stable before doing that.

These bots are not like the usual LLVM bots, the closest we have to a
bot config is this file:
http://llvm.org/viewvc/llvm-project/zorg/trunk/zorg/buildbot/builders/sanitizers/buildbot_selector.py?view=markup

I guess it would make a better place for such settings, but not by a lot.


>>
>>
>> Modified:
>>     zorg/trunk/zorg/buildbot/builders/sanitizers/buildbot_bootstrap.sh
>>
>> Modified:
>> zorg/trunk/zorg/buildbot/builders/sanitizers/buildbot_bootstrap.sh
>> URL:
>> http://llvm.org/viewvc/llvm-project/zorg/trunk/zorg/buildbot/builders/sanitizers/buildbot_bootstrap.sh?rev=222346&r1=222345&r2=222346&view=diff
>>
>> ==============================================================================
>> --- zorg/trunk/zorg/buildbot/builders/sanitizers/buildbot_bootstrap.sh
>> (original)
>> +++ zorg/trunk/zorg/buildbot/builders/sanitizers/buildbot_bootstrap.sh Wed
>> Nov 19 04:51:17 2014
>> @@ -33,7 +33,7 @@ LIBCXX=$LLVM/projects/libcxx
>>
>>  type -a gcc
>>  type -a g++
>> -CMAKE_COMMON_OPTIONS="-GNinja -DCMAKE_BUILD_TYPE=Release
>> -DLLVM_ENABLE_ASSERTIONS=ON"
>> +CMAKE_COMMON_OPTIONS="-GNinja -DCMAKE_BUILD_TYPE=Release
>> -DLLVM_ENABLE_ASSERTIONS=ON -DLLVM_PARALLEL_LINK_JOBS=3"
>>  CMAKE_STAGE1_OPTIONS="${CMAKE_COMMON_OPTIONS}"
>>
>>  echo @@@BUILD_STEP update@@@
>>
>>
>> _______________________________________________
>> llvm-commits mailing list
>> llvm-commits at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-commits
>
>