[LLVMdev] llvm.org/perf internal server error

[Renato Golin]

AFAIK, only two bots were submitting results, mine and Tobi's.

The default being not to submit makes more sense, IMO, because Hal was
going to separate between test-suite and benchmark runs, with the
latter being a subset of the former.

I assume test runs don't need to submit, while benchmark runs must.

cheers,
--renato

On 12 February 2014 22:12, Chris Matthews <chris.matthews at apple.com> wrote:
> Is there a list of bots that should not submit?
>
> Im not sure if opt in or opt out is better for this?
>
> On Feb 12, 2014, at 2:09 PM, Renato Golin <renato.golin at linaro.org> wrote:
>
>> On 12 February 2014 22:06, Chris Matthews <chris.matthews at apple.com> wrote:
>>> 1) Change the default logging strategy in LNT.  We should be emailing the sysadmin on all ISEs.
>>>
>>> 2) Update the bots to make submission optional, and don't submit when not wanted.
>>>
>>> 3) Split the bot's use of LNT up to have a separate submission step.  Then mark this new submission step as warn on fail.  That will isolate server failures from testing and run failures, and if the server does fail, the run will only be marked as warning and not a full failure.
>>
>> Excellent plan! I agree the default should be to not submit.
>>
>> thanks,
>> --renato
>