[LNT][PATCH] extract configuration from nightly tests

Renato Golin renato.golin at linaro.org
Fri Aug 9 14:55:29 PDT 2013


On 9 August 2013 22:29, Chris Matthews <chris.matthews at apple.com> wrote:

> First when an LNT run is finished and after the initial submission, rerun
> any benchmarks which the server reports back as regressed.
>

This is great, I think it will increase the quality without re-running
everything.


This would not catch changes in the system during reruns, but it would
> between runs.
>

That's the idea, yes. A re-run should be considered "the same run" for any
statistical purposes.


Both Daniel and myself have some scripts for helping with these sort of
> performance comparisons you are talking about, basically just looking at
> A/B situations and comparing the performance that way.
>

Excellent! Thanks for working on that!

cheers,
--renato
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20130809/6f0e9855/attachment.html>


More information about the llvm-commits mailing list