[PATCH] [LNT] Aggregate most recent runs

[Yi Kong]

On Fri, 2014-05-09 at 17:18 +0100, Yi Kong wrote:
> Patch updated to conform code style.
> 
> Also attached, screenshot comparison of stdev estimation using previous
> 10 runs and aggregation of 8 runs on a Cortex-A9 board.
> 
> On Thu, 2014-05-08 at 11:17 +0100, Yi Kong wrote:
> > Hi all,
> > 
> > After previously discussion, I've implemented aggregation across most
> > recent runs. This method significantly reduces noise when applied in
> > combination of Mann-Whitney U test. It replaces standard deviation
> > estimation feature, as it clearly performs better.
> > 
> > On a Cortex-A9 board running one iteration per run, regressions can be
> > easily spotted when the sliding window is greater than 8 runs and
> > aggregated by median, however changes are usually only significant
> > enough after 6 consecutive runs. On x86 machines with 10 iterations, the
> > improvement is not very obvious.
> > 
> > Cheers,
> > Yi Kong
> 
> 
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ARM-est-stdev.png
Type: image/png
Size: 38825 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20140509/4852679e/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ARM-sliding-window.png
Type: image/png
Size: 34826 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20140509/4852679e/attachment-0001.png>