[PATCH] [LNT] Aggregate most recent runs

[Yi Kong]

Hi all,

After previously discussion, I've implemented aggregation across most
recent runs. This method significantly reduces noise when applied in
combination of Mann-Whitney U test. It replaces standard deviation
estimation feature, as it clearly performs better.

On a Cortex-A9 board running one iteration per run, regressions can be
easily spotted when the sliding window is greater than 8 runs and
aggregated by median, however changes are usually only significant
enough after 6 consecutive runs. On x86 machines with 10 iterations, the
improvement is not very obvious.

Cheers,
Yi Kong
-------------- next part --------------
A non-text attachment was scrubbed...
Name: aggregate_over_comparison_runs.diff
Type: text/x-patch
Size: 12249 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20140508/bf4108ad/attachment.bin>