[PATCH] [LNT] Aggregate most recent runs
Yi.Kong at arm.com
Thu May 8 03:17:07 PDT 2014
After previously discussion, I've implemented aggregation across most
recent runs. This method significantly reduces noise when applied in
combination of Mann-Whitney U test. It replaces standard deviation
estimation feature, as it clearly performs better.
On a Cortex-A9 board running one iteration per run, regressions can be
easily spotted when the sliding window is greater than 8 runs and
aggregated by median, however changes are usually only significant
enough after 6 consecutive runs. On x86 machines with 10 iterations, the
improvement is not very obvious.
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 12249 bytes
Desc: not available
More information about the llvm-commits