[PATCH] [LNT] Use Mann-Whitney U test to identify changes

Anton Korobeynikov anton at korobeynikov.info
Fri May 2 07:35:21 PDT 2014


> There is an older thread "Why is the default LNT aggregation function min
> instead of mean" where Chris and David explain the reason why they have
> chosen 'min'.
>
> I just looked into this again using your new patch, and it seems switching
> from min to mean eliminates very reliably all runs with p <= 0.99 from the
> Run-over-* changes.
I would suggest giving median a try

-- 
With best regards, Anton Korobeynikov
Faculty of Mathematics and Mechanics, Saint Petersburg State University



More information about the llvm-commits mailing list