[PATCH] [LNT] Use Mann-Whitney U test to identify changes

Tobias Grosser tobias at grosser.es
Fri May 2 07:54:22 PDT 2014


On 02/05/2014 16:35, Anton Korobeynikov wrote:
>> There is an older thread "Why is the default LNT aggregation function min
>> instead of mean" where Chris and David explain the reason why they have
>> chosen 'min'.
>>
>> I just looked into this again using your new patch, and it seems switching
>> from min to mean eliminates very reliably all runs with p <= 0.99 from the
>> Run-over-* changes.
> I would suggest giving median a try

Sorry, that was a typo. I meant the 'median' as it is today already 
provided as an optional aggregation function by LNT.

Cheers,
Tobias



More information about the llvm-commits mailing list