[LLVMdev] Proposal: change LNT’s regression detection algorithm and how it is used to reduce false positives

[Renato Golin]

On 20 May 2015 at 23:31, Sean Silva <chisophugis at gmail.com> wrote:
> In the last 10,000 revisions of LLVM+Clang, only 10 revisions actually
> caused the binary of MultiSource/Benchmarks/BitBench/five11 to change. So if
> just store a hash of the binary in the database, we should be able to pool
> all samples we have collected while the binary is the the same as it
> currently is, which will let us use significantly more datapoints for the
> reference.

+1


> Also, we can trivially eliminate running the regression detection algorithm
> if the binary hasn't changed.

+2!

--renato