[LLVMdev] LNT BenchmarkGame

[Tim Northover]

> Is there any chance that the results are not being checked correctly? Any
> other ideas?

I think I vaguely convinced myself that the infrastructure didn't
actually check whether tests it classified as benchmarks passed or
failed. Not sure I had any good evidence for it other than things like
you're seeing.

> I'm tempted to just change the reference output and see what
> happens with the other bots...

Could be worth a try. But if that thing really is generating random
numbers I'm not sure replacing one genuine cast-iron random number
with another is the best solution long-term.

Tim.