[LLVMdev] LNT BenchmarkGame
t.p.northover at gmail.com
Tue Mar 12 07:24:36 PDT 2013
> Is there any chance that the results are not being checked correctly? Any
> other ideas?
I think I vaguely convinced myself that the infrastructure didn't
actually check whether tests it classified as benchmarks passed or
failed. Not sure I had any good evidence for it other than things like
> I'm tempted to just change the reference output and see what
> happens with the other bots...
Could be worth a try. But if that thing really is generating random
numbers I'm not sure replacing one genuine cast-iron random number
with another is the best solution long-term.
More information about the llvm-dev