[LLVMdev] LNT BenchmarkGame

Duncan Sands baldrick at free.fr
Tue Mar 12 09:48:07 PDT 2013

Hi Renato,

On 12/03/13 17:33, Renato Golin wrote:
> On 12 March 2013 16:21, Duncan Sands <baldrick at free.fr
> <mailto:baldrick at free.fr>> wrote:
>     IIRC the reference output is not used by default.  You have to put
>     in the Makefile in order to make use of the reference output.  As
>     BenchmarkGame doesn't have this, are you sure the reference output
>     is causing the problem?
> That was my initial assumption, too. But if I just run that test, the Makefile
> doesn't use GCC at all and only copies the reference_output to the out-nat file.

if you look at the first line of your log

2013-03-12 15:19:41: running: "make" "-k" 
"TARGET_LLVMGCC=/home/rengolin/devel/llvm/build/bin/clang" "TARGET_CXX=None" 
"TARGET_LLVMGXX=/home/rengolin/devel/llvm/build/bin/clang++" "TEST=simple" 
"SingleSource/Benchmarks/BenchmarkGame" "-j" "8" "report" "report.simple.csv"

then you see that it forces USE_REFERENCE_OUTPUT=1.  Maybe LNT does that?

Ciao, Duncan.

> I then copied a "good" output to the reference_output, and the test passed. I'm
> intrigued... ;)
> Attached is a test.log of a local run. The buildbots' logs are pretty similar on
> BenchmarkGame.
> cheers,
> --renato

More information about the llvm-dev mailing list