[LLVMdev] LNT BenchmarkGame

[Duncan Sands]

Hi Renato,

On 12/03/13 17:33, Renato Golin wrote:
> On 12 March 2013 16:21, Duncan Sands <baldrick at free.fr
> <mailto:baldrick at free.fr>> wrote:
>
>     IIRC the reference output is not used by default.  You have to put
>        USE_REFERENCE_OUTPUT := 1
>     in the Makefile in order to make use of the reference output.  As
>     BenchmarkGame doesn't have this, are you sure the reference output
>     is causing the problem?
>
>
> That was my initial assumption, too. But if I just run that test, the Makefile
> doesn't use GCC at all and only copies the reference_output to the out-nat file.

if you look at the first line of your log

2013-03-12 15:19:41: running: "make" "-k" 
"TARGET_LLVMGCC=/home/rengolin/devel/llvm/build/bin/clang" "TARGET_CXX=None" 
"LLI_OPTFLAGS=-O3" "TARGET_CC=None" 
"TARGET_LLVMGXX=/home/rengolin/devel/llvm/build/bin/clang++" "TEST=simple" 
"CC_UNDER_TEST_IS_CLANG=1" "ENABLE_PARALLEL_REPORT=1" "TARGET_FLAGS=" 
"USE_REFERENCE_OUTPUT=1" "CC_UNDER_TEST_TARGET_IS_X86_64=1" "OPTFLAGS=-O3" 
"LLC_OPTFLAGS=-O3" "ENABLE_OPTIMIZED=1" "ARCH=x86_64" 
"ENABLE_HASHED_PROGRAM_OUTPUT=1" "DISABLE_JIT=1" "-C" 
"SingleSource/Benchmarks/BenchmarkGame" "-j" "8" "report" "report.simple.csv"

then you see that it forces USE_REFERENCE_OUTPUT=1.  Maybe LNT does that?

Ciao, Duncan.

>
> I then copied a "good" output to the reference_output, and the test passed. I'm
> intrigued... ;)
>
> Attached is a test.log of a local run. The buildbots' logs are pretty similar on
> BenchmarkGame.
>
> cheers,
> --renato