[LLVMdev] Test suite on various archs: (Was: Re: [cfe-dev] Announcing 3.1 Release Branch Date!)

[Sylvestre Ledru]

Le mercredi 28 mars 2012 à 00:12 +0200, Sylvestre Ledru a écrit :
> Le mardi 27 mars 2012 à 14:36 -0700, Bill Wendling a écrit :
> > IMPORTANT! IMPORTANT! IMPORTANT!
> > 
> [...]
> 
> > By the way, we are looking for ARM testers. There was a lot of interest in the 3.0 release for an ARM release. We will try to do one this release on a trial basis. We are looking for ARMv7 cortex-a8 and cortex-a9 on Linux.
> If you are interested, I can upload the current trunk version into the
> Debian archive in the experimental suites with the unitary tests
> activated.
> I already uploaded the current trunk of llvm in experimental [1]. It is
> in the NEW queue but I am planning to upload the trunk of clang as soon
> as it get accepted. I was not planning to enable the test suite (the 12
> Debian archs is a huge work) but if you want to get feedback, I can
> enable it...
Replying to myself.

I enabled test suite in the package creation for clang and llvm.

Log are available for clang r154769
https://buildd.debian.org/status/package.php?p=clang&suite=experimental
and LLVM r154766
https://buildd.debian.org/status/package.php?p=llvm-3.1&suite=experimental

Grep for "Unexpected Failures" to find the result 

For example, under armel, I get for LLVM [1] :
  Expected Passes    : 5812
  Expected Failures  : 59
  Unsupported Tests  : 10
  Unexpected Passes  : 12
  Unexpected Failures: 1

and clang [2]:
  Expected Passes    : 4484
  Expected Failures  : 29
  Unsupported Tests  : 3
  Unexpected Passes  : 1
  Unexpected Failures: 30

I am available to upload on request new revision of LLVM and/or Clang in
Debian build systems.
I have also access to the debian porterbox on all Debian supported
architectures [3].

Hope this helps,
Sylvestre

[1]
Unexpected Passing Tests (12):
    LLVM :: ExecutionEngine/2003-01-04-ArgumentBug.ll
    LLVM :: ExecutionEngine/2003-01-04-LoopTest.ll
    LLVM :: ExecutionEngine/2003-01-15-AlignmentTest.ll
    LLVM :: ExecutionEngine/2003-05-06-LivenessClobber.ll
    LLVM :: ExecutionEngine/2003-05-07-ArgumentTest.ll
    LLVM :: ExecutionEngine/2003-08-21-EnvironmentTest.ll
    LLVM ::
ExecutionEngine/2003-10-18-PHINode-ConstantExpr-CondCode-Failure.ll
    LLVM :: ExecutionEngine/hello.ll
    LLVM :: ExecutionEngine/hello2.ll
    LLVM :: ExecutionEngine/simpletest.ll
    LLVM :: ExecutionEngine/stubs.ll
    LLVM :: ExecutionEngine/test-call-no-external-funcs.ll

********************
Failing Tests (1):
    LLVM :: CodeGen/X86/2010-06-14-fast-isel-fs-load.ll


[2] 
Unexpected Passing Tests (1):
    Clang :: CodeGenCXX/member-alignment.cpp

********************
Failing Tests (30):
    Clang :: CXX/conv/conv.prom/p2.cpp
    Clang :: CXX/special/class.copy/p15-inclass.cpp
    Clang :: CodeGen/2005-06-15-ExpandGotoInternalProblem.c
    Clang :: CodeGen/2006-01-13-StackSave.c
    Clang :: CodeGen/2008-07-17-no-emit-on-error.c
    Clang :: CodeGen/2008-07-30-implicit-initialization.c
    Clang ::
CodeGen/2008-07-31-promotion-of-compound-pointer-arithmetic.c
    Clang :: CodeGen/blocks-seq.c
    Clang :: CodeGen/packed-structure.c
    Clang :: CodeGenCXX/compound-literals.cpp
    Clang :: CodeGenCXX/copy-constructor-elim-2.cpp
    Clang :: CodeGenCXX/cxx0x-initializer-references.cpp
    Clang ::
CodeGenCXX/cxx0x-initializer-stdinitializerlist-startend.cpp
    Clang :: CodeGenCXX/cxx0x-initializer-stdinitializerlist.cpp
    Clang :: CodeGenCXX/for-range-temporaries.cpp
    Clang :: CodeGenCXX/for-range.cpp
    Clang :: CodeGenCXX/virt-call-offsets.cpp
    Clang :: CodeGenCXX/x86-64-abi-sret-vs-2word-struct-param.cpp
    Clang :: Driver/debug-options-as.c
    Clang :: Driver/hello.c
    Clang :: Driver/linux-header-search.cpp
    Clang :: PCH/pth.c
    Clang :: Preprocessor/include-pth.c
    Clang :: Preprocessor/mmx.c
    Clang :: Preprocessor/predefined-arch-macros.c
    Clang :: Sema/arm-neon-types.c
    Clang :: Sema/format-strings.c
    Clang :: Sema/wchar.c
    Clang :: Tooling/clang-check-pwd.cpp
    Clang :: Tooling/clang-check.cpp

[3]
http://www.debian.org/ports/