[LLVMdev] Marking a test suite test XFAIL

Dale Johannesen dalej at apple.com
Thu Jul 22 15:04:08 PDT 2010


On Jul 22, 2010, at 2:44 PMPDT, Patrick Alexander Simmons wrote:

> From http://llvm.org/docs/TestingGuide.html
>
> Some tests are known to fail. Some are bugs that we have not fixed  
> yet;
> others are features that we haven't added yet (or may never add). In
> DejaGNU, the result for such tests will be XFAIL (eXpected FAILure).  
> In
> this way, you can tell the difference between an expected and  
> unexpected
> failure.
>
> The tests in the test suite have no such feature at this time. If the
> test passes, only warnings and other miscellaneous output will be
> generated. If a test fails, a large <program> FAILED message will be
> displayed. This will help you separate benign warnings from actual  
> test
> failures.
>
> Does this mean there is no way to selectively disable a backend or to

It can be done in the Makefiles, but it's not as clean as XFAIL.  Look  
at External/SPEC/CINT2000/Makefile for examples.




More information about the llvm-dev mailing list