[LLVMdev] RFC: Change tests to run with fixed (not-host dependent) triple

[Daniel Dunbar]

Hi all,

We consistently see test failures arising because by default many of our
tests run in a mode where the tool (clang or llc) pick host-dependent
behavior. This makes it easy for developers to write tests that pass on
their system, but fail for other developers.

There is some utility in this behavior, as it gives us (unintended) testing
coverage of some things, but overall I think it is a net loss for
productivity.

I propose:

a. We change the test suite to run in such a way that all tools default to
an "unknown" host triple.

b. If someone feels there is missing coverage in some area, we add
increased tests for that area (which get run on all platforms).

c. If there is some reason that running with an "unknown" host triple is
undesirable, I propose that we set the default test triple to be
"x86_64-pc-linux-gnu", and require deviations to be specified.

Comments?

 - Daniel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20121130/492b4cf4/attachment.html>