[llvm-commits] [llvm] r141591 - in /llvm/trunk

[Bill Wendling]

On Oct 10, 2011, at 5:39 PM, Raja Venkateswaran wrote:

> Thanks for reapplying Ana's patches.
> 
> Can we use this opportunity to discuss the commit testing requirements for
> ARM? Ana's recent patch experience shows that ARM is a widely used backend
> in LLVM and needs to be more extensively tested. Can we discuss the list of
> extended sets that need to be run for ARM backend commit validation? This
> will help us do more checking in future. Here is the list I gathered so far
> 
> - llvm/test
> - projects/test-suite
> - llvm-project/compile-rt
> - SPEC2006
> 
> Are there other tests that LLVM ARM community run on a regular basis that is
> available to everyone?
> 
> Please let me know if we need to move this discussion to LLVMDev list or if
> this issue has already been discussed
> 
Hi Raja,

ARM is very important to most everyone on the list, of course. But I don't think it would be worth it to require more testing before a commit than is done with other back-ends -- like X86. Many people on this list run continuous testers for ARM, and it's among the back-ends tested by the public buildbots (or will be once they're back up and running). I think that the failure we saw today shows the power of our testing, not its limitations. :-) It would have been nicer to catch the bug earlier (that's the case with any bug), but that's a function of time and resources.

That said, if people have suggestions for other testsuites which we can throw at the ARM back-end, by all means chime in!

-bw